-- Logs begin at Fri 2022-08-19 20:13:29 UTC, end at Fri 2022-08-19 21:27:20 UTC. -- Aug 19 20:52:04.331104 dv-cinder-852209-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 20:52:04.338405 dv-cinder-852209-6-smb devstack@keystone.service[81626]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 20:52:04.340426 dv-cinder-852209-6-smb devstack@keystone.service[81626]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 20:52:04 2022] *** Aug 19 20:52:04.340426 dv-cinder-852209-6-smb devstack@keystone.service[81626]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 20:52:04.340426 dv-cinder-852209-6-smb devstack@keystone.service[81626]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 20:52:04.340426 dv-cinder-852209-6-smb devstack@keystone.service[81626]: nodename: dv-cinder-852209-6-smb Aug 19 20:52:04.340426 dv-cinder-852209-6-smb devstack@keystone.service[81626]: machine: x86_64 Aug 19 20:52:04.340426 dv-cinder-852209-6-smb devstack@keystone.service[81626]: clock source: unix Aug 19 20:52:04.340426 dv-cinder-852209-6-smb devstack@keystone.service[81626]: pcre jit disabled Aug 19 20:52:04.340883 dv-cinder-852209-6-smb devstack@keystone.service[81626]: detected number of CPU cores: 4 Aug 19 20:52:04.340883 dv-cinder-852209-6-smb devstack@keystone.service[81626]: current working directory: / Aug 19 20:52:04.340883 dv-cinder-852209-6-smb devstack@keystone.service[81626]: detected binary path: /usr/bin/uwsgi-core Aug 19 20:52:04.340883 dv-cinder-852209-6-smb devstack@keystone.service[81626]: your processes number limit is 47680 Aug 19 20:52:04.340883 dv-cinder-852209-6-smb devstack@keystone.service[81626]: your memory page size is 4096 bytes Aug 19 20:52:04.340883 dv-cinder-852209-6-smb devstack@keystone.service[81626]: detected max file descriptor number: 2048 Aug 19 20:52:04.340883 dv-cinder-852209-6-smb devstack@keystone.service[81626]: lock engine: pthread robust mutexes Aug 19 20:52:04.340883 dv-cinder-852209-6-smb devstack@keystone.service[81626]: thunder lock: enabled Aug 19 20:52:04.340883 dv-cinder-852209-6-smb devstack@keystone.service[81626]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 20:52:04.340883 dv-cinder-852209-6-smb devstack@keystone.service[81626]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 20:52:04.382374 dv-cinder-852209-6-smb devstack@keystone.service[81626]: Python main interpreter initialized at 0x56386f19d9c0 Aug 19 20:52:04.382374 dv-cinder-852209-6-smb devstack@keystone.service[81626]: python threads support enabled Aug 19 20:52:04.382374 dv-cinder-852209-6-smb devstack@keystone.service[81626]: your server socket listen backlog is limited to 100 connections Aug 19 20:52:04.382374 dv-cinder-852209-6-smb devstack@keystone.service[81626]: your mercy for graceful operations on workers is 90 seconds Aug 19 20:52:04.382812 dv-cinder-852209-6-smb devstack@keystone.service[81626]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 20:52:04.382895 dv-cinder-852209-6-smb devstack@keystone.service[81626]: *** Operational MODE: preforking *** Aug 19 20:52:04.383131 dv-cinder-852209-6-smb devstack@keystone.service[81626]: *** uWSGI is running in multiple interpreter mode *** Aug 19 20:52:04.383131 dv-cinder-852209-6-smb devstack@keystone.service[81626]: spawned uWSGI master process (pid: 81626) Aug 19 20:52:04.383338 dv-cinder-852209-6-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 19 20:52:04.384873 dv-cinder-852209-6-smb devstack@keystone.service[81626]: spawned uWSGI worker 1 (pid: 81640, cores: 1) Aug 19 20:52:04.384873 dv-cinder-852209-6-smb devstack@keystone.service[81626]: spawned uWSGI worker 2 (pid: 81641, cores: 1) Aug 19 20:52:04.385034 dv-cinder-852209-6-smb devstack@keystone.service[81626]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 20:52:08.739658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 20:52:08.739658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: from cryptography.utils import int_from_bytes Aug 19 20:52:08.740440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 20:52:08.740440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: from cryptography.utils import int_from_bytes Aug 19 20:52:08.745527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 20:52:08.745527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: from cryptography.utils import int_from_bytes Aug 19 20:52:08.746021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 20:52:08.746021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: from cryptography.utils import int_from_bytes Aug 19 20:52:08.791648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 20:52:08.791827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 20:52:08.792022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] command line args: [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 20:52:08.792297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 20:52:08.792479 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ================================================================================ {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 20:52:08.792742 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] admin_token = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.792997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] config_dir = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.793186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.793373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] config_source = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.793557 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] debug = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.793764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.794251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.794363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.795271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.795271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.795271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.795500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 20:52:08.795572 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_config_append = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.795638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 20:52:08.795703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.795766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] command line args: [] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 20:52:08.795829 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_dir = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.795829 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_file = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.796453 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 20:52:08.796516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.796667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ================================================================================ {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 20:52:08.796837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.796982 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.797072 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] admin_token = **** {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.797234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.797488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] config_dir = [] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.797614 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.797697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.797774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.797903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] config_source = [] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.797985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.798056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] debug = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.798187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.798264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.798410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.798497 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.798625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.798709 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.798906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.798997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.799148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.799227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.799381 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] list_limit = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.799498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.799618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] log_config_append = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.799740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.799855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.799973 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] log_dir = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.800091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.800220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] log_file = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.800342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.800463 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.800585 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.800706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] publish_errors = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.800820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.800940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.801061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.801179 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.801288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.801407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.801526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.801654 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.801769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.801883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.801995 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.802108 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] standard_threads = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.802221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.802342 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.802462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.802577 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.802697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.802827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.802941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.803069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] use_journal = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.803069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] use_json = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.803296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.803431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] use_stderr = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.803554 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.803675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] use_syslog = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.803791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.803912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.803912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.804132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.804255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.804370 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] publish_errors = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.804484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.804639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.804801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.804920 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.805033 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.805146 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.805259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.805376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.805376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.805608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.805729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] standard_threads = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.805844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.805958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.806112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.806238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.806360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.806475 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.806588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.806707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] use_journal = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.806707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] use_json = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.806963 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.807080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] use_stderr = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.807194 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.807313 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] use_syslog = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.807427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.807540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:52:08.807661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.807776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.807891 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.808005 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.808117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.808236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.808359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.808480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.808595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.808714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.808828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.808947 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.809073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.809189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.809189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.809401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.809615 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.809746 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.809876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.809992 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.810107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.810220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.810339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.810454 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.810642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.810784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.810912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.811026 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.811141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.811263 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.811378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.811492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.812169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.812294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.812409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.812532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.812647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.812766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.812880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.812993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.812993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.813222 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.813338 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.813338 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.813557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.813670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.813789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.813911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.814026 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.814145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.814267 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.814381 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.814494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.814653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.814809 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.814926 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.815046 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.815161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.815275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.815405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.815527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.815648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.815763 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.815876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.815996 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.816119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.816235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.816355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.816471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.816584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.816704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.816889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.817006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.817121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.817235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.817349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.817463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.817585 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.817701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.817814 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.817928 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.818041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.818155 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.818155 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.818377 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.818492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.818612 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.818726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.818856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.818988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.819105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.819219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.819333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.819446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.819569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.819691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.819812 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.819940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.820066 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.820173 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.820271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.820378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.820484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.820584 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.820693 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.820797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.820895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.821002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.821110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.821230 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.821347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.821463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.821586 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.821704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.821833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.821956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.822071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.822176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.822295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.822416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.822532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.822655 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.822784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.822901 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.823017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.823120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.823249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.823375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.823492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.823607 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.823713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.823831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.823973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.824128 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.824254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.824369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.824473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.824586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.824742 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.824861 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.824975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.825090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.825204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.825323 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.825447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.825563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.825678 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.825793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.825793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.826006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.826129 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.826251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.826367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.826481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.826603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.826718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.826907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.827024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.827151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.827335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.827459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.827587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.827713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.827830 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.827946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.828060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.828175 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.828290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.828290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.828583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.828699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.828699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.828913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.829040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.829166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.829290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.829407 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.829528 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.829644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.829758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.external = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.829872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.829996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.830112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.830233 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.830350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.830465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.830579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.830702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.password = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.830837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.830952 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] auth.token = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.831078 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.831194 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.831308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.831431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.831560 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.831685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.831801 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.831916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.832030 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.832176 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.832302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.832302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.832530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.832530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.832745 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.832859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.832972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.833095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.833214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.833214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] auth.external = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.833429 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.833545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.833667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.833667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.833896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.834012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.834126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.834242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.834620 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] auth.password = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.834620 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] auth.token = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.834898 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.835015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.835129 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.835245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.835364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.835492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.835610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.835726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.835849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.835966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.836081 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.836204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.836323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.836438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.836552 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.836668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] credential.caching = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.836783 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.836906 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.837028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.837149 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.837266 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.837382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.837497 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.837621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.837737 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.837853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.837967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.838082 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.838197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.838322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.838440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.838561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.838677 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.838842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.838974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.839093 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.839208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.839330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.839448 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.839564 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.839687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.839805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.839920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.840035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.840135 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.840232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.840355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.840474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] federation.caching = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.840589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.840704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.840819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.840934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.841058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.841181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.841298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.841419 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.841537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.841658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.841784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.841909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.842016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.842131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.842256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.842378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.842566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.842687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.843366 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.843522 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.843641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.843757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.843886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.844022 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.caching = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.844184 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.844303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.844418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.844534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.844660 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.844778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.844778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.845034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.845034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.845254 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.845379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.845379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.845598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.845714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.845829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.845944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.846068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.846185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.846301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.846416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.846531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.846647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.846821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.846942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.847057 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.847172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.847287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.847402 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.847526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.847644 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.847644 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.847861 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.847861 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.848077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.848077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.848309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.848425 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.848540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.848655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.848770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.848894 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.849012 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.849127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.849249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.849365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.849489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.849606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.849728 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.849844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.849961 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.850076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.850199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.850199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.850418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.850533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.850648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.850776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.850906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.851058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.851173 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.851323 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.851441 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.851557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.851686 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.851805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.851921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.852043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.852159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.852274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.852398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.852515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.852631 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.852745 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.852861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.852977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.853101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.853218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.853334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.853448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.853563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.853677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.853677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.853904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.854020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.854020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.854236 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.854351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.854351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.854577 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.854693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.854864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.855013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.855013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.855250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.855368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.855368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.855584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.855584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.855800 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.855922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.855922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.856139 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.856262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.856262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.856478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.856603 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.856720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.856836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.856951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.857067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.857181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.857306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.857306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.857525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.857641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.857756 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.857756 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.857981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.858099 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.858214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.858214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.859078 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.859260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.859260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.859528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.859645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.859762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.859878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.859993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.860118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.860237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.860353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.860471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.860586 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.860702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.860827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.860945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.861061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.861176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.861292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.861408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.861534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.861652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.861768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.861883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.861981 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.862135 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.862392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.862514 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.862630 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.862895 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.863008 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.863220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.863375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.863460 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.863705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.863862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.863941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.864183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.864315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.864427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] role.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.864688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] role.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.864953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.865033 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.865102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.865171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.865233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.865408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.865497 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.865662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.865771 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.865915 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.865994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.866166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.866264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.866412 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.866506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.866650 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.866759 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.866918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.866998 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.867157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.867322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] resource.caching = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.867399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.867470 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.867835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.867922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.867996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.868141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.868222 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.868590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.868764 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.868899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.869064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.869212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.869352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.869487 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.869617 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.869802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.869951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.870091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.870249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.870388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.870519 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.870649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.870796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] role.caching = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.870945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.871077 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] role.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.871208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.871338 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.871468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.871598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.871749 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.871883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.872023 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.872161 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.872293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.872423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.872561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.872693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.872824 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.872955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.873085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.873085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.873338 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.873481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.873612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.873741 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.873871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.874010 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.874143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.874273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.874403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.874532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.874663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.874876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.875013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.875184 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.875184 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.875446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.875576 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.875715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.875847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.875977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.876109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.876109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.876355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.876492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.876623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.876752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.876882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.877012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.877152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.877292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.877424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.877553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.877683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.877683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.877927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.878064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.878197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.connection = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.878337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.878476 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.878608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.878753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.878753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.879028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.879162 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.879553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.879684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.879813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.879943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.880080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.880213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.880344 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.880474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.880603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.880733 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.880871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] token.caching = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.881003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.881143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.881274 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.881404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.881534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.881672 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.881804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.881934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.882064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.882194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.882324 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.882464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.882595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.882726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.882920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.883052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.883182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.883182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 20:52:08.883443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.883443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.883443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.883443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.883443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.883443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.884164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.884164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.884164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.884522 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.connection = **** {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.884522 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.884955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.885227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.885450 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.885688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.885926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.886163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.886400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.886645 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.886904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.887245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.887488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.888670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.888924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.889179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.889417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.889726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.890150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:52:08.890451 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 20:52:08.912512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:08.912749 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:08.912982 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:08.918028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:08.918262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:08.918489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:08.922657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:08.927734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:08.951169 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:08.951401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:08.954502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:08.954766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.011770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.012718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.062060 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.062388 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.063050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.063295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.222944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.223176 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.223406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.223631 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.223736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.223856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.223974 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.224079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.224199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.224419 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.224636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.224850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.248135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.248284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.248420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.248519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.248596 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.248669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.248785 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.248869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.249034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.249606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.249773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.249922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.250004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.250184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.261652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.261759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.275440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.275559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.275638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.275757 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.275840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.275990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.276070 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.276225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.276316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.276433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.276523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.276645 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.276728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.276860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 20:52:09.293807 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.294016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 20:52:09.294239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.294358 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.294438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 20:52:09.294560 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 20:52:09.294821 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.294905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.295030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 20:52:09.295111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.295313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.295586 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.295666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.296414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.296676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.296946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.306118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.306380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.306508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.306658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.306769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.306957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.307040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.307247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.314893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.314995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.317764 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.317904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.318056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.318198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.318342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.318486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.318625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.318795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.318934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.319086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.319194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.319355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.319465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.319634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.319742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.319915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.320124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.320301 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.320402 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.320584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.320664 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.320861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.344751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.345140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.346233 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.346526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.346607 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.346903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.351263 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.351558 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.351673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.351841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.351933 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.352129 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.358217 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.358526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.358638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.359003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.362805 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.363106 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.363396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.363505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.363687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.363784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.363971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.364052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.364254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.364334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.364534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.364615 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.364810 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.364890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.365102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.365370 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.382853 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.383144 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.383521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.383805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.387048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.387658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.390884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.391197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.391774 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.392085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.395438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.396304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.398596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.399456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.401868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.402175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.402466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.402662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.402764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.402984 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.403079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.403271 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.403354 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.403557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.403835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.404123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.419905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.420214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.420490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.420761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.420871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.421382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.421793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.422062 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.427700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.428904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.429256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.429540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.430434 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.430712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.432212 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.432504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.432794 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.433103 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.433347 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.433430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.433631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.433914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.434215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.434491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.444970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.445260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.445548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.445833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.446120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.446394 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.446486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.446677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.446794 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.446980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.447258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.447538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.447816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.448100 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.462782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.464311 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.465832 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.467351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.468942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.470400 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.470629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.471920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.472085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.472223 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.472530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.473552 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.473836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.474132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.479052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.480521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.480610 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.482034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.483961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.484259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.484583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.484873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.485754 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.486054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.486341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.486624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.492869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.493172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.493462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.494532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.494855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.495139 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.500551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.500845 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.501137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.501424 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.501706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.501997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.502279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.502413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 20:52:09.502556 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.502699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.502870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.503005 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.503157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.503284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.503443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.503559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.503711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.503838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.504001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.504112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.504520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.504615 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.504896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.505174 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.505452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.505711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.505991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.506248 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 20:52:09.540029 dv-cinder-852209-6-smb devstack@keystone.service[81641]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56386f19d9c0 pid: 81641 (default app) Aug 19 20:52:09.541295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56386f19d9c0 pid: 81640 (default app) Aug 19 20:52:09.543465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28400a-c445-47ed-984b-88bb789e1314 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:09.543763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28400a-c445-47ed-984b-88bb789e1314 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:09.544045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28400a-c445-47ed-984b-88bb789e1314 None None] PATH_INFO: `/v3` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:09.548763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Fri Aug 19 20:52:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:16.214979 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b9cc1-6a2a-4557-a552-2e9b79fbd5b8 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:16.215580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b9cc1-6a2a-4557-a552-2e9b79fbd5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:16.215856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b9cc1-6a2a-4557-a552-2e9b79fbd5b8 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:16.220829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:52:16.226386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaf6fa-b57b-4e84-a98e-cfe1c2fabfcc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:16.226836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaf6fa-b57b-4e84-a98e-cfe1c2fabfcc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:16.226970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaf6fa-b57b-4e84-a98e-cfe1c2fabfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:16.298977 dv-cinder-852209-6-smb devstack@keystone.service[81641]: INFO dbcounter [None req-7edaf6fa-b57b-4e84-a98e-cfe1c2fabfcc None None] Registered counter for database keystone Aug 19 20:52:16.318472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG oslo_db.sqlalchemy.engines [None req-7edaf6fa-b57b-4e84-a98e-cfe1c2fabfcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 20:52:16.324837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writer thread running {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 20:52:16.510268 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG passlib.handlers.bcrypt [None req-7edaf6fa-b57b-4e84-a98e-cfe1c2fabfcc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81641) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 20:52:16.510598 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG passlib.handlers.bcrypt [None req-7edaf6fa-b57b-4e84-a98e-cfe1c2fabfcc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81641) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 20:52:16.567284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7edaf6fa-b57b-4e84-a98e-cfe1c2fabfcc None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:16.568887 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7edaf6fa-b57b-4e84-a98e-cfe1c2fabfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:16.701083 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 20:52:17.155756 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b9cc1-6a2a-4557-a552-2e9b79fbd5b8 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:17.223939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: INFO dbcounter [None req-fb9b9cc1-6a2a-4557-a552-2e9b79fbd5b8 None None] Registered counter for database keystone Aug 19 20:52:17.247628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG oslo_db.sqlalchemy.engines [None req-fb9b9cc1-6a2a-4557-a552-2e9b79fbd5b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 20:52:17.254796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writer thread running {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 20:52:17.376151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b9cc1-6a2a-4557-a552-2e9b79fbd5b8 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:17.380734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662702b1-8870-4a67-ba54-0339527ff4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:17.381363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662702b1-8870-4a67-ba54-0339527ff4ed admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:17.381645 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662702b1-8870-4a67-ba54-0339527ff4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:17.381919 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662702b1-8870-4a67-ba54-0339527ff4ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:17.390777 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662702b1-8870-4a67-ba54-0339527ff4ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:17.442213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: WARNING keystone.common.rbac_enforcer.enforcer [None req-662702b1-8870-4a67-ba54-0339527ff4ed admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 20:52:17.442484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662702b1-8870-4a67-ba54-0339527ff4ed admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:17.453135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Fri Aug 19 20:52:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 20:52:17.459155 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaf6fa-b57b-4e84-a98e-cfe1c2fabfcc None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:17.473890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaf6fa-b57b-4e84-a98e-cfe1c2fabfcc None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:17.478333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90884d9-aac9-4b4d-a7c0-d57a380f1170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:17.479473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90884d9-aac9-4b4d-a7c0-d57a380f1170 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:17.479764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90884d9-aac9-4b4d-a7c0-d57a380f1170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:17.480045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90884d9-aac9-4b4d-a7c0-d57a380f1170 admin admin] PATH_INFO: `/v3/projects/ff8263e17f324e50a27d4a90ba61dbe6` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:17.481637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90884d9-aac9-4b4d-a7c0-d57a380f1170 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff8263e17f324e50a27d4a90ba61dbe6)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:17.536816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b90884d9-aac9-4b4d-a7c0-d57a380f1170 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 20:52:17.537164 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90884d9-aac9-4b4d-a7c0-d57a380f1170 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:17.541834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Fri Aug 19 20:52:17 2022] GET /identity/v3/projects/ff8263e17f324e50a27d4a90ba61dbe6 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:19.419859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70f04-966c-413e-9d60-f4118db333fe None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:19.420447 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70f04-966c-413e-9d60-f4118db333fe None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:19.420447 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70f04-966c-413e-9d60-f4118db333fe None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:19.425228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:19.430704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7f332-0d7f-40e7-bd6c-9d47b57c4bbf None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:19.431186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7f332-0d7f-40e7-bd6c-9d47b57c4bbf None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:19.431278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7f332-0d7f-40e7-bd6c-9d47b57c4bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:19.451096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d3c7f332-0d7f-40e7-bd6c-9d47b57c4bbf None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:19.453190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d3c7f332-0d7f-40e7-bd6c-9d47b57c4bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:19.462397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 20:52:19.728674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f70f04-966c-413e-9d60-f4118db333fe None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:19.740814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f70f04-966c-413e-9d60-f4118db333fe None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:19.745064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47149d6f-7145-4cc7-b378-26b8f5c4ada6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:19.745679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47149d6f-7145-4cc7-b378-26b8f5c4ada6 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:19.745964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47149d6f-7145-4cc7-b378-26b8f5c4ada6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:19.746242 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47149d6f-7145-4cc7-b378-26b8f5c4ada6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:19.755559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47149d6f-7145-4cc7-b378-26b8f5c4ada6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:19.757339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47149d6f-7145-4cc7-b378-26b8f5c4ada6 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:19.766792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Fri Aug 19 20:52:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 20:52:19.772514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7f332-0d7f-40e7-bd6c-9d47b57c4bbf None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:19.782716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7f332-0d7f-40e7-bd6c-9d47b57c4bbf None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:19.787114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb9d2d-4aa3-4a9f-b047-2ed48499e880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:19.787741 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb9d2d-4aa3-4a9f-b047-2ed48499e880 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:19.788023 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb9d2d-4aa3-4a9f-b047-2ed48499e880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:19.788382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb9d2d-4aa3-4a9f-b047-2ed48499e880 admin admin] PATH_INFO: `/v3/users/0e229cb6df1d467b90bf2948d7f02eb9` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:19.789691 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb9d2d-4aa3-4a9f-b047-2ed48499e880 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e229cb6df1d467b90bf2948d7f02eb9)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:19.791554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb9d2d-4aa3-4a9f-b047-2ed48499e880 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:19.793092 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Fri Aug 19 20:52:19 2022] GET /identity/v3/users/0e229cb6df1d467b90bf2948d7f02eb9 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:21.787286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67644988-9929-45ab-821e-e380ef088d79 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:21.787858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67644988-9929-45ab-821e-e380ef088d79 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:21.787858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67644988-9929-45ab-821e-e380ef088d79 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:21.789186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:52:21.796395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c7230-f50b-4fe8-ba40-f841caa09868 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:21.797080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c7230-f50b-4fe8-ba40-f841caa09868 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:21.797381 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c7230-f50b-4fe8-ba40-f841caa09868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:21.822086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f61c7230-f50b-4fe8-ba40-f841caa09868 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:21.823456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f61c7230-f50b-4fe8-ba40-f841caa09868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:21.835091 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97e886-c609-4e11-b0e6-a89f46cf0589 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:21.835451 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97e886-c609-4e11-b0e6-a89f46cf0589 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:21.835791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97e886-c609-4e11-b0e6-a89f46cf0589 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:21.837431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:52:21.844253 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fce055-b683-424b-b550-b68774e86281 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:21.844538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fce055-b683-424b-b550-b68774e86281 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:21.844812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fce055-b683-424b-b550-b68774e86281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:21.895607 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG passlib.handlers.bcrypt [None req-35fce055-b683-424b-b550-b68774e86281 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81640) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 20:52:21.896274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG passlib.handlers.bcrypt [None req-35fce055-b683-424b-b550-b68774e86281 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81640) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 20:52:21.924194 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:21.947384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-35fce055-b683-424b-b550-b68774e86281 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:21.949202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-35fce055-b683-424b-b550-b68774e86281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:22.060823 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:52:22.206475 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c7230-f50b-4fe8-ba40-f841caa09868 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:22.250049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:22.340816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fce055-b683-424b-b550-b68774e86281 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:22.374807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c7230-f50b-4fe8-ba40-f841caa09868 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:22.426401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa577c-62cc-4d5f-9b59-6e3390dc9d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:22.427417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa577c-62cc-4d5f-9b59-6e3390dc9d68 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:22.427854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa577c-62cc-4d5f-9b59-6e3390dc9d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:22.428302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa577c-62cc-4d5f-9b59-6e3390dc9d68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:22.446678 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa577c-62cc-4d5f-9b59-6e3390dc9d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-bbfa577c-62cc-4d5f-9b59-6e3390dc9d68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:22.457467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:22.459461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:22.461346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:22.461346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:22.461346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:22.461346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:22.461346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:22.461346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:22.461346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:22.461346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:22.461346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:22.461346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:22.461346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:22.461346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:52:22.461346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:22.466460 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa577c-62cc-4d5f-9b59-6e3390dc9d68 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:22.507469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fce055-b683-424b-b550-b68774e86281 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:22.510998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:22.560328 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a1db7-8e41-4003-ba4c-55dce8036892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:22.562052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a1db7-8e41-4003-ba4c-55dce8036892 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:22.562444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a1db7-8e41-4003-ba4c-55dce8036892 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:22.562865 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a1db7-8e41-4003-ba4c-55dce8036892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:22.591003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:22.613063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa577c-62cc-4d5f-9b59-6e3390dc9d68 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:22.652260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5a5e0-3340-4587-85ee-917145b9a302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:22.653012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5a5e0-3340-4587-85ee-917145b9a302 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:22.653366 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5a5e0-3340-4587-85ee-917145b9a302 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:22.653716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5a5e0-3340-4587-85ee-917145b9a302 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:22.654493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5a5e0-3340-4587-85ee-917145b9a302 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:22.655458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5a5e0-3340-4587-85ee-917145b9a302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:22.657115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5a5e0-3340-4587-85ee-917145b9a302 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:22.666513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a1db7-8e41-4003-ba4c-55dce8036892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:22.668183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a1db7-8e41-4003-ba4c-55dce8036892 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:22.671724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:22.677679 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5a5e0-3340-4587-85ee-917145b9a302 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:22.787359 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:52:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:52:22.792965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a1db7-8e41-4003-ba4c-55dce8036892 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:22.795439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5a5e0-3340-4587-85ee-917145b9a302 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:22.797020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:22.836150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9230985-a619-4e8e-9e7e-858ec5d75484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:22.836800 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9230985-a619-4e8e-9e7e-858ec5d75484 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:22.837077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9230985-a619-4e8e-9e7e-858ec5d75484 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:22.837356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9230985-a619-4e8e-9e7e-858ec5d75484 None admin] PATH_INFO: `/v3/users/0e229cb6df1d467b90bf2948d7f02eb9` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:22.838584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9230985-a619-4e8e-9e7e-858ec5d75484 None admin] RBAC: Authorizing `identity:get_user(user_id=0e229cb6df1d467b90bf2948d7f02eb9)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:22.840115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9230985-a619-4e8e-9e7e-858ec5d75484 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:22.841857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:22 2022] GET /identity/v3/users/0e229cb6df1d467b90bf2948d7f02eb9 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:22.847756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9230985-a619-4e8e-9e7e-858ec5d75484 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:22.866334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:22.911861 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a1db7-8e41-4003-ba4c-55dce8036892 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:22.952914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b1bc6-5405-44a2-b58f-960d09ebd1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:22.953836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b1bc6-5405-44a2-b58f-960d09ebd1cd None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:22.954124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b1bc6-5405-44a2-b58f-960d09ebd1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:22.954403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b1bc6-5405-44a2-b58f-960d09ebd1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:22.980224 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b1bc6-5405-44a2-b58f-960d09ebd1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:22.981827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b1bc6-5405-44a2-b58f-960d09ebd1cd None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:22.982257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9230985-a619-4e8e-9e7e-858ec5d75484 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-869b1bc6-5405-44a2-b58f-960d09ebd1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:52:23.004982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:23.007081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:52:23.009492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:52:23.009492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:52:23.009492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:23.009492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 9/18] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:52:23.016311 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b1bc6-5405-44a2-b58f-960d09ebd1cd None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:23.038304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397312e-39a5-49d8-9ff5-c0e632f42582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:23.039156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397312e-39a5-49d8-9ff5-c0e632f42582 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:23.039555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397312e-39a5-49d8-9ff5-c0e632f42582 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:23.039949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397312e-39a5-49d8-9ff5-c0e632f42582 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:23.041312 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397312e-39a5-49d8-9ff5-c0e632f42582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:23.043051 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397312e-39a5-49d8-9ff5-c0e632f42582 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:23.044962 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 10/19] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:52:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:23.054570 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397312e-39a5-49d8-9ff5-c0e632f42582 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:23.103477 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:23.166879 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:23.167619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b1bc6-5405-44a2-b58f-960d09ebd1cd None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:23.191055 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397312e-39a5-49d8-9ff5-c0e632f42582 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:23.210412 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b36cb-c0c3-4fec-98f2-abfdc4ad9aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:23.211311 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b36cb-c0c3-4fec-98f2-abfdc4ad9aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:23.211688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b36cb-c0c3-4fec-98f2-abfdc4ad9aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:23.212047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b36cb-c0c3-4fec-98f2-abfdc4ad9aa4 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:23.212887 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b36cb-c0c3-4fec-98f2-abfdc4ad9aa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:23.213286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b36cb-c0c3-4fec-98f2-abfdc4ad9aa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:23.215030 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b36cb-c0c3-4fec-98f2-abfdc4ad9aa4 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:23.237235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625583a-ac51-4570-8f83-168f703252da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:23.238404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625583a-ac51-4570-8f83-168f703252da None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:23.238846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625583a-ac51-4570-8f83-168f703252da None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:23.239245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625583a-ac51-4570-8f83-168f703252da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:23.240360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625583a-ac51-4570-8f83-168f703252da None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.domain.id=default, user.id=0e229cb6df1d467b90bf2948d7f02eb9) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:23.240763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625583a-ac51-4570-8f83-168f703252da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:23.242085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 10/20] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:23.242980 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625583a-ac51-4570-8f83-168f703252da None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:23.255799 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 11/21] 10.222.0.17 () {56 vars in 1322 bytes} [Fri Aug 19 20:52:23 2022] GET /identity/v3/role_assignments?user.id=0e229cb6df1d467b90bf2948d7f02eb9&scope.domain.id=default&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 233 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:26.197829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223ff88-5246-4b11-9574-846ea9026942 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:26.198378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223ff88-5246-4b11-9574-846ea9026942 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:26.198378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223ff88-5246-4b11-9574-846ea9026942 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:26.199908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 11/22] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:26.206307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582766d6-86fa-4629-9be7-1218dd86ba9f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:26.207147 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582766d6-86fa-4629-9be7-1218dd86ba9f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:26.207614 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582766d6-86fa-4629-9be7-1218dd86ba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:26.239149 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-582766d6-86fa-4629-9be7-1218dd86ba9f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:26.240676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-582766d6-86fa-4629-9be7-1218dd86ba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:26.339663 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 12/23] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:26.428530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eda54d-a039-444e-a18b-47ec66c3c322 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:26.429130 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eda54d-a039-444e-a18b-47ec66c3c322 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:26.429599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eda54d-a039-444e-a18b-47ec66c3c322 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:26.431474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:26.444703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1ba7b-22e2-425c-a7d1-15c4376ab50c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:26.445025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1ba7b-22e2-425c-a7d1-15c4376ab50c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:26.445283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1ba7b-22e2-425c-a7d1-15c4376ab50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:26.471941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-33f1ba7b-22e2-425c-a7d1-15c4376ab50c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:26.473153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-33f1ba7b-22e2-425c-a7d1-15c4376ab50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:26.565442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 13/25] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:26.572137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061903-0e1f-4e25-92b4-a9a1c209f26c None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:26.572432 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061903-0e1f-4e25-92b4-a9a1c209f26c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:26.572718 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061903-0e1f-4e25-92b4-a9a1c209f26c None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:26.574414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 13/26] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:26.580851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e6ca7-d45c-46e6-bbac-eca9edd278b2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:26.581167 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e6ca7-d45c-46e6-bbac-eca9edd278b2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:26.581430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e6ca7-d45c-46e6-bbac-eca9edd278b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:26.593804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:26.608753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a91e6ca7-d45c-46e6-bbac-eca9edd278b2 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:26.615215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a91e6ca7-d45c-46e6-bbac-eca9edd278b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:26.706689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 14/27] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:26.802575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061903-0e1f-4e25-92b4-a9a1c209f26c None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:26.937289 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061903-0e1f-4e25-92b4-a9a1c209f26c None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:26.959414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:26.996126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7b805-e215-4d42-bd63-945db3af7ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:26.997301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7b805-e215-4d42-bd63-945db3af7ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:26.997806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7b805-e215-4d42-bd63-945db3af7ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:26.998180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7b805-e215-4d42-bd63-945db3af7ac8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:27.014438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7b805-e215-4d42-bd63-945db3af7ac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-b0a7b805-e215-4d42-bd63-945db3af7ac8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:27.021704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:27.023546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:27.025720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:27.025720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:27.025720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:27.025720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:27.025720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:27.025720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:27.025720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:27.025720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:27.025720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:27.025720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:27.025720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:27.025720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:27.025720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 14/28] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:52:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:27.032470 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e6ca7-d45c-46e6-bbac-eca9edd278b2 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:27.156711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e6ca7-d45c-46e6-bbac-eca9edd278b2 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:27.203203 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c18e6-605a-467c-b0e4-4970f5a8b57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:27.204126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c18e6-605a-467c-b0e4-4970f5a8b57b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:27.204579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c18e6-605a-467c-b0e4-4970f5a8b57b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:27.204992 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c18e6-605a-467c-b0e4-4970f5a8b57b None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:27.205829 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c18e6-605a-467c-b0e4-4970f5a8b57b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:27.206281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c18e6-605a-467c-b0e4-4970f5a8b57b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:27.212754 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c18e6-605a-467c-b0e4-4970f5a8b57b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:27.224186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 15/29] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:27.227384 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:27.237260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7b805-e215-4d42-bd63-945db3af7ac8 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:27.329234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c18e6-605a-467c-b0e4-4970f5a8b57b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:27.376281 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7b805-e215-4d42-bd63-945db3af7ac8 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:27.415958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e17f59-f6ae-4f21-af93-67d83d38439d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:27.416933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e17f59-f6ae-4f21-af93-67d83d38439d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:27.417367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e17f59-f6ae-4f21-af93-67d83d38439d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:27.417789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e17f59-f6ae-4f21-af93-67d83d38439d None admin] PATH_INFO: `/v3/users/0e229cb6df1d467b90bf2948d7f02eb9` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:27.420074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e17f59-f6ae-4f21-af93-67d83d38439d None admin] RBAC: Authorizing `identity:get_user(user_id=0e229cb6df1d467b90bf2948d7f02eb9)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:27.421787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e17f59-f6ae-4f21-af93-67d83d38439d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:27.424263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 15/30] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:27 2022] GET /identity/v3/users/0e229cb6df1d467b90bf2948d7f02eb9 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:27.432343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e17f59-f6ae-4f21-af93-67d83d38439d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:27.528671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c18e6-605a-467c-b0e4-4970f5a8b57b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:27.541339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:27.606098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c0b57-d300-4051-812f-ba13775e5fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:27.606666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c0b57-d300-4051-812f-ba13775e5fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:27.606973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c0b57-d300-4051-812f-ba13775e5fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:27.607247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c0b57-d300-4051-812f-ba13775e5fc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:27.628322 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c0b57-d300-4051-812f-ba13775e5fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:27.630074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c0b57-d300-4051-812f-ba13775e5fc0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:27.650297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e17f59-f6ae-4f21-af93-67d83d38439d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-1f9c0b57-d300-4051-812f-ba13775e5fc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:52:27.665985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:27.667071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:52:27.667870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:52:27.667870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:52:27.667870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:52:27.667870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 16/31] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:52:27.670225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c0b57-d300-4051-812f-ba13775e5fc0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:27.738594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:27.764072 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e8bdb-9790-44f6-bf75-20b5bf83c25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:27.765207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e8bdb-9790-44f6-bf75-20b5bf83c25d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:27.765657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e8bdb-9790-44f6-bf75-20b5bf83c25d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:27.766104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e8bdb-9790-44f6-bf75-20b5bf83c25d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:27.771920 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e8bdb-9790-44f6-bf75-20b5bf83c25d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:27.774201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e8bdb-9790-44f6-bf75-20b5bf83c25d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:27.776928 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 16/32] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:52:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:27.784344 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e8bdb-9790-44f6-bf75-20b5bf83c25d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:27.810909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c0b57-d300-4051-812f-ba13775e5fc0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:27.857680 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c0bf6-0745-4f56-8ae6-3ffceaf7df9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:27.859013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c0bf6-0745-4f56-8ae6-3ffceaf7df9b None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:27.859547 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c0bf6-0745-4f56-8ae6-3ffceaf7df9b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:27.860025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c0bf6-0745-4f56-8ae6-3ffceaf7df9b None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:27.860887 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c0bf6-0745-4f56-8ae6-3ffceaf7df9b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:27.862624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c0bf6-0745-4f56-8ae6-3ffceaf7df9b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:27.939678 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e8bdb-9790-44f6-bf75-20b5bf83c25d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:27.954788 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:27.980678 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bef2bc-ca2e-4aec-b9d6-0591f2a121ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:27.981656 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bef2bc-ca2e-4aec-b9d6-0591f2a121ac None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:27.982130 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bef2bc-ca2e-4aec-b9d6-0591f2a121ac None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:27.982593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bef2bc-ca2e-4aec-b9d6-0591f2a121ac None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:27.984089 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bef2bc-ca2e-4aec-b9d6-0591f2a121ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:27.984662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bef2bc-ca2e-4aec-b9d6-0591f2a121ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:27.986275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bef2bc-ca2e-4aec-b9d6-0591f2a121ac None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:27.999363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 17/33] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:28.000502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bef2bc-ca2e-4aec-b9d6-0591f2a121ac None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:28.033685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 17/34] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Aug 19 20:52:27 2022] POST /identity/v3/roles => generated 225 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:52:28.035615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969e00b-5378-48f1-a9ca-da46ada48cc7 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:28.035915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969e00b-5378-48f1-a9ca-da46ada48cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:28.036202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969e00b-5378-48f1-a9ca-da46ada48cc7 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:28.038598 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 18/35] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:28.039273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969e00b-5378-48f1-a9ca-da46ada48cc7 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:28.135938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bef2bc-ca2e-4aec-b9d6-0591f2a121ac None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:28.178938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d96b37-5fa6-4912-b1ff-d6f08a987450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:28.180016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d96b37-5fa6-4912-b1ff-d6f08a987450 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:28.180523 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d96b37-5fa6-4912-b1ff-d6f08a987450 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:28.181021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d96b37-5fa6-4912-b1ff-d6f08a987450 None admin] PATH_INFO: `/v3/domains/default/users/0e229cb6df1d467b90bf2948d7f02eb9/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:28.183520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d96b37-5fa6-4912-b1ff-d6f08a987450 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0e229cb6df1d467b90bf2948d7f02eb9, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:28.185261 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d96b37-5fa6-4912-b1ff-d6f08a987450 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:28.192587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969e00b-5378-48f1-a9ca-da46ada48cc7 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:28.213345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:28.305491 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2dd6f-92cc-4e18-b4ba-9d0472673247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:28.306529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2dd6f-92cc-4e18-b4ba-9d0472673247 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:28.307049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2dd6f-92cc-4e18-b4ba-9d0472673247 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:28.307550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2dd6f-92cc-4e18-b4ba-9d0472673247 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:28.308432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2dd6f-92cc-4e18-b4ba-9d0472673247 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:28.310442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2dd6f-92cc-4e18-b4ba-9d0472673247 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:28.337913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 18/36] 10.222.0.17 () {58 vars in 1361 bytes} [Fri Aug 19 20:52:27 2022] PUT /identity/v3/domains/default/users/0e229cb6df1d467b90bf2948d7f02eb9/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:52:28.340420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077dab-ab91-4bb9-af26-420f1b2a4336 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:28.340420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077dab-ab91-4bb9-af26-420f1b2a4336 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:28.340420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077dab-ab91-4bb9-af26-420f1b2a4336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:28.352661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 19/37] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:52:28 2022] POST /identity/v3/projects => generated 301 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:52:28.363032 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-1f077dab-ab91-4bb9-af26-420f1b2a4336 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:28.364727 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1f077dab-ab91-4bb9-af26-420f1b2a4336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:28.401246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:28.416669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bdea4-08b4-4c77-a2cb-e0e41d5427e3 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:28.417324 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bdea4-08b4-4c77-a2cb-e0e41d5427e3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:28.417836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bdea4-08b4-4c77-a2cb-e0e41d5427e3 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:28.419546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 20/38] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:52:28.426235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243bdd1-8e8a-44b9-bc03-b4ef8ce1170f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:28.426907 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243bdd1-8e8a-44b9-bc03-b4ef8ce1170f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:28.427457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243bdd1-8e8a-44b9-bc03-b4ef8ce1170f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:28.452456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e243bdd1-8e8a-44b9-bc03-b4ef8ce1170f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:28.454754 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e243bdd1-8e8a-44b9-bc03-b4ef8ce1170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:28.457121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 19/39] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:28.541791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 21/40] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:52:28.689333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab024-e82e-4efa-89c2-56704d853c04 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:28.689760 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab024-e82e-4efa-89c2-56704d853c04 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:28.690250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab024-e82e-4efa-89c2-56704d853c04 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:28.699286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 20/41] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:28 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:28.707159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ab5c-15f1-4fc3-a5fb-b8fb8ed07690 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:28.707771 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ab5c-15f1-4fc3-a5fb-b8fb8ed07690 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:28.708252 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ab5c-15f1-4fc3-a5fb-b8fb8ed07690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:28.743449 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1241ab5c-15f1-4fc3-a5fb-b8fb8ed07690 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:28.745389 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1241ab5c-15f1-4fc3-a5fb-b8fb8ed07690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:28.854148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 22/42] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:28.877777 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ab024-e82e-4efa-89c2-56704d853c04 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:28.911633 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241ab5c-15f1-4fc3-a5fb-b8fb8ed07690 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:28.936369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:29.024781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ab024-e82e-4efa-89c2-56704d853c04 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:29.039951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241ab5c-15f1-4fc3-a5fb-b8fb8ed07690 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:29.066786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddedc03-c68f-453f-85ea-cf66d80160e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:29.067788 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddedc03-c68f-453f-85ea-cf66d80160e7 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:29.068292 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddedc03-c68f-453f-85ea-cf66d80160e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:29.068757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddedc03-c68f-453f-85ea-cf66d80160e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:29.070423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddedc03-c68f-453f-85ea-cf66d80160e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:29.072383 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddedc03-c68f-453f-85ea-cf66d80160e7 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:29.075126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:52:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:29.082053 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddedc03-c68f-453f-85ea-cf66d80160e7 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:29.122108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:29.209267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ce831-3eae-4270-96d2-20d756cd067e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:29.210592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ce831-3eae-4270-96d2-20d756cd067e None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:29.211133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ce831-3eae-4270-96d2-20d756cd067e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:29.211643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ce831-3eae-4270-96d2-20d756cd067e None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:29.212568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ce831-3eae-4270-96d2-20d756cd067e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:29.214432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ce831-3eae-4270-96d2-20d756cd067e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:29.221991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddedc03-c68f-453f-85ea-cf66d80160e7 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:29.236973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Aug 19 20:52:28 2022] POST /identity/v3/roles => generated 219 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:52:29.273734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca245a6-0ce9-422c-97cc-6dc82276295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:29.274925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca245a6-0ce9-422c-97cc-6dc82276295e None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:29.275495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca245a6-0ce9-422c-97cc-6dc82276295e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:29.276031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca245a6-0ce9-422c-97cc-6dc82276295e None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:29.276967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca245a6-0ce9-422c-97cc-6dc82276295e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:29.278899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca245a6-0ce9-422c-97cc-6dc82276295e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:29.326909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:52:29 2022] POST /identity/v3/projects => generated 312 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 20:52:29.342140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ce831-3eae-4270-96d2-20d756cd067e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:29.446661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:29.472477 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ce831-3eae-4270-96d2-20d756cd067e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:29.520280 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84f419-5c80-488b-b15e-0db5609dffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:29.520920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84f419-5c80-488b-b15e-0db5609dffc2 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:29.521210 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84f419-5c80-488b-b15e-0db5609dffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:29.521494 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84f419-5c80-488b-b15e-0db5609dffc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:29.522225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84f419-5c80-488b-b15e-0db5609dffc2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:29.523695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84f419-5c80-488b-b15e-0db5609dffc2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:29.542082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Aug 19 20:52:29 2022] POST /identity/v3/roles => generated 223 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:52:30.544905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf112e-dd62-404f-b89c-cf48af2118ea None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:30.546076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf112e-dd62-404f-b89c-cf48af2118ea None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:30.546076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf112e-dd62-404f-b89c-cf48af2118ea None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:30.547593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 23/47] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:30.553042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371c163-3ca3-496d-b5dd-6533dc90a441 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:30.553751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371c163-3ca3-496d-b5dd-6533dc90a441 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:30.553984 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371c163-3ca3-496d-b5dd-6533dc90a441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:30.573165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a371c163-3ca3-496d-b5dd-6533dc90a441 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:30.574354 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a371c163-3ca3-496d-b5dd-6533dc90a441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:30.647104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 25/48] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:30.937603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf112e-dd62-404f-b89c-cf48af2118ea None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:31.041516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:31.065532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf112e-dd62-404f-b89c-cf48af2118ea None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:31.102774 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b6d1-8520-4875-bdd5-ddeacb319b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:31.103417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b6d1-8520-4875-bdd5-ddeacb319b37 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:31.103700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b6d1-8520-4875-bdd5-ddeacb319b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:31.103978 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b6d1-8520-4875-bdd5-ddeacb319b37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:31.116261 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9b6d1-8520-4875-bdd5-ddeacb319b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-c5c9b6d1-8520-4875-bdd5-ddeacb319b37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:31.121143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:31.122862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:31.124681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:31.124681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:31.124681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:31.124681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:31.124681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:31.124681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:31.124681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:31.124681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:31.124681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:31.124681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:31.124681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:31.124681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:31.124681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 24/49] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:52:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:31.131816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371c163-3ca3-496d-b5dd-6533dc90a441 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:31.205143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:31.239804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371c163-3ca3-496d-b5dd-6533dc90a441 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:31.276649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1e0e5-a543-4bd5-8f7c-3fdd9cb3f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:31.277278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1e0e5-a543-4bd5-8f7c-3fdd9cb3f295 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:31.277568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1e0e5-a543-4bd5-8f7c-3fdd9cb3f295 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:31.277851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1e0e5-a543-4bd5-8f7c-3fdd9cb3f295 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:31.278537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1e0e5-a543-4bd5-8f7c-3fdd9cb3f295 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:31.278884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1e0e5-a543-4bd5-8f7c-3fdd9cb3f295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:31.280878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1e0e5-a543-4bd5-8f7c-3fdd9cb3f295 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:31.290197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 26/50] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:31.296622 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b6d1-8520-4875-bdd5-ddeacb319b37 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:31.345845 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9b9fc-e85d-48e8-a666-7e331b5b8f15 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:31.346124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9b9fc-e85d-48e8-a666-7e331b5b8f15 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:31.346440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9b9fc-e85d-48e8-a666-7e331b5b8f15 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:31.347855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 27/51] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:52:31.355657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58dcc0-dc45-48c5-aef1-69c80121408a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:31.356117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58dcc0-dc45-48c5-aef1-69c80121408a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:31.356583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58dcc0-dc45-48c5-aef1-69c80121408a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:31.376009 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-be58dcc0-dc45-48c5-aef1-69c80121408a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:31.377235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-be58dcc0-dc45-48c5-aef1-69c80121408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:31.413939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b6d1-8520-4875-bdd5-ddeacb319b37 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:31.461369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 28/52] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:52:31.563235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81433633-f8f5-46b6-8c79-2cb629aadaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:31.563885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81433633-f8f5-46b6-8c79-2cb629aadaff None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:31.564171 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81433633-f8f5-46b6-8c79-2cb629aadaff None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:31.564459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81433633-f8f5-46b6-8c79-2cb629aadaff None admin] PATH_INFO: `/v3/users/0e229cb6df1d467b90bf2948d7f02eb9` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:31.565634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81433633-f8f5-46b6-8c79-2cb629aadaff None admin] RBAC: Authorizing `identity:get_user(user_id=0e229cb6df1d467b90bf2948d7f02eb9)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:31.567154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81433633-f8f5-46b6-8c79-2cb629aadaff None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:31.568768 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 25/53] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:31 2022] GET /identity/v3/users/0e229cb6df1d467b90bf2948d7f02eb9 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:31.574561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58dcc0-dc45-48c5-aef1-69c80121408a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:31.640042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:31.684058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58dcc0-dc45-48c5-aef1-69c80121408a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:31.723433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79e8c4-ecb0-408d-b363-3a698e34cff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:31.724012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79e8c4-ecb0-408d-b363-3a698e34cff2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:31.724396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79e8c4-ecb0-408d-b363-3a698e34cff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:31.724682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79e8c4-ecb0-408d-b363-3a698e34cff2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:31.725859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79e8c4-ecb0-408d-b363-3a698e34cff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:31.727393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79e8c4-ecb0-408d-b363-3a698e34cff2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:31.729039 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 29/54] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:52:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:31.735507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81433633-f8f5-46b6-8c79-2cb629aadaff None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:31.738632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79e8c4-ecb0-408d-b363-3a698e34cff2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:31.751877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:31.854598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81433633-f8f5-46b6-8c79-2cb629aadaff None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:31.857004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79e8c4-ecb0-408d-b363-3a698e34cff2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:31.888297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:31.893711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3b46c-f3d9-42ae-a2fb-f561102556a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:31.894361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3b46c-f3d9-42ae-a2fb-f561102556a8 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:31.894675 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3b46c-f3d9-42ae-a2fb-f561102556a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:31.895044 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3b46c-f3d9-42ae-a2fb-f561102556a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:31.895751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3b46c-f3d9-42ae-a2fb-f561102556a8 None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.domain.id=default, user.id=0e229cb6df1d467b90bf2948d7f02eb9) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:31.895846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495417fc-a670-46a4-9ea4-3f922176e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:31.896066 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3b46c-f3d9-42ae-a2fb-f561102556a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:31.896570 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495417fc-a670-46a4-9ea4-3f922176e78c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:31.896918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495417fc-a670-46a4-9ea4-3f922176e78c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:31.897268 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495417fc-a670-46a4-9ea4-3f922176e78c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:31.897530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3b46c-f3d9-42ae-a2fb-f561102556a8 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:31.898568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495417fc-a670-46a4-9ea4-3f922176e78c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:31.900292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495417fc-a670-46a4-9ea4-3f922176e78c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:31.901974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 30/55] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:52:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:31.906808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 26/56] 10.222.0.17 () {56 vars in 1322 bytes} [Fri Aug 19 20:52:31 2022] GET /identity/v3/role_assignments?user.id=0e229cb6df1d467b90bf2948d7f02eb9&scope.domain.id=default&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 530 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:31.907944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495417fc-a670-46a4-9ea4-3f922176e78c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:32.025332 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495417fc-a670-46a4-9ea4-3f922176e78c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:32.065617 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879836b-ec84-4e78-a083-28bc48698eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:32.066237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879836b-ec84-4e78-a083-28bc48698eb5 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:32.066511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879836b-ec84-4e78-a083-28bc48698eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:32.067504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879836b-ec84-4e78-a083-28bc48698eb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:32.067504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879836b-ec84-4e78-a083-28bc48698eb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:32.068978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879836b-ec84-4e78-a083-28bc48698eb5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:32.099725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 31/57] 10.222.0.17 () {60 vars in 1140 bytes} [Fri Aug 19 20:52:31 2022] POST /identity/v3/projects => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:52:34.079479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97513f1b-3de5-42af-a3ab-5181b3505a9f None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:34.080068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97513f1b-3de5-42af-a3ab-5181b3505a9f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:34.080068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97513f1b-3de5-42af-a3ab-5181b3505a9f None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:34.081297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 27/58] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:34.086726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668698d-aca7-42a7-9643-dec9e872e85f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:34.087222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668698d-aca7-42a7-9643-dec9e872e85f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:34.087355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668698d-aca7-42a7-9643-dec9e872e85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:34.105732 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2668698d-aca7-42a7-9643-dec9e872e85f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:34.106991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2668698d-aca7-42a7-9643-dec9e872e85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:34.153975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:34.177617 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 32/59] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:34.446819 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97513f1b-3de5-42af-a3ab-5181b3505a9f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:34.526757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:34.553312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97513f1b-3de5-42af-a3ab-5181b3505a9f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:34.588516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be0efc-5335-4d05-a1e5-439697a8e52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:34.589171 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be0efc-5335-4d05-a1e5-439697a8e52b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:34.589462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be0efc-5335-4d05-a1e5-439697a8e52b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:34.589749 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be0efc-5335-4d05-a1e5-439697a8e52b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:34.590982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be0efc-5335-4d05-a1e5-439697a8e52b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:34.593062 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be0efc-5335-4d05-a1e5-439697a8e52b None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:34.594821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 28/60] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:52:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:34.600843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668698d-aca7-42a7-9643-dec9e872e85f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:34.710773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668698d-aca7-42a7-9643-dec9e872e85f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:34.746985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1adcd-6658-48df-8e2b-fe8369352504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:34.747626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1adcd-6658-48df-8e2b-fe8369352504 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:34.747941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1adcd-6658-48df-8e2b-fe8369352504 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:34.748224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1adcd-6658-48df-8e2b-fe8369352504 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:34.749442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1adcd-6658-48df-8e2b-fe8369352504 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:34.751045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1adcd-6658-48df-8e2b-fe8369352504 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:34.780140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 33/61] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:52:34 2022] POST /identity/v3/users => generated 275 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:52:38.434907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447eae4-b288-4a9e-8078-6df506be9e75 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:38.437006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447eae4-b288-4a9e-8078-6df506be9e75 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:38.437782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447eae4-b288-4a9e-8078-6df506be9e75 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:38.440694 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 29/62] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:38.446631 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f9cbd-ab78-453f-b32e-de47ab382ade None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:38.447408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f9cbd-ab78-453f-b32e-de47ab382ade None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:38.447408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f9cbd-ab78-453f-b32e-de47ab382ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:38.476939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-fe2f9cbd-ab78-453f-b32e-de47ab382ade None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:38.478176 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fe2f9cbd-ab78-453f-b32e-de47ab382ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:38.534980 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:38.538602 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1270671-6264-4af4-bede-06252feaf654 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:38.539472 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1270671-6264-4af4-bede-06252feaf654 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:38.540505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1270671-6264-4af4-bede-06252feaf654 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:38.543471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 30/63] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:38.552666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d932a5-98af-4181-b610-4944e198495d None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:38.553397 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d932a5-98af-4181-b610-4944e198495d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:38.553641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d932a5-98af-4181-b610-4944e198495d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:38.589463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-d5d932a5-98af-4181-b610-4944e198495d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:38.590713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d5d932a5-98af-4181-b610-4944e198495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:38.611923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 34/64] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:52:38.678865 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 31/65] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:52:38.764345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888db129-4b9b-47b5-9c86-45a62ffa8ba1 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:38.764987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888db129-4b9b-47b5-9c86-45a62ffa8ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:38.765449 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888db129-4b9b-47b5-9c86-45a62ffa8ba1 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:38.767044 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 35/66] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:38.772912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a77af1-e2c7-47e1-861d-d6a0644745c5 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:38.773480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a77af1-e2c7-47e1-861d-d6a0644745c5 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:38.773960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a77af1-e2c7-47e1-861d-d6a0644745c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:38.798157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-c1a77af1-e2c7-47e1-861d-d6a0644745c5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:38.799797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c1a77af1-e2c7-47e1-861d-d6a0644745c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:38.825749 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4386f-b480-428a-899b-6dd182b25bd0 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:38.826932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4386f-b480-428a-899b-6dd182b25bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:38.827423 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4386f-b480-428a-899b-6dd182b25bd0 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:38.829538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 36/67] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:52:38.837715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a89062-200a-4aad-aea7-80299e3e7b73 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:38.838349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a89062-200a-4aad-aea7-80299e3e7b73 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:38.839024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a89062-200a-4aad-aea7-80299e3e7b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:38.861853 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d3a89062-200a-4aad-aea7-80299e3e7b73 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:38.863820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d3a89062-200a-4aad-aea7-80299e3e7b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:38.936234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 32/68] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:38.937730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a77af1-e2c7-47e1-861d-d6a0644745c5 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:38.940818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:38.956517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 37/69] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:52:39.056251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a77af1-e2c7-47e1-861d-d6a0644745c5 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:39.096473 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732973f0-16f1-49ec-928a-19f29d64d949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:39.097595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732973f0-16f1-49ec-928a-19f29d64d949 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:39.098084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732973f0-16f1-49ec-928a-19f29d64d949 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:39.098562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732973f0-16f1-49ec-928a-19f29d64d949 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:39.111042 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732973f0-16f1-49ec-928a-19f29d64d949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-732973f0-16f1-49ec-928a-19f29d64d949 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:39.116454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:39.117375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:39.118157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:39.118157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:39.118157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:39.118157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:39.118157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:39.118157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:39.118157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:39.118157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:39.118157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:39.118157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:39.118157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:52:39.118157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:39.119776 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a89062-200a-4aad-aea7-80299e3e7b73 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:39.119967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 33/70] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:52:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:39.126761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732973f0-16f1-49ec-928a-19f29d64d949 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:39.211998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:39.263268 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732973f0-16f1-49ec-928a-19f29d64d949 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:39.319646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5b0c3-224a-477d-8b79-d1a94810f993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:39.320199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5b0c3-224a-477d-8b79-d1a94810f993 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:39.320491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5b0c3-224a-477d-8b79-d1a94810f993 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:39.320775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5b0c3-224a-477d-8b79-d1a94810f993 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:39.321486 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5b0c3-224a-477d-8b79-d1a94810f993 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:39.321802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5b0c3-224a-477d-8b79-d1a94810f993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:39.323297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5b0c3-224a-477d-8b79-d1a94810f993 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:39.342288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 34/71] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:52:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:39.343589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5b0c3-224a-477d-8b79-d1a94810f993 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:39.347172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:39.351646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a89062-200a-4aad-aea7-80299e3e7b73 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:39.396209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fd818-5de3-4f6b-9e96-536d552904f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:39.396869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fd818-5de3-4f6b-9e96-536d552904f8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:39.397152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fd818-5de3-4f6b-9e96-536d552904f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:39.397429 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fd818-5de3-4f6b-9e96-536d552904f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:39.411039 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fd818-5de3-4f6b-9e96-536d552904f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-0d0fd818-5de3-4f6b-9e96-536d552904f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:39.415599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:39.416519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:39.417293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:39.417293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:39.417293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:39.417293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:39.417293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:39.417293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:39.417293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:39.417293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:39.417293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:39.417293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:39.417293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:52:39.417293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:52:39.417293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 38/72] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:52:39.417973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fd818-5de3-4f6b-9e96-536d552904f8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:39.464401 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5b0c3-224a-477d-8b79-d1a94810f993 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:39.491595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:39.505241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744ac78-394d-4de1-adbb-9b77fcbef9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:39.505998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744ac78-394d-4de1-adbb-9b77fcbef9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:39.506509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744ac78-394d-4de1-adbb-9b77fcbef9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:39.507056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744ac78-394d-4de1-adbb-9b77fcbef9b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:39.508546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744ac78-394d-4de1-adbb-9b77fcbef9b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:39.510265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744ac78-394d-4de1-adbb-9b77fcbef9b3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:39.512142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 35/73] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:52:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:39.512945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744ac78-394d-4de1-adbb-9b77fcbef9b3 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:39.542996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fd818-5de3-4f6b-9e96-536d552904f8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:39.591489 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5ed85-eca0-4d0a-b024-d4babe3ea744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:39.592738 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5ed85-eca0-4d0a-b024-d4babe3ea744 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:39.593117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5ed85-eca0-4d0a-b024-d4babe3ea744 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:39.593608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5ed85-eca0-4d0a-b024-d4babe3ea744 None admin] PATH_INFO: `/v3/users/15313602248c4227a5b0b9e1c4fdfeed` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:39.614822 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5ed85-eca0-4d0a-b024-d4babe3ea744 None admin] RBAC: Authorizing `identity:get_user(user_id=15313602248c4227a5b0b9e1c4fdfeed)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:39.616698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5ed85-eca0-4d0a-b024-d4babe3ea744 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:39.618813 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 39/74] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:39 2022] GET /identity/v3/users/15313602248c4227a5b0b9e1c4fdfeed => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:39.619622 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5ed85-eca0-4d0a-b024-d4babe3ea744 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:39.637348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:39.641156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744ac78-394d-4de1-adbb-9b77fcbef9b3 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:39.682595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298da0b-7c7c-40f0-9558-6967e397890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:39.683358 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298da0b-7c7c-40f0-9558-6967e397890c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:39.683792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298da0b-7c7c-40f0-9558-6967e397890c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:39.684190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298da0b-7c7c-40f0-9558-6967e397890c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:39.696420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298da0b-7c7c-40f0-9558-6967e397890c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-d298da0b-7c7c-40f0-9558-6967e397890c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:39.701654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:39.702725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:39.703525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:39.703525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:39.703525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:39.703525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:39.703525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:39.703525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:39.703525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:39.703525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:39.703525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:39.703525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:39.703525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:39.703525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:39.703525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 36/75] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:52:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:39.704151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa4561-cb68-406c-9d6a-a0af91874bde None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:39.704239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa4561-cb68-406c-9d6a-a0af91874bde None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:39.704478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa4561-cb68-406c-9d6a-a0af91874bde None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:39.705778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 37/76] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:39.706478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa4561-cb68-406c-9d6a-a0af91874bde None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:39.742138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5ed85-eca0-4d0a-b024-d4babe3ea744 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:39.766545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:39.783252 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72ceb6-9146-490f-8688-ef80ee6195cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:39.783882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72ceb6-9146-490f-8688-ef80ee6195cc None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:39.784166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72ceb6-9146-490f-8688-ef80ee6195cc None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:39.784486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72ceb6-9146-490f-8688-ef80ee6195cc None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:39.785166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72ceb6-9146-490f-8688-ef80ee6195cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:39.785481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72ceb6-9146-490f-8688-ef80ee6195cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:39.786924 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72ceb6-9146-490f-8688-ef80ee6195cc None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:39.796127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 40/77] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:52:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:39.797246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72ceb6-9146-490f-8688-ef80ee6195cc None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:39.835037 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa4561-cb68-406c-9d6a-a0af91874bde None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:39.874871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc061d-9afe-4c2c-b622-f7c8d001f982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:39.875570 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc061d-9afe-4c2c-b622-f7c8d001f982 None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:39.875773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc061d-9afe-4c2c-b622-f7c8d001f982 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:39.876049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc061d-9afe-4c2c-b622-f7c8d001f982 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:39.876758 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc061d-9afe-4c2c-b622-f7c8d001f982 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:39.878239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc061d-9afe-4c2c-b622-f7c8d001f982 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:39.892877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:39.908902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 38/78] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:52:39 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:52:39.911840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc061d-9afe-4c2c-b622-f7c8d001f982 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:39.925567 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72ceb6-9146-490f-8688-ef80ee6195cc None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:39.976906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d7c4b-e49c-43c2-bdff-abb5270bdf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:39.978286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d7c4b-e49c-43c2-bdff-abb5270bdf45 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:39.978729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d7c4b-e49c-43c2-bdff-abb5270bdf45 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:39.979347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d7c4b-e49c-43c2-bdff-abb5270bdf45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:40.060354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc061d-9afe-4c2c-b622-f7c8d001f982 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:40.078493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:40.080559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d7c4b-e49c-43c2-bdff-abb5270bdf45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:40.082178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d7c4b-e49c-43c2-bdff-abb5270bdf45 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:40.125963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece094a3-42f7-4eee-a57c-b7420beb8567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:40.126513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece094a3-42f7-4eee-a57c-b7420beb8567 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:40.126858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece094a3-42f7-4eee-a57c-b7420beb8567 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:40.127136 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece094a3-42f7-4eee-a57c-b7420beb8567 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:40.127821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece094a3-42f7-4eee-a57c-b7420beb8567 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:40.128137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece094a3-42f7-4eee-a57c-b7420beb8567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:40.129824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece094a3-42f7-4eee-a57c-b7420beb8567 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:40.142598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 39/79] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:40.144789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cf9a0-afca-457a-a9d9-ade20ea22e09 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:40.145258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cf9a0-afca-457a-a9d9-ade20ea22e09 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:40.145719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cf9a0-afca-457a-a9d9-ade20ea22e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:40.175151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-a19cf9a0-afca-457a-a9d9-ade20ea22e09 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:40.177549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a19cf9a0-afca-457a-a9d9-ade20ea22e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:40.189792 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:40.233779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 41/80] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:52:40.236376 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d7c4b-e49c-43c2-bdff-abb5270bdf45 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:40.292897 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 40/81] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:40.293773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cf9a0-afca-457a-a9d9-ade20ea22e09 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:40.371929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d7c4b-e49c-43c2-bdff-abb5270bdf45 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:40.416983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1dbce-d7cc-40e2-96b1-eefd2fd1b7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:40.418100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1dbce-d7cc-40e2-96b1-eefd2fd1b7ee None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:40.418614 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1dbce-d7cc-40e2-96b1-eefd2fd1b7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:40.419262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1dbce-d7cc-40e2-96b1-eefd2fd1b7ee None admin] PATH_INFO: `/v3/users/15313602248c4227a5b0b9e1c4fdfeed` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:40.421502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1dbce-d7cc-40e2-96b1-eefd2fd1b7ee None admin] RBAC: Authorizing `identity:get_user(user_id=15313602248c4227a5b0b9e1c4fdfeed)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:40.423322 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1dbce-d7cc-40e2-96b1-eefd2fd1b7ee None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:40.425450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 42/82] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:40 2022] GET /identity/v3/users/15313602248c4227a5b0b9e1c4fdfeed => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:40.426658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1dbce-d7cc-40e2-96b1-eefd2fd1b7ee None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:40.435192 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:40.438877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cf9a0-afca-457a-a9d9-ade20ea22e09 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:40.477904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cddf3-93f3-4703-8797-37d124602065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:40.478536 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cddf3-93f3-4703-8797-37d124602065 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:40.478872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cddf3-93f3-4703-8797-37d124602065 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:40.479155 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cddf3-93f3-4703-8797-37d124602065 None admin] PATH_INFO: `/v3/users/0e229cb6df1d467b90bf2948d7f02eb9` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:40.480372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cddf3-93f3-4703-8797-37d124602065 None admin] RBAC: Authorizing `identity:get_user(user_id=0e229cb6df1d467b90bf2948d7f02eb9)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:40.481916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cddf3-93f3-4703-8797-37d124602065 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:40.484589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 41/83] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:40 2022] GET /identity/v3/users/0e229cb6df1d467b90bf2948d7f02eb9 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:40.485447 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cddf3-93f3-4703-8797-37d124602065 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:40.487833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:40.565102 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1dbce-d7cc-40e2-96b1-eefd2fd1b7ee None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:40.630680 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cddf3-93f3-4703-8797-37d124602065 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:40.647417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaeebe-4299-4688-a264-d73bcebfaf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:40.648149 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaeebe-4299-4688-a264-d73bcebfaf96 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:40.648440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaeebe-4299-4688-a264-d73bcebfaf96 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:40.648719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaeebe-4299-4688-a264-d73bcebfaf96 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:40.649933 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaeebe-4299-4688-a264-d73bcebfaf96 None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:40.651433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaeebe-4299-4688-a264-d73bcebfaf96 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:40.653103 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 43/84] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:40 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:40.653890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaeebe-4299-4688-a264-d73bcebfaf96 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:40.718975 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd60028-6dec-4a9b-a149-1410c9cfcf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:40.719526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd60028-6dec-4a9b-a149-1410c9cfcf0a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:40.719809 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd60028-6dec-4a9b-a149-1410c9cfcf0a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:40.720084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd60028-6dec-4a9b-a149-1410c9cfcf0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:40.804563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:40.834213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaeebe-4299-4688-a264-d73bcebfaf96 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:40.851349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:40.877589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98333dc-6096-4691-b2cf-a4f10558bca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:40.878596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98333dc-6096-4691-b2cf-a4f10558bca5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:40.879255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98333dc-6096-4691-b2cf-a4f10558bca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:40.879996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98333dc-6096-4691-b2cf-a4f10558bca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:40.936184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd60028-6dec-4a9b-a149-1410c9cfcf0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:40.938314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd60028-6dec-4a9b-a149-1410c9cfcf0a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:40.983467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98333dc-6096-4691-b2cf-a4f10558bca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:40.987284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98333dc-6096-4691-b2cf-a4f10558bca5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:41.154003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 42/85] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:52:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:52:41.156254 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd60028-6dec-4a9b-a149-1410c9cfcf0a None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:41.156403 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 44/86] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:52:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:52:41.157283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98333dc-6096-4691-b2cf-a4f10558bca5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:41.182964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:41.241414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:41.293057 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd60028-6dec-4a9b-a149-1410c9cfcf0a None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:41.309425 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98333dc-6096-4691-b2cf-a4f10558bca5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:41.342782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cd7b5-65a1-4162-9cc3-4edd91b9f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:41.343418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cd7b5-65a1-4162-9cc3-4edd91b9f3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:41.343740 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cd7b5-65a1-4162-9cc3-4edd91b9f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:41.344454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cd7b5-65a1-4162-9cc3-4edd91b9f3c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:41.345478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cd7b5-65a1-4162-9cc3-4edd91b9f3c9 None admin] RBAC: Adding query filter params (role.id=0fdbf18b17e545d9929e22ebddc1d5b7, scope.project.id=90fb40089787468fac42f2a8bafe87dc, user.id=15313602248c4227a5b0b9e1c4fdfeed) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:41.345858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cd7b5-65a1-4162-9cc3-4edd91b9f3c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:41.347364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cd7b5-65a1-4162-9cc3-4edd91b9f3c9 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:41.350077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473395c-7ed2-4b13-97dc-9b2d23829efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:41.350995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473395c-7ed2-4b13-97dc-9b2d23829efe None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:41.351499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473395c-7ed2-4b13-97dc-9b2d23829efe None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:41.351974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473395c-7ed2-4b13-97dc-9b2d23829efe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:41.353495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 43/87] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:52:41 2022] GET /identity/v3/role_assignments?user.id=15313602248c4227a5b0b9e1c4fdfeed&scope.project.id=90fb40089787468fac42f2a8bafe87dc&role.id=0fdbf18b17e545d9929e22ebddc1d5b7 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:41.354700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cd7b5-65a1-4162-9cc3-4edd91b9f3c9 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:41.367634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473395c-7ed2-4b13-97dc-9b2d23829efe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-a473395c-7ed2-4b13-97dc-9b2d23829efe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:41.375816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:41.376729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:41.377486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:41.377486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:41.377486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:41.377486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:41.377486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:41.377486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:41.377486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:41.377486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:41.377486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:41.377486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:41.377486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:52:41.377486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:52:41.377486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 45/88] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:41.378177 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473395c-7ed2-4b13-97dc-9b2d23829efe None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:41.502028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cd7b5-65a1-4162-9cc3-4edd91b9f3c9 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:41.546935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:41.557077 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ea5b0-586a-46bc-bed1-b4399e475ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:41.557778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ea5b0-586a-46bc-bed1-b4399e475ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:41.558083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ea5b0-586a-46bc-bed1-b4399e475ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:41.558375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ea5b0-586a-46bc-bed1-b4399e475ba2 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:41.562677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ea5b0-586a-46bc-bed1-b4399e475ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:41.564259 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ea5b0-586a-46bc-bed1-b4399e475ba2 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:41.566158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 44/89] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:41 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:41.571336 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ea5b0-586a-46bc-bed1-b4399e475ba2 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:41.591326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:41.637476 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473395c-7ed2-4b13-97dc-9b2d23829efe None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:41.689434 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037844c9-abb5-4c14-8e41-bccf4aebe7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:41.690705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037844c9-abb5-4c14-8e41-bccf4aebe7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:41.691879 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037844c9-abb5-4c14-8e41-bccf4aebe7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:41.692493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037844c9-abb5-4c14-8e41-bccf4aebe7c9 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:41.695292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037844c9-abb5-4c14-8e41-bccf4aebe7c9 None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:41.697102 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037844c9-abb5-4c14-8e41-bccf4aebe7c9 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:41.702715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 46/90] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:41 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:41.706512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037844c9-abb5-4c14-8e41-bccf4aebe7c9 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:41.738933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ea5b0-586a-46bc-bed1-b4399e475ba2 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:41.818483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2671c61-7632-4315-bc24-6d07e084d109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:41.819865 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2671c61-7632-4315-bc24-6d07e084d109 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:41.820158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2671c61-7632-4315-bc24-6d07e084d109 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:41.820443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2671c61-7632-4315-bc24-6d07e084d109 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:41.821300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2671c61-7632-4315-bc24-6d07e084d109 None admin] RBAC: Adding query filter params (name=member) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:41.821612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2671c61-7632-4315-bc24-6d07e084d109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:41.823244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2671c61-7632-4315-bc24-6d07e084d109 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:41.836413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 45/91] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:52:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:41.837209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2671c61-7632-4315-bc24-6d07e084d109 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:41.919181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:41.972511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2671c61-7632-4315-bc24-6d07e084d109 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:42.001440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037844c9-abb5-4c14-8e41-bccf4aebe7c9 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:42.022846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1802f7-20be-4d5e-aa66-55d1ac4fee73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:42.022846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1802f7-20be-4d5e-aa66-55d1ac4fee73 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:42.023086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1802f7-20be-4d5e-aa66-55d1ac4fee73 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:42.023345 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1802f7-20be-4d5e-aa66-55d1ac4fee73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:42.030757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1802f7-20be-4d5e-aa66-55d1ac4fee73 None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=90fb40089787468fac42f2a8bafe87dc, user.id=0e229cb6df1d467b90bf2948d7f02eb9) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:42.030757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1802f7-20be-4d5e-aa66-55d1ac4fee73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:42.030757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1802f7-20be-4d5e-aa66-55d1ac4fee73 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:42.041258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 46/92] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:52:41 2022] GET /identity/v3/role_assignments?user.id=0e229cb6df1d467b90bf2948d7f02eb9&scope.project.id=90fb40089787468fac42f2a8bafe87dc&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:42.043134 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1802f7-20be-4d5e-aa66-55d1ac4fee73 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:42.100462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32476b5-c925-43b9-a3c1-2b773bfb6f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:42.101484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32476b5-c925-43b9-a3c1-2b773bfb6f93 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:42.101971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32476b5-c925-43b9-a3c1-2b773bfb6f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:42.102459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32476b5-c925-43b9-a3c1-2b773bfb6f93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:42.103461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32476b5-c925-43b9-a3c1-2b773bfb6f93 None admin] RBAC: Adding query filter params (role.id=40d451ce7e0143e682ac5d43622c57d2, scope.project.id=90fb40089787468fac42f2a8bafe87dc, user.id=15313602248c4227a5b0b9e1c4fdfeed) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:42.104015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32476b5-c925-43b9-a3c1-2b773bfb6f93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:42.105690 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32476b5-c925-43b9-a3c1-2b773bfb6f93 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:42.128510 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 47/93] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:52:41 2022] GET /identity/v3/role_assignments?user.id=15313602248c4227a5b0b9e1c4fdfeed&scope.project.id=90fb40089787468fac42f2a8bafe87dc&role.id=40d451ce7e0143e682ac5d43622c57d2 => generated 259 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:42.249420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1802f7-20be-4d5e-aa66-55d1ac4fee73 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:42.301243 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:42.320482 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475e142-6206-42fb-a7c9-899236cd513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:42.321533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475e142-6206-42fb-a7c9-899236cd513d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:42.322018 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475e142-6206-42fb-a7c9-899236cd513d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:42.322498 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475e142-6206-42fb-a7c9-899236cd513d None admin] PATH_INFO: `/v3/users/15313602248c4227a5b0b9e1c4fdfeed` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:42.324769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475e142-6206-42fb-a7c9-899236cd513d None admin] RBAC: Authorizing `identity:get_user(user_id=15313602248c4227a5b0b9e1c4fdfeed)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:42.328265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475e142-6206-42fb-a7c9-899236cd513d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:42.331718 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 47/94] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:42 2022] GET /identity/v3/users/15313602248c4227a5b0b9e1c4fdfeed => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:42.341201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32476b5-c925-43b9-a3c1-2b773bfb6f93 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:42.348444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:42.529382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b79ae-8893-4bee-a263-5fb91a234fcc None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:42.530852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b79ae-8893-4bee-a263-5fb91a234fcc None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:42.531315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b79ae-8893-4bee-a263-5fb91a234fcc None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:42.534152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 48/95] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:42.545425 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2632f-34d0-451d-968c-6b97e224a36c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:42.545940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2632f-34d0-451d-968c-6b97e224a36c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:42.546401 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2632f-34d0-451d-968c-6b97e224a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:42.580380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32476b5-c925-43b9-a3c1-2b773bfb6f93 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:42.603923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-bcd2632f-34d0-451d-968c-6b97e224a36c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:42.605163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-bcd2632f-34d0-451d-968c-6b97e224a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:42.653398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b982-ed2f-4d0a-a148-592645917fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:42.654528 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b982-ed2f-4d0a-a148-592645917fbc None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:42.655061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b982-ed2f-4d0a-a148-592645917fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:42.655501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b982-ed2f-4d0a-a148-592645917fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:42.807582 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1b982-ed2f-4d0a-a148-592645917fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:42.810057 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1b982-ed2f-4d0a-a148-592645917fbc None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:42.815895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:42.817335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 49/96] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:43.009136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 48/97] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:52:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:52:43.019931 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2632f-34d0-451d-968c-6b97e224a36c None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:43.178665 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2632f-34d0-451d-968c-6b97e224a36c None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:43.213411 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:43.228973 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6719b-f254-45c5-b9db-69ddd7a0164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:43.229702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6719b-f254-45c5-b9db-69ddd7a0164d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:43.229989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6719b-f254-45c5-b9db-69ddd7a0164d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:43.230267 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6719b-f254-45c5-b9db-69ddd7a0164d None admin] PATH_INFO: `/v3/projects/6ac1903a98024bf4bec75f4670abecd3` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:43.235669 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6719b-f254-45c5-b9db-69ddd7a0164d None admin] RBAC: Authorizing `identity:get_project(project_id=6ac1903a98024bf4bec75f4670abecd3)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:43.237906 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6719b-f254-45c5-b9db-69ddd7a0164d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:43.240117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 50/98] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:43 2022] GET /identity/v3/projects/6ac1903a98024bf4bec75f4670abecd3 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:43.246121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b982-ed2f-4d0a-a148-592645917fbc None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:43.395974 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6719b-f254-45c5-b9db-69ddd7a0164d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:43.397542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b982-ed2f-4d0a-a148-592645917fbc None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:43.402788 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:43.465067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22fd46-6485-4155-99e4-796af5aa6ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:43.466052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22fd46-6485-4155-99e4-796af5aa6ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:43.466591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22fd46-6485-4155-99e4-796af5aa6ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:43.467844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22fd46-6485-4155-99e4-796af5aa6ef9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:43.469242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22fd46-6485-4155-99e4-796af5aa6ef9 None admin] RBAC: Adding query filter params (role.id=40d451ce7e0143e682ac5d43622c57d2, scope.project.id=6ac1903a98024bf4bec75f4670abecd3, user.id=15313602248c4227a5b0b9e1c4fdfeed) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:43.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22fd46-6485-4155-99e4-796af5aa6ef9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:43.473087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22fd46-6485-4155-99e4-796af5aa6ef9 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:43.488767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 49/99] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:52:43 2022] GET /identity/v3/role_assignments?user.id=15313602248c4227a5b0b9e1c4fdfeed&scope.project.id=6ac1903a98024bf4bec75f4670abecd3&role.id=40d451ce7e0143e682ac5d43622c57d2 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:43.490604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6758e-f17d-404f-91d8-efd966489169 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:43.494028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6758e-f17d-404f-91d8-efd966489169 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:43.494568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6758e-f17d-404f-91d8-efd966489169 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:43.496215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 50/100] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:43.502713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce554081-f099-48d1-8e20-cc9778ee44e0 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:43.503382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce554081-f099-48d1-8e20-cc9778ee44e0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:43.503942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce554081-f099-48d1-8e20-cc9778ee44e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:43.544842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ce554081-f099-48d1-8e20-cc9778ee44e0 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:43.550098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ce554081-f099-48d1-8e20-cc9778ee44e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:43.604539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6719b-f254-45c5-b9db-69ddd7a0164d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:43.691954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 51/101] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:43.712208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d8221-c59d-4ce4-822f-e3de4a6af54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:43.713226 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d8221-c59d-4ce4-822f-e3de4a6af54b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:43.713702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d8221-c59d-4ce4-822f-e3de4a6af54b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:43.714169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d8221-c59d-4ce4-822f-e3de4a6af54b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:43.742013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d8221-c59d-4ce4-822f-e3de4a6af54b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-6d1d8221-c59d-4ce4-822f-e3de4a6af54b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:43.748007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:43.749445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:43.750299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:43.750299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:43.750299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:43.750299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:43.750299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:43.750299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:43.750299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:43.750299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:43.750299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:43.750299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:43.750299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:52:43.750299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:43.753048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 51/102] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:43.759045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce554081-f099-48d1-8e20-cc9778ee44e0 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:43.980164 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:43.984973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce554081-f099-48d1-8e20-cc9778ee44e0 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:44.034301 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f3e06-dbc9-4a55-b5cd-76a2acd70763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:44.034971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f3e06-dbc9-4a55-b5cd-76a2acd70763 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:44.035256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f3e06-dbc9-4a55-b5cd-76a2acd70763 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:44.035532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f3e06-dbc9-4a55-b5cd-76a2acd70763 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:44.036220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f3e06-dbc9-4a55-b5cd-76a2acd70763 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:44.036523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f3e06-dbc9-4a55-b5cd-76a2acd70763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:44.037913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f3e06-dbc9-4a55-b5cd-76a2acd70763 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:44.047459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 52/103] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:52:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:44.053245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d8221-c59d-4ce4-822f-e3de4a6af54b None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:44.077399 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f3e06-dbc9-4a55-b5cd-76a2acd70763 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:44.157918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:44.208478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f3e06-dbc9-4a55-b5cd-76a2acd70763 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:44.263372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d8221-c59d-4ce4-822f-e3de4a6af54b None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:44.274306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf69d1-17b4-4ed9-84e9-8ddc7f1774d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:44.274989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf69d1-17b4-4ed9-84e9-8ddc7f1774d5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:44.275274 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf69d1-17b4-4ed9-84e9-8ddc7f1774d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:44.275601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf69d1-17b4-4ed9-84e9-8ddc7f1774d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:44.276766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf69d1-17b4-4ed9-84e9-8ddc7f1774d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:44.278259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf69d1-17b4-4ed9-84e9-8ddc7f1774d5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:44.283382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 53/104] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:52:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:44.290792 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf69d1-17b4-4ed9-84e9-8ddc7f1774d5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:44.329551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:44.348108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ac150-e163-4740-a188-75d6827156b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:44.348780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ac150-e163-4740-a188-75d6827156b1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:44.349067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ac150-e163-4740-a188-75d6827156b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:44.349353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ac150-e163-4740-a188-75d6827156b1 None admin] PATH_INFO: `/v3/users/3377ad62948c4172a41f20cabc26f26f` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:44.388104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ac150-e163-4740-a188-75d6827156b1 None admin] RBAC: Authorizing `identity:get_user(user_id=3377ad62948c4172a41f20cabc26f26f)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:44.391326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ac150-e163-4740-a188-75d6827156b1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:44.393545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 52/105] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:44 2022] GET /identity/v3/users/3377ad62948c4172a41f20cabc26f26f => generated 289 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:44.399573 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ac150-e163-4740-a188-75d6827156b1 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:44.456248 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf69d1-17b4-4ed9-84e9-8ddc7f1774d5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:44.548738 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6d4f2-c2ab-4549-8845-a2aff059b9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:44.549641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d4f2-c2ab-4549-8845-a2aff059b9a6 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:44.551131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d4f2-c2ab-4549-8845-a2aff059b9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:44.551611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d4f2-c2ab-4549-8845-a2aff059b9a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:44.553138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6d4f2-c2ab-4549-8845-a2aff059b9a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:44.555976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6d4f2-c2ab-4549-8845-a2aff059b9a6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:44.609646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ac150-e163-4740-a188-75d6827156b1 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:44.625087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 54/106] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:52:44 2022] POST /identity/v3/projects => generated 302 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 20:52:44.626405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12085c46-8253-406e-8092-769ed764a355 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:44.626814 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12085c46-8253-406e-8092-769ed764a355 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:44.627103 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12085c46-8253-406e-8092-769ed764a355 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:44.628513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 55/107] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:44.628625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:44.634685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0ff86-0ce9-495e-8ad2-49b7225f1ce2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:44.635009 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0ff86-0ce9-495e-8ad2-49b7225f1ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:44.635294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0ff86-0ce9-495e-8ad2-49b7225f1ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:44.666290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27692ed3-58f7-43f8-989d-3cd4a6a9186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:44.668107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692ed3-58f7-43f8-989d-3cd4a6a9186d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:44.669283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692ed3-58f7-43f8-989d-3cd4a6a9186d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:44.669790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692ed3-58f7-43f8-989d-3cd4a6a9186d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:44.676782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a4d0ff86-0ce9-495e-8ad2-49b7225f1ce2 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:44.681423 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a4d0ff86-0ce9-495e-8ad2-49b7225f1ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:44.811770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27692ed3-58f7-43f8-989d-3cd4a6a9186d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:44.813154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27692ed3-58f7-43f8-989d-3cd4a6a9186d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:44.894403 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 56/108] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:44.988850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 53/109] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:52:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:52:44.997679 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0ff86-0ce9-495e-8ad2-49b7225f1ce2 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:45.018622 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:45.213956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0ff86-0ce9-495e-8ad2-49b7225f1ce2 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:45.284386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca978c-cfb8-4580-bb29-55484a5dfd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:45.285309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca978c-cfb8-4580-bb29-55484a5dfd72 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:45.285721 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca978c-cfb8-4580-bb29-55484a5dfd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:45.286125 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca978c-cfb8-4580-bb29-55484a5dfd72 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:45.287843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca978c-cfb8-4580-bb29-55484a5dfd72 None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:45.290498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca978c-cfb8-4580-bb29-55484a5dfd72 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:45.293836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 57/110] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:44 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:45.301770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27692ed3-58f7-43f8-989d-3cd4a6a9186d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:45.321606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:45.450156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27692ed3-58f7-43f8-989d-3cd4a6a9186d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:45.485373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca978c-cfb8-4580-bb29-55484a5dfd72 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:45.495912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcad0f-0cf3-41c2-a8c0-7fac65efca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:45.496872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcad0f-0cf3-41c2-a8c0-7fac65efca4a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:45.497375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcad0f-0cf3-41c2-a8c0-7fac65efca4a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:45.497873 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcad0f-0cf3-41c2-a8c0-7fac65efca4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:45.499993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcad0f-0cf3-41c2-a8c0-7fac65efca4a None admin] RBAC: Adding query filter params (role.id=b1ad7360ee8a4c03bc87e2f9121a7d65, scope.project.id=90fb40089787468fac42f2a8bafe87dc, user.id=3377ad62948c4172a41f20cabc26f26f) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:45.500532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcad0f-0cf3-41c2-a8c0-7fac65efca4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:45.502213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcad0f-0cf3-41c2-a8c0-7fac65efca4a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:45.509064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 54/111] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:52:45 2022] GET /identity/v3/role_assignments?user.id=3377ad62948c4172a41f20cabc26f26f&scope.project.id=90fb40089787468fac42f2a8bafe87dc&role.id=b1ad7360ee8a4c03bc87e2f9121a7d65 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:45.620297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb863c4-1a76-4734-8d79-a855cc086c63 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:45.621433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb863c4-1a76-4734-8d79-a855cc086c63 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:45.621924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb863c4-1a76-4734-8d79-a855cc086c63 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:45.624477 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 55/112] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:52:45.640845 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bc3c0-25c8-4eb0-8fe5-e7afb94c5367 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:45.641505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bc3c0-25c8-4eb0-8fe5-e7afb94c5367 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:45.641980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bc3c0-25c8-4eb0-8fe5-e7afb94c5367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:45.699991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7f1bc3c0-25c8-4eb0-8fe5-e7afb94c5367 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:45.701794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7f1bc3c0-25c8-4eb0-8fe5-e7afb94c5367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:45.735965 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:45.786448 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca978c-cfb8-4580-bb29-55484a5dfd72 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:45.906222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835959ab-d395-47b8-be40-dd5bac07b9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:45.907782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835959ab-d395-47b8-be40-dd5bac07b9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:45.908286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835959ab-d395-47b8-be40-dd5bac07b9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:45.908767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835959ab-d395-47b8-be40-dd5bac07b9c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:45.924132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 56/113] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:45.925788 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27d930-c164-420e-afce-9b0ec5365d7c None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:45.926284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27d930-c164-420e-afce-9b0ec5365d7c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:45.926837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27d930-c164-420e-afce-9b0ec5365d7c None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:45.928595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 57/114] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:45.930596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835959ab-d395-47b8-be40-dd5bac07b9c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:45.936670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c59b6d-d408-4ce8-a73c-35d0163006ea None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:45.937328 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c59b6d-d408-4ce8-a73c-35d0163006ea None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-835959ab-d395-47b8-be40-dd5bac07b9c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:45.937767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:45.938632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:45.939442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:45.939442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:45.939442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:45.939442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:45.939442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:45.939442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:45.939442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:45.939442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:45.939442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:45.939442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:45.939442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:52:45.939442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:52:45.939442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 58/115] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:52:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:52:45.940626 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c59b6d-d408-4ce8-a73c-35d0163006ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:45.950828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835959ab-d395-47b8-be40-dd5bac07b9c2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:45.961543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:45.983985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-57c59b6d-d408-4ce8-a73c-35d0163006ea None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:45.985550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-57c59b6d-d408-4ce8-a73c-35d0163006ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:46.060365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835959ab-d395-47b8-be40-dd5bac07b9c2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:46.102366 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c1534-7dbf-417f-aae4-6e3c139d4370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:46.103084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c1534-7dbf-417f-aae4-6e3c139d4370 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:46.103366 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c1534-7dbf-417f-aae4-6e3c139d4370 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:46.103641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c1534-7dbf-417f-aae4-6e3c139d4370 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:46.104380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c1534-7dbf-417f-aae4-6e3c139d4370 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:46.104690 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c1534-7dbf-417f-aae4-6e3c139d4370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:46.106082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c1534-7dbf-417f-aae4-6e3c139d4370 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:46.119185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:46.119376 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 59/116] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:52:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:46.125483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c1534-7dbf-417f-aae4-6e3c139d4370 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:46.181682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 58/117] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:52:46.267395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c1534-7dbf-417f-aae4-6e3c139d4370 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:46.304944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6b314-2498-4ce8-92eb-b02397179fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:46.305590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6b314-2498-4ce8-92eb-b02397179fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:46.305873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6b314-2498-4ce8-92eb-b02397179fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:46.306156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6b314-2498-4ce8-92eb-b02397179fd2 None admin] PATH_INFO: `/v3/users/15313602248c4227a5b0b9e1c4fdfeed` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:46.310626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6b314-2498-4ce8-92eb-b02397179fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=15313602248c4227a5b0b9e1c4fdfeed)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:46.312597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6b314-2498-4ce8-92eb-b02397179fd2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:46.314218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 60/118] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:46 2022] GET /identity/v3/users/15313602248c4227a5b0b9e1c4fdfeed => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:46.320070 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c59b6d-d408-4ce8-a73c-35d0163006ea None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:46.448165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c59b6d-d408-4ce8-a73c-35d0163006ea None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:46.487702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148058e6-f956-46f5-9332-f1039132f1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:46.488372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148058e6-f956-46f5-9332-f1039132f1db None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:46.488714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148058e6-f956-46f5-9332-f1039132f1db None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:46.489251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148058e6-f956-46f5-9332-f1039132f1db None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:46.490682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148058e6-f956-46f5-9332-f1039132f1db None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:46.492253 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148058e6-f956-46f5-9332-f1039132f1db None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:46.494387 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 59/119] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:46 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:46.501122 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6b314-2498-4ce8-92eb-b02397179fd2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:46.562076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148058e6-f956-46f5-9332-f1039132f1db None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:46.564958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:46.624468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:46.698126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6b314-2498-4ce8-92eb-b02397179fd2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:46.725625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148058e6-f956-46f5-9332-f1039132f1db None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:46.767729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac60e6-a97b-4bdf-ade8-f9066e6b3a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:46.768470 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac60e6-a97b-4bdf-ade8-f9066e6b3a3f None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:46.768753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac60e6-a97b-4bdf-ade8-f9066e6b3a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:46.769040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac60e6-a97b-4bdf-ade8-f9066e6b3a3f None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc/users/15313602248c4227a5b0b9e1c4fdfeed/roles/0fdbf18b17e545d9929e22ebddc1d5b7` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:46.773787 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac60e6-a97b-4bdf-ade8-f9066e6b3a3f None admin] RBAC: Authorizing `identity:create_grant(project_id=90fb40089787468fac42f2a8bafe87dc, user_id=15313602248c4227a5b0b9e1c4fdfeed, role_id=0fdbf18b17e545d9929e22ebddc1d5b7)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:46.775500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac60e6-a97b-4bdf-ade8-f9066e6b3a3f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:46.792224 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda6ed6-628f-44a5-be07-790ea3d647aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:46.793634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda6ed6-628f-44a5-be07-790ea3d647aa None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:46.794170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda6ed6-628f-44a5-be07-790ea3d647aa None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:46.794662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda6ed6-628f-44a5-be07-790ea3d647aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:46.795580 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 61/120] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:52:46 2022] PUT /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc/users/15313602248c4227a5b0b9e1c4fdfeed/roles/0fdbf18b17e545d9929e22ebddc1d5b7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:52:46.797276 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce702ef-3b46-4bc3-85fb-db389d938c76 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:46.797861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce702ef-3b46-4bc3-85fb-db389d938c76 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:46.798291 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce702ef-3b46-4bc3-85fb-db389d938c76 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:46.800832 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 62/121] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:46.802023 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce702ef-3b46-4bc3-85fb-db389d938c76 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:46.824616 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda6ed6-628f-44a5-be07-790ea3d647aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-7eda6ed6-628f-44a5-be07-790ea3d647aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:46.834250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:46.835386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:46.836207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:46.836207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:46.836207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:46.836207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:46.836207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:46.836207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:46.836207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:46.836207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:46.836207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:46.836207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:46.836207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:52:46.836207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:46.839069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 60/122] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:46.840860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f4f1a-186e-46b0-83d3-b5bbf46da0ec None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:46.847124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f4f1a-186e-46b0-83d3-b5bbf46da0ec None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:46.847639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f4f1a-186e-46b0-83d3-b5bbf46da0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:46.875106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-1d4f4f1a-186e-46b0-83d3-b5bbf46da0ec None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:46.877103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1d4f4f1a-186e-46b0-83d3-b5bbf46da0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:47.008571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce702ef-3b46-4bc3-85fb-db389d938c76 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:47.015717 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:47.036138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 61/123] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:47.037061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f4f1a-186e-46b0-83d3-b5bbf46da0ec None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:47.072586 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:47.089025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98449cb6-ec36-4e6d-bcc3-f89fbcb8d789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:47.089748 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98449cb6-ec36-4e6d-bcc3-f89fbcb8d789 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:47.090134 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98449cb6-ec36-4e6d-bcc3-f89fbcb8d789 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:47.090495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98449cb6-ec36-4e6d-bcc3-f89fbcb8d789 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:47.107679 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98449cb6-ec36-4e6d-bcc3-f89fbcb8d789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-98449cb6-ec36-4e6d-bcc3-f89fbcb8d789 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:47.112854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:47.113802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:47.114597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:47.114597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:47.114597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:47.114597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:47.114597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:47.114597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:47.114597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:47.114597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:47.114597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:47.114597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:47.114597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:47.114597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:52:47.120312 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 63/124] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:52:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:47.130552 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98449cb6-ec36-4e6d-bcc3-f89fbcb8d789 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:47.189311 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f4f1a-186e-46b0-83d3-b5bbf46da0ec None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:47.251319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765cfbf-ea98-4b87-94e9-18633c488ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:47.252282 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765cfbf-ea98-4b87-94e9-18633c488ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:47.252748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765cfbf-ea98-4b87-94e9-18633c488ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:47.253205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765cfbf-ea98-4b87-94e9-18633c488ca1 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:47.254065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765cfbf-ea98-4b87-94e9-18633c488ca1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:47.254838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765cfbf-ea98-4b87-94e9-18633c488ca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:47.256540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765cfbf-ea98-4b87-94e9-18633c488ca1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:47.267148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98449cb6-ec36-4e6d-bcc3-f89fbcb8d789 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:47.278839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 62/125] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:52:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:47.287474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765cfbf-ea98-4b87-94e9-18633c488ca1 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:47.326237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916599b-aa16-472e-ac72-37098f4d549b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:47.327911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916599b-aa16-472e-ac72-37098f4d549b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:47.328432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916599b-aa16-472e-ac72-37098f4d549b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:47.328908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916599b-aa16-472e-ac72-37098f4d549b None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:47.329782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916599b-aa16-472e-ac72-37098f4d549b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:47.330269 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916599b-aa16-472e-ac72-37098f4d549b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:47.331914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916599b-aa16-472e-ac72-37098f4d549b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:47.350370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 64/126] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:47.359361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916599b-aa16-472e-ac72-37098f4d549b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:47.407255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:47.478943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765cfbf-ea98-4b87-94e9-18633c488ca1 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:47.499275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:47.546663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d3b1d-ae94-4ccc-bd8b-79ae104a5fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:47.547378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3b1d-ae94-4ccc-bd8b-79ae104a5fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:47.547669 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3b1d-ae94-4ccc-bd8b-79ae104a5fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:47.547952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3b1d-ae94-4ccc-bd8b-79ae104a5fe5 None admin] PATH_INFO: `/v3/users/15313602248c4227a5b0b9e1c4fdfeed` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:47.549259 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d3b1d-ae94-4ccc-bd8b-79ae104a5fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=15313602248c4227a5b0b9e1c4fdfeed)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:47.550770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d3b1d-ae94-4ccc-bd8b-79ae104a5fe5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:47.552766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 63/127] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:47 2022] GET /identity/v3/users/15313602248c4227a5b0b9e1c4fdfeed => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:47.558119 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d3b1d-ae94-4ccc-bd8b-79ae104a5fe5 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:47.653160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916599b-aa16-472e-ac72-37098f4d549b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:47.678773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d3b1d-ae94-4ccc-bd8b-79ae104a5fe5 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:47.701865 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:47.714486 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc94436-ce9f-4dbc-9450-6b6e20fac458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:47.715195 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc94436-ce9f-4dbc-9450-6b6e20fac458 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:47.718766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc94436-ce9f-4dbc-9450-6b6e20fac458 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:47.718766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc94436-ce9f-4dbc-9450-6b6e20fac458 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:47.718766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc94436-ce9f-4dbc-9450-6b6e20fac458 None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:47.719292 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc94436-ce9f-4dbc-9450-6b6e20fac458 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:47.721003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 64/128] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:47 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:47.721802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc94436-ce9f-4dbc-9450-6b6e20fac458 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:47.768296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ea537-f1bc-4db0-b0a6-6af5025955a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:47.769955 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ea537-f1bc-4db0-b0a6-6af5025955a7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:47.770704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ea537-f1bc-4db0-b0a6-6af5025955a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:47.771454 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ea537-f1bc-4db0-b0a6-6af5025955a7 None admin] PATH_INFO: `/v3/users/0e229cb6df1d467b90bf2948d7f02eb9` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:47.780782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ea537-f1bc-4db0-b0a6-6af5025955a7 None admin] RBAC: Authorizing `identity:get_user(user_id=0e229cb6df1d467b90bf2948d7f02eb9)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:47.783439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ea537-f1bc-4db0-b0a6-6af5025955a7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:47.786709 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 65/129] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:47 2022] GET /identity/v3/users/0e229cb6df1d467b90bf2948d7f02eb9 => generated 247 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:47.789902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ea537-f1bc-4db0-b0a6-6af5025955a7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:47.855739 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc94436-ce9f-4dbc-9450-6b6e20fac458 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:47.909908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8497b08-d515-4925-b4e1-a4d9cd7f24e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:47.910489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497b08-d515-4925-b4e1-a4d9cd7f24e9 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:47.910809 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497b08-d515-4925-b4e1-a4d9cd7f24e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:47.911097 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497b08-d515-4925-b4e1-a4d9cd7f24e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:47.930781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8497b08-d515-4925-b4e1-a4d9cd7f24e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-a8497b08-d515-4925-b4e1-a4d9cd7f24e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:47.931822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:47.933555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 65/130] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:47.935120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8497b08-d515-4925-b4e1-a4d9cd7f24e9 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:48.061901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ea537-f1bc-4db0-b0a6-6af5025955a7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:48.072703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:48.099038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:48.151513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206f532-1ecc-4684-b18d-5d78117d9279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:48.152215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206f532-1ecc-4684-b18d-5d78117d9279 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:48.152504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206f532-1ecc-4684-b18d-5d78117d9279 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:48.152775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206f532-1ecc-4684-b18d-5d78117d9279 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc/users/15313602248c4227a5b0b9e1c4fdfeed/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:48.161615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206f532-1ecc-4684-b18d-5d78117d9279 None admin] RBAC: Authorizing `identity:create_grant(project_id=90fb40089787468fac42f2a8bafe87dc, user_id=15313602248c4227a5b0b9e1c4fdfeed, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:48.167383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206f532-1ecc-4684-b18d-5d78117d9279 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:48.206779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 66/131] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:52:47 2022] PUT /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc/users/15313602248c4227a5b0b9e1c4fdfeed/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:52:48.209113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206f532-1ecc-4684-b18d-5d78117d9279 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:48.255949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8497b08-d515-4925-b4e1-a4d9cd7f24e9 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:48.368065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507db850-7dc2-441b-83c1-af207fbc45d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:48.369685 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db850-7dc2-441b-83c1-af207fbc45d8 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:48.370484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db850-7dc2-441b-83c1-af207fbc45d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:48.371268 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db850-7dc2-441b-83c1-af207fbc45d8 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:48.374333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507db850-7dc2-441b-83c1-af207fbc45d8 None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:48.377763 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507db850-7dc2-441b-83c1-af207fbc45d8 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:48.381866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 66/132] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:47 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:48.392748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507db850-7dc2-441b-83c1-af207fbc45d8 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:48.408352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206f532-1ecc-4684-b18d-5d78117d9279 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:48.446786 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1773e-7b8b-4a7a-9fc0-0fe7d2af449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:48.447416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1773e-7b8b-4a7a-9fc0-0fe7d2af449f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:48.447706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1773e-7b8b-4a7a-9fc0-0fe7d2af449f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:48.447987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1773e-7b8b-4a7a-9fc0-0fe7d2af449f None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:48.448705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1773e-7b8b-4a7a-9fc0-0fe7d2af449f None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:48.449027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1773e-7b8b-4a7a-9fc0-0fe7d2af449f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:48.450512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1773e-7b8b-4a7a-9fc0-0fe7d2af449f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:48.468410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 67/133] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:52:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:48.473512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1773e-7b8b-4a7a-9fc0-0fe7d2af449f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:48.548156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:48.627492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507db850-7dc2-441b-83c1-af207fbc45d8 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:48.651109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:48.651320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1773e-7b8b-4a7a-9fc0-0fe7d2af449f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:48.712197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc7353-4e71-4dba-824b-c0dfd2fbfd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:48.719208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc7353-4e71-4dba-824b-c0dfd2fbfd12 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:48.719706 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc7353-4e71-4dba-824b-c0dfd2fbfd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:48.720209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc7353-4e71-4dba-824b-c0dfd2fbfd12 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc/users/0e229cb6df1d467b90bf2948d7f02eb9/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:48.725764 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc7353-4e71-4dba-824b-c0dfd2fbfd12 None admin] RBAC: Authorizing `identity:create_grant(project_id=90fb40089787468fac42f2a8bafe87dc, user_id=0e229cb6df1d467b90bf2948d7f02eb9, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:48.728410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc7353-4e71-4dba-824b-c0dfd2fbfd12 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:48.765423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 67/134] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:52:48 2022] PUT /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc/users/0e229cb6df1d467b90bf2948d7f02eb9/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 20:52:48.768532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d77cf2-16aa-4aaf-a21d-9b09f2d907a7 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:48.768978 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d77cf2-16aa-4aaf-a21d-9b09f2d907a7 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:48.769410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d77cf2-16aa-4aaf-a21d-9b09f2d907a7 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:48.772747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 68/135] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:48.781685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d9b00-6962-4737-8406-070dd6f2caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:48.782454 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d9b00-6962-4737-8406-070dd6f2caca None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:48.782762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d9b00-6962-4737-8406-070dd6f2caca None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:48.782943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc4dc-f789-484e-868d-a6e0bbc0d569 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:48.783052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d9b00-6962-4737-8406-070dd6f2caca None admin] PATH_INFO: `/v3/users/15313602248c4227a5b0b9e1c4fdfeed` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:48.783479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc4dc-f789-484e-868d-a6e0bbc0d569 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:48.784124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc4dc-f789-484e-868d-a6e0bbc0d569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:48.787682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d9b00-6962-4737-8406-070dd6f2caca None admin] RBAC: Authorizing `identity:get_user(user_id=15313602248c4227a5b0b9e1c4fdfeed)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:48.789249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d9b00-6962-4737-8406-070dd6f2caca None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:48.791234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 68/136] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:48 2022] GET /identity/v3/users/15313602248c4227a5b0b9e1c4fdfeed => generated 275 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:48.798146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d9b00-6962-4737-8406-070dd6f2caca None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:48.844719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-090bc4dc-f789-484e-868d-a6e0bbc0d569 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:48.846765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-090bc4dc-f789-484e-868d-a6e0bbc0d569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:49.065401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d9b00-6962-4737-8406-070dd6f2caca None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:49.070116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 69/137] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:49.079230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:49.096272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1aa6ff-a024-437b-8c9a-dad56ea6cab7 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:49.096598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1aa6ff-a024-437b-8c9a-dad56ea6cab7 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:49.096850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1aa6ff-a024-437b-8c9a-dad56ea6cab7 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:49.098333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 70/138] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:49.108900 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b99c3-a068-46d4-b45c-8589fed1214c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:49.109283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b99c3-a068-46d4-b45c-8589fed1214c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:49.109569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b99c3-a068-46d4-b45c-8589fed1214c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:49.118912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d113ba6-a848-4be4-90af-14d03f22a3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:49.120055 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113ba6-a848-4be4-90af-14d03f22a3ab None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:49.120552 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113ba6-a848-4be4-90af-14d03f22a3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:49.121039 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113ba6-a848-4be4-90af-14d03f22a3ab None admin] PATH_INFO: `/v3/projects/6ac1903a98024bf4bec75f4670abecd3` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:49.123739 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d113ba6-a848-4be4-90af-14d03f22a3ab None admin] RBAC: Authorizing `identity:get_project(project_id=6ac1903a98024bf4bec75f4670abecd3)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:49.128270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d113ba6-a848-4be4-90af-14d03f22a3ab None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:49.131905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 69/139] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:48 2022] GET /identity/v3/projects/6ac1903a98024bf4bec75f4670abecd3 => generated 312 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:49.139972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d113ba6-a848-4be4-90af-14d03f22a3ab None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:49.144790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-320b99c3-a068-46d4-b45c-8589fed1214c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:49.146034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-320b99c3-a068-46d4-b45c-8589fed1214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:49.304709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 71/140] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:49.365097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d113ba6-a848-4be4-90af-14d03f22a3ab None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:49.418202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7d175-6c7d-4b51-847e-aa516c0f4168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:49.418914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7d175-6c7d-4b51-847e-aa516c0f4168 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:49.419199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7d175-6c7d-4b51-847e-aa516c0f4168 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:49.419479 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7d175-6c7d-4b51-847e-aa516c0f4168 None admin] PATH_INFO: `/v3/projects/6ac1903a98024bf4bec75f4670abecd3/users/15313602248c4227a5b0b9e1c4fdfeed/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:49.421861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7d175-6c7d-4b51-847e-aa516c0f4168 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac1903a98024bf4bec75f4670abecd3, user_id=15313602248c4227a5b0b9e1c4fdfeed, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:49.423374 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7d175-6c7d-4b51-847e-aa516c0f4168 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:49.448728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 70/141] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:52:49 2022] PUT /identity/v3/projects/6ac1903a98024bf4bec75f4670abecd3/users/15313602248c4227a5b0b9e1c4fdfeed/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 20:52:49.507563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b99c3-a068-46d4-b45c-8589fed1214c None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:49.558556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:49.643633 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b99c3-a068-46d4-b45c-8589fed1214c None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:49.686982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d020e5-152a-4493-9c56-088ae1d11f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:49.687717 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d020e5-152a-4493-9c56-088ae1d11f28 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:49.688008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d020e5-152a-4493-9c56-088ae1d11f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:49.688288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d020e5-152a-4493-9c56-088ae1d11f28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:49.689586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d020e5-152a-4493-9c56-088ae1d11f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:49.691185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d020e5-152a-4493-9c56-088ae1d11f28 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:49.692835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 72/142] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:52:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:49.698625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7d175-6c7d-4b51-847e-aa516c0f4168 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:49.717892 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d020e5-152a-4493-9c56-088ae1d11f28 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:49.787139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:49.868579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7d175-6c7d-4b51-847e-aa516c0f4168 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:49.979977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d020e5-152a-4493-9c56-088ae1d11f28 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:49.983357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5692615-67cb-4088-a47e-0e5b986f1f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:49.984374 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692615-67cb-4088-a47e-0e5b986f1f41 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:49.984855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692615-67cb-4088-a47e-0e5b986f1f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:49.985331 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692615-67cb-4088-a47e-0e5b986f1f41 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:49.986495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5692615-67cb-4088-a47e-0e5b986f1f41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:49.990788 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5692615-67cb-4088-a47e-0e5b986f1f41 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:50.000076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:50.042623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 71/143] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:52:49 2022] POST /identity/v3/users => generated 283 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 20:52:50.045260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6d5ca-1c92-4293-9d71-7c4328aa5b6e None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:50.045981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6d5ca-1c92-4293-9d71-7c4328aa5b6e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:50.046468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6d5ca-1c92-4293-9d71-7c4328aa5b6e None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:50.050247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 72/144] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:50.057404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755cb49-9f7a-4fb6-8709-37067f81d246 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:50.057891 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755cb49-9f7a-4fb6-8709-37067f81d246 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:50.058365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755cb49-9f7a-4fb6-8709-37067f81d246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:50.078380 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9d28b-7a07-4aab-a43d-b0e0c6de9ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:50.080465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9d28b-7a07-4aab-a43d-b0e0c6de9ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:50.081165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9d28b-7a07-4aab-a43d-b0e0c6de9ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:50.081758 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9d28b-7a07-4aab-a43d-b0e0c6de9ed9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:50.096511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9d28b-7a07-4aab-a43d-b0e0c6de9ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:50.096949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d755cb49-9f7a-4fb6-8709-37067f81d246 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:50.099080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d755cb49-9f7a-4fb6-8709-37067f81d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-11c9d28b-7a07-4aab-a43d-b0e0c6de9ed9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:50.102959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:50.103927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:50.104816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:50.104816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:50.104816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:50.104816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:50.104816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:50.104816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:50.104816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:50.104816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:50.104816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:50.104816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:50.104816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:52:50.104816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:50.107535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 73/145] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:50.114879 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9d28b-7a07-4aab-a43d-b0e0c6de9ed9 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:50.238221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 73/146] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:50.300564 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9d28b-7a07-4aab-a43d-b0e0c6de9ed9 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:50.344865 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32f327-88f6-4167-8e93-62a0ca547054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:50.345891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32f327-88f6-4167-8e93-62a0ca547054 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:50.346391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32f327-88f6-4167-8e93-62a0ca547054 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:50.346929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32f327-88f6-4167-8e93-62a0ca547054 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:50.347828 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32f327-88f6-4167-8e93-62a0ca547054 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:50.348360 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32f327-88f6-4167-8e93-62a0ca547054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:50.350040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32f327-88f6-4167-8e93-62a0ca547054 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:50.360330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 74/147] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:52:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:50.369025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755cb49-9f7a-4fb6-8709-37067f81d246 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:50.439847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:50.572927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755cb49-9f7a-4fb6-8709-37067f81d246 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:50.617588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7bcc2-fef5-4317-8d7d-183549d3bf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:50.618235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7bcc2-fef5-4317-8d7d-183549d3bf70 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:50.618513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7bcc2-fef5-4317-8d7d-183549d3bf70 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:50.618819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7bcc2-fef5-4317-8d7d-183549d3bf70 None admin] PATH_INFO: `/v3/users/3377ad62948c4172a41f20cabc26f26f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:50.619983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7bcc2-fef5-4317-8d7d-183549d3bf70 None admin] RBAC: Authorizing `identity:get_user(user_id=3377ad62948c4172a41f20cabc26f26f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:50.624002 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7bcc2-fef5-4317-8d7d-183549d3bf70 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:50.626010 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 74/148] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:50 2022] GET /identity/v3/users/3377ad62948c4172a41f20cabc26f26f => generated 289 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:50.637305 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32f327-88f6-4167-8e93-62a0ca547054 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:50.660697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7bcc2-fef5-4317-8d7d-183549d3bf70 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:50.704917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:50.836214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:50.857618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7bcc2-fef5-4317-8d7d-183549d3bf70 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:50.875967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32f327-88f6-4167-8e93-62a0ca547054 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:50.940244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e0e7d-a482-4b6f-af64-596c82cc0988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:50.940952 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e0e7d-a482-4b6f-af64-596c82cc0988 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:50.941369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e0e7d-a482-4b6f-af64-596c82cc0988 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:50.941654 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e0e7d-a482-4b6f-af64-596c82cc0988 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:50.960803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e84cff-fd1a-4826-ab35-3f0ad0144ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:50.961458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e84cff-fd1a-4826-ab35-3f0ad0144ccd None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:50.961769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e84cff-fd1a-4826-ab35-3f0ad0144ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:50.962043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e84cff-fd1a-4826-ab35-3f0ad0144ccd None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:50.964684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e84cff-fd1a-4826-ab35-3f0ad0144ccd None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:50.966025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e84cff-fd1a-4826-ab35-3f0ad0144ccd None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:50.971041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 75/149] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:50 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:50.972085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e0e7d-a482-4b6f-af64-596c82cc0988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-964e0e7d-a482-4b6f-af64-596c82cc0988 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:50.977198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:50.978307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:50.979385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:50.979385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:50.979385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:50.979385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:50.979385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:50.979385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:50.979385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:50.979385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:50.979385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:50.979385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:50.979385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:52:50.979385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:52:50.979385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 75/150] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:52:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:52:50.984223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e84cff-fd1a-4826-ab35-3f0ad0144ccd None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:50.986624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e0e7d-a482-4b6f-af64-596c82cc0988 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:51.136362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:51.141190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e84cff-fd1a-4826-ab35-3f0ad0144ccd None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:51.184403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef486db-cea7-4182-9b2c-b4b9d5c262f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:51.186071 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef486db-cea7-4182-9b2c-b4b9d5c262f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:51.186389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef486db-cea7-4182-9b2c-b4b9d5c262f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:51.186666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef486db-cea7-4182-9b2c-b4b9d5c262f9 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc/users/3377ad62948c4172a41f20cabc26f26f/roles/b1ad7360ee8a4c03bc87e2f9121a7d65` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:51.189444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef486db-cea7-4182-9b2c-b4b9d5c262f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=90fb40089787468fac42f2a8bafe87dc, user_id=3377ad62948c4172a41f20cabc26f26f, role_id=b1ad7360ee8a4c03bc87e2f9121a7d65)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:51.190958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef486db-cea7-4182-9b2c-b4b9d5c262f9 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:51.220046 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 76/151] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:52:50 2022] PUT /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc/users/3377ad62948c4172a41f20cabc26f26f/roles/b1ad7360ee8a4c03bc87e2f9121a7d65 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:52:51.255991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e0e7d-a482-4b6f-af64-596c82cc0988 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:51.308504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67ed6-cda0-48ea-b99b-6da56569a656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:51.309590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67ed6-cda0-48ea-b99b-6da56569a656 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:51.310157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67ed6-cda0-48ea-b99b-6da56569a656 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:51.311234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67ed6-cda0-48ea-b99b-6da56569a656 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:51.311941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c67ed6-cda0-48ea-b99b-6da56569a656 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:51.312256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c67ed6-cda0-48ea-b99b-6da56569a656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:51.313888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c67ed6-cda0-48ea-b99b-6da56569a656 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:51.327980 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 76/152] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:52:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:51.335079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef486db-cea7-4182-9b2c-b4b9d5c262f9 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:51.519390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef486db-cea7-4182-9b2c-b4b9d5c262f9 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:51.601807 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf1778-11d3-4ca6-8cd8-79b0e07dd498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:51.603114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf1778-11d3-4ca6-8cd8-79b0e07dd498 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:51.603633 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf1778-11d3-4ca6-8cd8-79b0e07dd498 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:51.604124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf1778-11d3-4ca6-8cd8-79b0e07dd498 None admin] PATH_INFO: `/v3/users/15313602248c4227a5b0b9e1c4fdfeed` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:51.606438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf1778-11d3-4ca6-8cd8-79b0e07dd498 None admin] RBAC: Authorizing `identity:get_user(user_id=15313602248c4227a5b0b9e1c4fdfeed)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:51.609909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf1778-11d3-4ca6-8cd8-79b0e07dd498 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:51.613569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 77/153] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:51 2022] GET /identity/v3/users/15313602248c4227a5b0b9e1c4fdfeed => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:51.619960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67ed6-cda0-48ea-b99b-6da56569a656 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:51.659671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:51.787538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67ed6-cda0-48ea-b99b-6da56569a656 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:51.834714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09674ad4-edd9-40de-a896-5da68e82714c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:51.835376 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674ad4-edd9-40de-a896-5da68e82714c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:51.835718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674ad4-edd9-40de-a896-5da68e82714c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:51.836003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674ad4-edd9-40de-a896-5da68e82714c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:51.972789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09674ad4-edd9-40de-a896-5da68e82714c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:51.975722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09674ad4-edd9-40de-a896-5da68e82714c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:52.007153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:52.175055 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 77/154] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:52:52.181238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf1778-11d3-4ca6-8cd8-79b0e07dd498 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:52.228659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:52.301536 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d2541-6561-47db-aba1-03dafc0e6b79 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:52.303110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d2541-6561-47db-aba1-03dafc0e6b79 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:52.303967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d2541-6561-47db-aba1-03dafc0e6b79 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:52.311337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 78/155] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:52 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:52.329304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556e0b-9c27-4114-9183-c3824af4141a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:52.330387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556e0b-9c27-4114-9183-c3824af4141a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:52.331355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556e0b-9c27-4114-9183-c3824af4141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:52.337549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf1778-11d3-4ca6-8cd8-79b0e07dd498 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:52.377259 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01b3ae-b968-4d96-8dd7-95f013e5dfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:52.382772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01b3ae-b968-4d96-8dd7-95f013e5dfbf None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:52.382772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01b3ae-b968-4d96-8dd7-95f013e5dfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:52.382772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01b3ae-b968-4d96-8dd7-95f013e5dfbf None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:52.382772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01b3ae-b968-4d96-8dd7-95f013e5dfbf None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:52.382772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01b3ae-b968-4d96-8dd7-95f013e5dfbf None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:52.383471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 78/156] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:52 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:52.394771 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01b3ae-b968-4d96-8dd7-95f013e5dfbf None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:52.408993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5b556e0b-9c27-4114-9183-c3824af4141a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:52.411931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5b556e0b-9c27-4114-9183-c3824af4141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:52.580693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:52.611730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01b3ae-b968-4d96-8dd7-95f013e5dfbf None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:52.625770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 79/157] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 19 20:52:52.628590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e266077-daf2-44e3-a3d6-cf6b1b70529c None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:52.629414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e266077-daf2-44e3-a3d6-cf6b1b70529c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:52.630421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e266077-daf2-44e3-a3d6-cf6b1b70529c None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:52.633708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 80/158] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:52.641187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be21d1-5e69-4f0c-a8b1-6cc0d8b34440 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:52.642096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be21d1-5e69-4f0c-a8b1-6cc0d8b34440 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:52.642901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be21d1-5e69-4f0c-a8b1-6cc0d8b34440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:52.696559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-81be21d1-5e69-4f0c-a8b1-6cc0d8b34440 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:52.699208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-81be21d1-5e69-4f0c-a8b1-6cc0d8b34440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:52.714772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178eea4f-17f2-4382-bae7-2053cb3fd7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:52.714772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178eea4f-17f2-4382-bae7-2053cb3fd7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:52.714772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178eea4f-17f2-4382-bae7-2053cb3fd7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:52.714772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178eea4f-17f2-4382-bae7-2053cb3fd7b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:52.715425 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178eea4f-17f2-4382-bae7-2053cb3fd7b1 None admin] RBAC: Adding query filter params (role.id=0fdbf18b17e545d9929e22ebddc1d5b7, scope.project.id=90fb40089787468fac42f2a8bafe87dc, user.id=15313602248c4227a5b0b9e1c4fdfeed) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:52.715425 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178eea4f-17f2-4382-bae7-2053cb3fd7b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:52.715670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178eea4f-17f2-4382-bae7-2053cb3fd7b1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:52.726692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 79/159] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:52:52 2022] GET /identity/v3/role_assignments?user.id=15313602248c4227a5b0b9e1c4fdfeed&scope.project.id=90fb40089787468fac42f2a8bafe87dc&role.id=0fdbf18b17e545d9929e22ebddc1d5b7 => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:52.781841 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:52.834153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 81/160] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:53.083831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ddd67-b342-4cc8-8618-3a34394350d9 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:53.084306 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ddd67-b342-4cc8-8618-3a34394350d9 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:53.084597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ddd67-b342-4cc8-8618-3a34394350d9 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:53.086107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 80/161] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:53.100463 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d91d-019b-431a-b297-bee0e0e03b25 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:53.100755 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d91d-019b-431a-b297-bee0e0e03b25 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:53.101035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d91d-019b-431a-b297-bee0e0e03b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:53.131755 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-3114d91d-019b-431a-b297-bee0e0e03b25 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:53.132968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3114d91d-019b-431a-b297-bee0e0e03b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:53.186200 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ddd67-b342-4cc8-8618-3a34394350d9 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:53.236275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 82/162] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:53.346153 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ddd67-b342-4cc8-8618-3a34394350d9 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:53.403472 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8b7c6-621e-4667-9c7b-321f1cc924b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:53.404680 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8b7c6-621e-4667-9c7b-321f1cc924b7 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:53.405058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8b7c6-621e-4667-9c7b-321f1cc924b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:53.405559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8b7c6-621e-4667-9c7b-321f1cc924b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:53.417478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8b7c6-621e-4667-9c7b-321f1cc924b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-5ca8b7c6-621e-4667-9c7b-321f1cc924b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:53.423513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:53.424382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:52:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 81/163] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:53.430705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d91d-019b-431a-b297-bee0e0e03b25 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:53.505369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8b7c6-621e-4667-9c7b-321f1cc924b7 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:53.553680 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:53.569360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d91d-019b-431a-b297-bee0e0e03b25 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:53.581810 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:53.619826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ae7e6-422e-4d86-be60-c0f6c1a7c41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:53.620618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ae7e6-422e-4d86-be60-c0f6c1a7c41f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:53.620907 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ae7e6-422e-4d86-be60-c0f6c1a7c41f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:53.621186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ae7e6-422e-4d86-be60-c0f6c1a7c41f None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:53.621941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ae7e6-422e-4d86-be60-c0f6c1a7c41f None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:53.622248 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ae7e6-422e-4d86-be60-c0f6c1a7c41f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:53.626588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ae7e6-422e-4d86-be60-c0f6c1a7c41f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:53.641225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 83/164] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:52:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:53.649775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ae7e6-422e-4d86-be60-c0f6c1a7c41f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:53.780830 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8b7c6-621e-4667-9c7b-321f1cc924b7 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:53.856992 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ae7e6-422e-4d86-be60-c0f6c1a7c41f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:53.863892 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ec6f7-788b-48a7-b193-c5818c39d4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:53.866218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ec6f7-788b-48a7-b193-c5818c39d4db None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:53.866839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ec6f7-788b-48a7-b193-c5818c39d4db None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:53.867382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ec6f7-788b-48a7-b193-c5818c39d4db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:53.896976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ec6f7-788b-48a7-b193-c5818c39d4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-593ec6f7-788b-48a7-b193-c5818c39d4db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:53.904835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:53.905881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:53.906858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:53.906858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:53.906858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:53.906858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:53.906858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:53.906858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:53.906858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:53.906858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:53.906858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:53.906858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:53.906858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:53.906858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:53.915385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 82/165] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:52:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:52:53.917049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ec6f7-788b-48a7-b193-c5818c39d4db None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:53.965075 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbbe89-9678-431d-aac5-47c1b8adf836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:53.965763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbbe89-9678-431d-aac5-47c1b8adf836 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:53.966051 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbbe89-9678-431d-aac5-47c1b8adf836 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:53.966334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbbe89-9678-431d-aac5-47c1b8adf836 None admin] PATH_INFO: `/v3/users/15313602248c4227a5b0b9e1c4fdfeed` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:53.970782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbbe89-9678-431d-aac5-47c1b8adf836 None admin] RBAC: Authorizing `identity:get_user(user_id=15313602248c4227a5b0b9e1c4fdfeed)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:53.970782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbbe89-9678-431d-aac5-47c1b8adf836 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:53.971546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 84/166] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:53 2022] GET /identity/v3/users/15313602248c4227a5b0b9e1c4fdfeed => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:53.972327 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbbe89-9678-431d-aac5-47c1b8adf836 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:54.070052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:54.124803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:54.191485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ec6f7-788b-48a7-b193-c5818c39d4db None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:54.269658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdc39d-33f7-48fc-b685-7457ab72acf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:54.270862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc39d-33f7-48fc-b685-7457ab72acf5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:54.271447 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc39d-33f7-48fc-b685-7457ab72acf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:54.272509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc39d-33f7-48fc-b685-7457ab72acf5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:54.302523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbbe89-9678-431d-aac5-47c1b8adf836 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:54.303337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdc39d-33f7-48fc-b685-7457ab72acf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-45cdc39d-33f7-48fc-b685-7457ab72acf5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:54.309715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:54.312090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 83/167] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:54.313637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdc39d-33f7-48fc-b685-7457ab72acf5 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:54.404798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f4284-0d09-42b1-9cbb-6fd61fef8371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:54.405350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f4284-0d09-42b1-9cbb-6fd61fef8371 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:54.405635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f4284-0d09-42b1-9cbb-6fd61fef8371 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:54.405920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f4284-0d09-42b1-9cbb-6fd61fef8371 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:54.406606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f4284-0d09-42b1-9cbb-6fd61fef8371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:54.407184 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f4284-0d09-42b1-9cbb-6fd61fef8371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:54.410223 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f4284-0d09-42b1-9cbb-6fd61fef8371 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:54.427156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 85/168] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:54.428173 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f4284-0d09-42b1-9cbb-6fd61fef8371 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:54.504009 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdc39d-33f7-48fc-b685-7457ab72acf5 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:54.544421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2a47e-39e8-48b4-9eab-bca759c3e07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:54.545977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a47e-39e8-48b4-9eab-bca759c3e07f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:54.546457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a47e-39e8-48b4-9eab-bca759c3e07f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:54.548711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a47e-39e8-48b4-9eab-bca759c3e07f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:54.557530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:54.693985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:54.700367 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f4284-0d09-42b1-9cbb-6fd61fef8371 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:54.738029 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b643647-9795-4a52-8c1b-8ec12a6077e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:54.738712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b643647-9795-4a52-8c1b-8ec12a6077e8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:54.739041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b643647-9795-4a52-8c1b-8ec12a6077e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:54.739321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b643647-9795-4a52-8c1b-8ec12a6077e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:54.742068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b643647-9795-4a52-8c1b-8ec12a6077e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:54.742068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b643647-9795-4a52-8c1b-8ec12a6077e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:54.742068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b643647-9795-4a52-8c1b-8ec12a6077e8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:54.751962 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 86/169] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:52:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:54.753048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b643647-9795-4a52-8c1b-8ec12a6077e8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:54.761159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2a47e-39e8-48b4-9eab-bca759c3e07f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:54.764208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2a47e-39e8-48b4-9eab-bca759c3e07f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:54.869591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b643647-9795-4a52-8c1b-8ec12a6077e8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:54.906633 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676d79-8020-42a8-8021-7eca2dad7c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:54.907319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676d79-8020-42a8-8021-7eca2dad7c07 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:54.907607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676d79-8020-42a8-8021-7eca2dad7c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:54.907882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676d79-8020-42a8-8021-7eca2dad7c07 None admin] PATH_INFO: `/v3/users/0e229cb6df1d467b90bf2948d7f02eb9` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:54.909228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676d79-8020-42a8-8021-7eca2dad7c07 None admin] RBAC: Authorizing `identity:get_user(user_id=0e229cb6df1d467b90bf2948d7f02eb9)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:54.910879 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676d79-8020-42a8-8021-7eca2dad7c07 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:54.912866 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 87/170] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:54 2022] GET /identity/v3/users/0e229cb6df1d467b90bf2948d7f02eb9 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:54.913688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676d79-8020-42a8-8021-7eca2dad7c07 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:54.971987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:55.082324 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676d79-8020-42a8-8021-7eca2dad7c07 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:55.121822 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4420e5c-ef3c-4467-a16c-efacd1ec8cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:55.122472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4420e5c-ef3c-4467-a16c-efacd1ec8cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:55.122781 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4420e5c-ef3c-4467-a16c-efacd1ec8cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:55.123632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4420e5c-ef3c-4467-a16c-efacd1ec8cc2 None admin] PATH_INFO: `/v3/users/15313602248c4227a5b0b9e1c4fdfeed` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:55.125095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4420e5c-ef3c-4467-a16c-efacd1ec8cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=15313602248c4227a5b0b9e1c4fdfeed)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:55.126571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4420e5c-ef3c-4467-a16c-efacd1ec8cc2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:55.128387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 88/171] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:54 2022] GET /identity/v3/users/15313602248c4227a5b0b9e1c4fdfeed => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:55.129109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4420e5c-ef3c-4467-a16c-efacd1ec8cc2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:55.133067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 84/172] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:52:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 823 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:52:55.142876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2a47e-39e8-48b4-9eab-bca759c3e07f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:55.270794 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4420e5c-ef3c-4467-a16c-efacd1ec8cc2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:55.292614 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:55.318996 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:55.343685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dc5e3-941f-40ba-add0-04e7077f79e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:55.344245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dc5e3-941f-40ba-add0-04e7077f79e1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:55.344542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dc5e3-941f-40ba-add0-04e7077f79e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:55.344829 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dc5e3-941f-40ba-add0-04e7077f79e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:55.424132 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dc5e3-941f-40ba-add0-04e7077f79e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:55.425643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dc5e3-941f-40ba-add0-04e7077f79e1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:55.527064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2a47e-39e8-48b4-9eab-bca759c3e07f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:55.531118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:55.540996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 89/173] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:52:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:52:55.541776 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dc5e3-941f-40ba-add0-04e7077f79e1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:55.572842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a905df-df5a-4f1d-8da5-ccfcf0729b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:55.573465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a905df-df5a-4f1d-8da5-ccfcf0729b76 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:55.573746 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a905df-df5a-4f1d-8da5-ccfcf0729b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:55.574020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a905df-df5a-4f1d-8da5-ccfcf0729b76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:55.652968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a905df-df5a-4f1d-8da5-ccfcf0729b76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:55.655706 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a905df-df5a-4f1d-8da5-ccfcf0729b76 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:55.659679 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dc5e3-941f-40ba-add0-04e7077f79e1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:55.696352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:55.700606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d55307-fad2-449d-9e9d-cdaf2c68d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:55.701990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55307-fad2-449d-9e9d-cdaf2c68d245 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:55.702283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55307-fad2-449d-9e9d-cdaf2c68d245 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:55.702560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55307-fad2-449d-9e9d-cdaf2c68d245 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:55.703947 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d55307-fad2-449d-9e9d-cdaf2c68d245 None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:55.706015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d55307-fad2-449d-9e9d-cdaf2c68d245 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:55.707745 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 90/174] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:55 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:55.709037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fbe02-e4ac-4941-8efd-5bb422618e46 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:55.709409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fbe02-e4ac-4941-8efd-5bb422618e46 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:55.709689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fbe02-e4ac-4941-8efd-5bb422618e46 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:55.710992 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 91/175] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:55.715393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161d17e-3154-4248-8c8d-c13b72574273 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:55.715393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161d17e-3154-4248-8c8d-c13b72574273 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:55.715393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161d17e-3154-4248-8c8d-c13b72574273 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:55.715393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 92/176] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:55.715393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161d17e-3154-4248-8c8d-c13b72574273 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:55.797374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 85/177] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:52:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 20:52:55.798970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b2b13-70e5-4561-8998-b27895a7b319 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:55.799105 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b2b13-70e5-4561-8998-b27895a7b319 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:55.799297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b2b13-70e5-4561-8998-b27895a7b319 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:55.800784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 86/178] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:55.802990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea0c52-ba42-4941-b320-220665f0b513 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:55.803369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea0c52-ba42-4941-b320-220665f0b513 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:55.803793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea0c52-ba42-4941-b320-220665f0b513 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:55.806302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 87/179] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:52:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:52:55.808448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea0c52-ba42-4941-b320-220665f0b513 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:55.814806 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:55.865081 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161d17e-3154-4248-8c8d-c13b72574273 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:55.909120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d484a68-59d2-4383-9d6b-b3b5c2f0de9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:55.909760 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d484a68-59d2-4383-9d6b-b3b5c2f0de9a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:55.910100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d484a68-59d2-4383-9d6b-b3b5c2f0de9a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:55.910480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d484a68-59d2-4383-9d6b-b3b5c2f0de9a None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:55.911858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d484a68-59d2-4383-9d6b-b3b5c2f0de9a None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:55.913553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d484a68-59d2-4383-9d6b-b3b5c2f0de9a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:55.915362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 93/180] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:55 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:55.916756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68e6ec-6f2f-499e-9387-6c553ad513e8 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:55.917171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68e6ec-6f2f-499e-9387-6c553ad513e8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:55.917573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68e6ec-6f2f-499e-9387-6c553ad513e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:55.940222 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea0c52-ba42-4941-b320-220665f0b513 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:55.942761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-0d68e6ec-6f2f-499e-9387-6c553ad513e8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:55.944421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0d68e6ec-6f2f-499e-9387-6c553ad513e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:55.991957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140852b-ec2a-4c0b-89c0-f6dfeb115ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:55.993007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140852b-ec2a-4c0b-89c0-f6dfeb115ceb None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:55.993494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140852b-ec2a-4c0b-89c0-f6dfeb115ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:55.993912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140852b-ec2a-4c0b-89c0-f6dfeb115ceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:55.994920 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140852b-ec2a-4c0b-89c0-f6dfeb115ceb None admin] RBAC: Adding query filter params (role.id=40d451ce7e0143e682ac5d43622c57d2, scope.project.id=90fb40089787468fac42f2a8bafe87dc, user.id=15313602248c4227a5b0b9e1c4fdfeed) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:55.995258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140852b-ec2a-4c0b-89c0-f6dfeb115ceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:55.996793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140852b-ec2a-4c0b-89c0-f6dfeb115ceb None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:56.000499 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:56.004869 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 88/181] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:52:55 2022] GET /identity/v3/role_assignments?user.id=15313602248c4227a5b0b9e1c4fdfeed&scope.project.id=90fb40089787468fac42f2a8bafe87dc&role.id=40d451ce7e0143e682ac5d43622c57d2 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:56.006238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e977d-617f-4c9e-8bb7-9f9ebe0736d0 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:56.006518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e977d-617f-4c9e-8bb7-9f9ebe0736d0 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:56.006824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e977d-617f-4c9e-8bb7-9f9ebe0736d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:56.030068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-932e977d-617f-4c9e-8bb7-9f9ebe0736d0 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:56.031721 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-932e977d-617f-4c9e-8bb7-9f9ebe0736d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:56.073833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 94/182] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:56.076494 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68e6ec-6f2f-499e-9387-6c553ad513e8 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:56.125154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 89/183] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:56.126781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a4e89-f71e-4359-aaf6-806f5af0d245 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:56.126940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a4e89-f71e-4359-aaf6-806f5af0d245 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:56.127177 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a4e89-f71e-4359-aaf6-806f5af0d245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:56.146504 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7d9a4e89-f71e-4359-aaf6-806f5af0d245 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:56.147855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7d9a4e89-f71e-4359-aaf6-806f5af0d245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:56.182828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:56.233933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 90/184] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:56.235651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0b933-060c-41cb-a088-c1713b0621c8 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:56.236010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0b933-060c-41cb-a088-c1713b0621c8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:56.236367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0b933-060c-41cb-a088-c1713b0621c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:56.258781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-f1a0b933-060c-41cb-a088-c1713b0621c8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:52:56.260099 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f1a0b933-060c-41cb-a088-c1713b0621c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:52:56.265846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68e6ec-6f2f-499e-9387-6c553ad513e8 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:56.329213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:56.343700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 91/185] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:52:56.344600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40629ad-cfd3-4e39-81d9-b4f77f8fb02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:56.344786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0b933-060c-41cb-a088-c1713b0621c8 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:56.346368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40629ad-cfd3-4e39-81d9-b4f77f8fb02f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:56.347414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40629ad-cfd3-4e39-81d9-b4f77f8fb02f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:56.348358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40629ad-cfd3-4e39-81d9-b4f77f8fb02f None admin] PATH_INFO: `/v3/projects/6ac1903a98024bf4bec75f4670abecd3` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:56.356577 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40629ad-cfd3-4e39-81d9-b4f77f8fb02f None admin] RBAC: Authorizing `identity:get_project(project_id=6ac1903a98024bf4bec75f4670abecd3)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:56.360852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40629ad-cfd3-4e39-81d9-b4f77f8fb02f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:56.365086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 95/186] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:56 2022] GET /identity/v3/projects/6ac1903a98024bf4bec75f4670abecd3 => generated 312 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:56.371945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40629ad-cfd3-4e39-81d9-b4f77f8fb02f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:56.467306 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0b933-060c-41cb-a088-c1713b0621c8 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:56.525513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2492a15-fd0c-4baa-b4fb-df0cfd2b9e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:56.526171 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2492a15-fd0c-4baa-b4fb-df0cfd2b9e38 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:56.526457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2492a15-fd0c-4baa-b4fb-df0cfd2b9e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:56.526759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2492a15-fd0c-4baa-b4fb-df0cfd2b9e38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:56.527513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2492a15-fd0c-4baa-b4fb-df0cfd2b9e38 None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=90fb40089787468fac42f2a8bafe87dc, user.id=0e229cb6df1d467b90bf2948d7f02eb9) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:56.527822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2492a15-fd0c-4baa-b4fb-df0cfd2b9e38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:56.530504 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2492a15-fd0c-4baa-b4fb-df0cfd2b9e38 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:56.540189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 92/187] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:52:56 2022] GET /identity/v3/role_assignments?user.id=0e229cb6df1d467b90bf2948d7f02eb9&scope.project.id=90fb40089787468fac42f2a8bafe87dc&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:56.540189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2492a15-fd0c-4baa-b4fb-df0cfd2b9e38 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:56.620592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40629ad-cfd3-4e39-81d9-b4f77f8fb02f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:56.654064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:56.676053 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:56.699347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44524591-843d-4ceb-b759-56b531c304ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:56.699980 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44524591-843d-4ceb-b759-56b531c304ad None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:56.700259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44524591-843d-4ceb-b759-56b531c304ad None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:56.700532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44524591-843d-4ceb-b759-56b531c304ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:56.708096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44524591-843d-4ceb-b759-56b531c304ad None admin] RBAC: Adding query filter params (role.id=40d451ce7e0143e682ac5d43622c57d2, scope.project.id=6ac1903a98024bf4bec75f4670abecd3, user.id=15313602248c4227a5b0b9e1c4fdfeed) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:56.708945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44524591-843d-4ceb-b759-56b531c304ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:56.709919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44524591-843d-4ceb-b759-56b531c304ad None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:56.721839 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 96/188] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:52:56 2022] GET /identity/v3/role_assignments?user.id=15313602248c4227a5b0b9e1c4fdfeed&scope.project.id=6ac1903a98024bf4bec75f4670abecd3&role.id=40d451ce7e0143e682ac5d43622c57d2 => generated 608 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:56.753754 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44524591-843d-4ceb-b759-56b531c304ad None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:56.759080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2492a15-fd0c-4baa-b4fb-df0cfd2b9e38 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:56.856512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b6df4-c9fe-4d38-95b7-7d9b54ea97f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:56.858370 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6df4-c9fe-4d38-95b7-7d9b54ea97f6 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:56.858685 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6df4-c9fe-4d38-95b7-7d9b54ea97f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:56.858989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6df4-c9fe-4d38-95b7-7d9b54ea97f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:56.877669 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b6df4-c9fe-4d38-95b7-7d9b54ea97f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-366b6df4-c9fe-4d38-95b7-7d9b54ea97f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:56.884449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:56.886031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 93/189] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:52:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:56.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b6df4-c9fe-4d38-95b7-7d9b54ea97f6 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:56.927605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44524591-843d-4ceb-b759-56b531c304ad None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:56.989311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b455e5-81aa-4f77-b7eb-c6ec4ac73011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:56.990332 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b455e5-81aa-4f77-b7eb-c6ec4ac73011 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:56.990792 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b455e5-81aa-4f77-b7eb-c6ec4ac73011 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:56.992068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b455e5-81aa-4f77-b7eb-c6ec4ac73011 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:56.993957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b455e5-81aa-4f77-b7eb-c6ec4ac73011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:56.996368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b455e5-81aa-4f77-b7eb-c6ec4ac73011 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:57.000604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 97/190] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:52:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:57.001910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b455e5-81aa-4f77-b7eb-c6ec4ac73011 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:57.046236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b6df4-c9fe-4d38-95b7-7d9b54ea97f6 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:57.060873 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:57.075860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:57.083530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df974c-102a-43df-9f2e-9df1ebaf9fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:57.084185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df974c-102a-43df-9f2e-9df1ebaf9fda None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:57.084472 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df974c-102a-43df-9f2e-9df1ebaf9fda None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:57.084752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df974c-102a-43df-9f2e-9df1ebaf9fda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:57.097031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df974c-102a-43df-9f2e-9df1ebaf9fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-f6df974c-102a-43df-9f2e-9df1ebaf9fda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:57.101922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:57.102924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 94/191] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:57.104342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df974c-102a-43df-9f2e-9df1ebaf9fda None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:57.137359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b455e5-81aa-4f77-b7eb-c6ec4ac73011 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:57.183330 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a596eb-11a9-46c4-ae5f-cf7bf84ae415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:57.184356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a596eb-11a9-46c4-ae5f-cf7bf84ae415 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:57.184761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a596eb-11a9-46c4-ae5f-cf7bf84ae415 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:57.185207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a596eb-11a9-46c4-ae5f-cf7bf84ae415 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:57.199500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a596eb-11a9-46c4-ae5f-cf7bf84ae415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-a3a596eb-11a9-46c4-ae5f-cf7bf84ae415 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:52:57.205919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:52:57.208295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 98/192] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:52:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:52:57.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a596eb-11a9-46c4-ae5f-cf7bf84ae415 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:57.245421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df974c-102a-43df-9f2e-9df1ebaf9fda None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:57.299551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a5595-c452-44f1-b1ba-883c1b815a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:57.300505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a5595-c452-44f1-b1ba-883c1b815a43 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:57.300847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a5595-c452-44f1-b1ba-883c1b815a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:57.301269 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a5595-c452-44f1-b1ba-883c1b815a43 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:57.302067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a5595-c452-44f1-b1ba-883c1b815a43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:57.302445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a5595-c452-44f1-b1ba-883c1b815a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:57.304359 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a5595-c452-44f1-b1ba-883c1b815a43 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:57.314778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 95/193] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:52:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:57.315638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a5595-c452-44f1-b1ba-883c1b815a43 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:57.348817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a596eb-11a9-46c4-ae5f-cf7bf84ae415 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:57.355700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:57.372321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:57.393756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e320a-85fa-4f85-ba5c-6ed147269960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:57.394501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e320a-85fa-4f85-ba5c-6ed147269960 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:57.394932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e320a-85fa-4f85-ba5c-6ed147269960 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:57.395307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e320a-85fa-4f85-ba5c-6ed147269960 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:57.396073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e320a-85fa-4f85-ba5c-6ed147269960 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:57.397993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e320a-85fa-4f85-ba5c-6ed147269960 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:57.423484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 99/194] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:52:57 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:52:57.424539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e320a-85fa-4f85-ba5c-6ed147269960 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:57.439701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a5595-c452-44f1-b1ba-883c1b815a43 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:57.487965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfef7c0-fa49-4cb2-98f6-a540c2131293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:57.488606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfef7c0-fa49-4cb2-98f6-a540c2131293 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:57.488893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfef7c0-fa49-4cb2-98f6-a540c2131293 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:57.489174 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfef7c0-fa49-4cb2-98f6-a540c2131293 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:57.489913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfef7c0-fa49-4cb2-98f6-a540c2131293 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:57.490220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfef7c0-fa49-4cb2-98f6-a540c2131293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:57.491881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfef7c0-fa49-4cb2-98f6-a540c2131293 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:57.504983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 96/195] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:52:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:57.505694 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfef7c0-fa49-4cb2-98f6-a540c2131293 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:57.581109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e320a-85fa-4f85-ba5c-6ed147269960 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:57.641433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91e67c-80cd-4079-af5c-d8dac9a6f569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:57.642458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91e67c-80cd-4079-af5c-d8dac9a6f569 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:57.643074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91e67c-80cd-4079-af5c-d8dac9a6f569 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:57.643544 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91e67c-80cd-4079-af5c-d8dac9a6f569 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:57.644761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91e67c-80cd-4079-af5c-d8dac9a6f569 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:57.645271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91e67c-80cd-4079-af5c-d8dac9a6f569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:57.647764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91e67c-80cd-4079-af5c-d8dac9a6f569 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:57.659507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:57.667831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfef7c0-fa49-4cb2-98f6-a540c2131293 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:57.671271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 100/196] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:52:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:57.672682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91e67c-80cd-4079-af5c-d8dac9a6f569 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:57.738789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8551ec-4ca6-4855-ae4f-afb1b7537333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:57.740726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8551ec-4ca6-4855-ae4f-afb1b7537333 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:57.740726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8551ec-4ca6-4855-ae4f-afb1b7537333 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:57.740726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8551ec-4ca6-4855-ae4f-afb1b7537333 None admin] PATH_INFO: `/v3/users/f3d313994aa04528a6c4044c5c0cd637` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:57.744944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:57.773149 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8551ec-4ca6-4855-ae4f-afb1b7537333 None admin] RBAC: Authorizing `identity:get_user(user_id=f3d313994aa04528a6c4044c5c0cd637)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:57.775275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8551ec-4ca6-4855-ae4f-afb1b7537333 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:57.778368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 97/197] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:57 2022] GET /identity/v3/users/f3d313994aa04528a6c4044c5c0cd637 => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:57.780290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8551ec-4ca6-4855-ae4f-afb1b7537333 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:57.891195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91e67c-80cd-4079-af5c-d8dac9a6f569 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:57.953487 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322b24c-3e55-4664-affa-c6fb4507baee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:57.954579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322b24c-3e55-4664-affa-c6fb4507baee None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:57.955096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322b24c-3e55-4664-affa-c6fb4507baee None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:57.955575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322b24c-3e55-4664-affa-c6fb4507baee None admin] PATH_INFO: `/v3/users/3377ad62948c4172a41f20cabc26f26f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:57.957969 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322b24c-3e55-4664-affa-c6fb4507baee None admin] RBAC: Authorizing `identity:get_user(user_id=3377ad62948c4172a41f20cabc26f26f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:57.960440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8551ec-4ca6-4855-ae4f-afb1b7537333 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:57.960767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322b24c-3e55-4664-affa-c6fb4507baee None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:57.964124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 101/198] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:57 2022] GET /identity/v3/users/3377ad62948c4172a41f20cabc26f26f => generated 289 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:57.965497 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322b24c-3e55-4664-affa-c6fb4507baee None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:58.024484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927d98a-ee00-4758-b5c3-7549ea524149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:58.026069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927d98a-ee00-4758-b5c3-7549ea524149 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:58.026841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927d98a-ee00-4758-b5c3-7549ea524149 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:58.027575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927d98a-ee00-4758-b5c3-7549ea524149 None admin] PATH_INFO: `/v3/users/f3d313994aa04528a6c4044c5c0cd637` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:58.030256 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927d98a-ee00-4758-b5c3-7549ea524149 None admin] RBAC: Authorizing `identity:get_user(user_id=f3d313994aa04528a6c4044c5c0cd637)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:58.033617 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927d98a-ee00-4758-b5c3-7549ea524149 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:58.037017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 98/199] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:52:57 2022] GET /identity/v3/users/f3d313994aa04528a6c4044c5c0cd637 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:58.038910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927d98a-ee00-4758-b5c3-7549ea524149 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:58.094116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:58.171644 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322b24c-3e55-4664-affa-c6fb4507baee None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:58.186629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:58.240358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b606fc-6313-4534-8eb2-86b634d2d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:58.241445 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b606fc-6313-4534-8eb2-86b634d2d73c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:58.241921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b606fc-6313-4534-8eb2-86b634d2d73c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:58.242623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b606fc-6313-4534-8eb2-86b634d2d73c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:58.258903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927d98a-ee00-4758-b5c3-7549ea524149 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:58.320829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d787ea4-e8ec-4658-b4c0-173f65a95ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:58.321396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d787ea4-e8ec-4658-b4c0-173f65a95ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:58.321690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d787ea4-e8ec-4658-b4c0-173f65a95ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:58.321970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d787ea4-e8ec-4658-b4c0-173f65a95ef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:58.373625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b606fc-6313-4534-8eb2-86b634d2d73c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:58.376321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b606fc-6313-4534-8eb2-86b634d2d73c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:58.403192 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d787ea4-e8ec-4658-b4c0-173f65a95ef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:58.405297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d787ea4-e8ec-4658-b4c0-173f65a95ef7 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:58.434135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:58.557321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 102/200] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:52:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:52:58.558838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b606fc-6313-4534-8eb2-86b634d2d73c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:58.559212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 99/201] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:52:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:52:58.564767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d787ea4-e8ec-4658-b4c0-173f65a95ef7 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:58.565213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:58.710999 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b606fc-6313-4534-8eb2-86b634d2d73c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:58.751405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d787ea4-e8ec-4658-b4c0-173f65a95ef7 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:58.769380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6ae52-eccc-4d88-88d0-17e37cf9a95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:58.770776 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6ae52-eccc-4d88-88d0-17e37cf9a95f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:58.770999 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6ae52-eccc-4d88-88d0-17e37cf9a95f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:58.771466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6ae52-eccc-4d88-88d0-17e37cf9a95f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:58.793095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:58.811462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bb626-56f0-460d-af80-34f6931bc79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:58.812643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bb626-56f0-460d-af80-34f6931bc79b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:58.813142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bb626-56f0-460d-af80-34f6931bc79b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:58.813653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bb626-56f0-460d-af80-34f6931bc79b None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:58.815170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bb626-56f0-460d-af80-34f6931bc79b None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:58.818027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bb626-56f0-460d-af80-34f6931bc79b None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:58.820786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 100/202] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:58 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:52:58.822491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bb626-56f0-460d-af80-34f6931bc79b None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:58.902353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6ae52-eccc-4d88-88d0-17e37cf9a95f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:58.906276 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6ae52-eccc-4d88-88d0-17e37cf9a95f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:58.912427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:58.955822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bb626-56f0-460d-af80-34f6931bc79b None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:59.006116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d202-b897-4a2d-ba61-0bc8d3d46688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:59.007458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d202-b897-4a2d-ba61-0bc8d3d46688 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:59.007949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d202-b897-4a2d-ba61-0bc8d3d46688 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:59.008465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d202-b897-4a2d-ba61-0bc8d3d46688 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:59.010579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5d202-b897-4a2d-ba61-0bc8d3d46688 None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:59.012585 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5d202-b897-4a2d-ba61-0bc8d3d46688 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:59.020923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 101/203] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:58 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:59.020923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d202-b897-4a2d-ba61-0bc8d3d46688 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:59.074078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 103/204] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:52:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:52:59.080582 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6ae52-eccc-4d88-88d0-17e37cf9a95f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:59.102678 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:59.155377 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d202-b897-4a2d-ba61-0bc8d3d46688 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:59.214400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db437311-abfe-46b3-8506-1f647a2ebb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:59.215285 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db437311-abfe-46b3-8506-1f647a2ebb81 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:59.215647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db437311-abfe-46b3-8506-1f647a2ebb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:59.215990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db437311-abfe-46b3-8506-1f647a2ebb81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:59.217638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db437311-abfe-46b3-8506-1f647a2ebb81 None admin] RBAC: Adding query filter params (role.id=b1ad7360ee8a4c03bc87e2f9121a7d65, scope.project.id=90fb40089787468fac42f2a8bafe87dc, user.id=3377ad62948c4172a41f20cabc26f26f) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:59.218103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db437311-abfe-46b3-8506-1f647a2ebb81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:59.220112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db437311-abfe-46b3-8506-1f647a2ebb81 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:59.227265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 102/205] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:52:59 2022] GET /identity/v3/role_assignments?user.id=3377ad62948c4172a41f20cabc26f26f&scope.project.id=90fb40089787468fac42f2a8bafe87dc&role.id=b1ad7360ee8a4c03bc87e2f9121a7d65 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:59.228223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db437311-abfe-46b3-8506-1f647a2ebb81 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:59.266554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6ae52-eccc-4d88-88d0-17e37cf9a95f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:59.270462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:59.329260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d3e98-f5ed-4caa-ab5d-f725b5776fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:59.330258 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d3e98-f5ed-4caa-ab5d-f725b5776fac None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:59.330804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d3e98-f5ed-4caa-ab5d-f725b5776fac None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:59.331277 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d3e98-f5ed-4caa-ab5d-f725b5776fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:59.332723 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d3e98-f5ed-4caa-ab5d-f725b5776fac None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=9be09a7606624a74a92f8c33c2919615, user.id=f3d313994aa04528a6c4044c5c0cd637) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:59.335154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d3e98-f5ed-4caa-ab5d-f725b5776fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:59.337015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d3e98-f5ed-4caa-ab5d-f725b5776fac None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:59.357211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 104/206] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:52:59 2022] GET /identity/v3/role_assignments?user.id=f3d313994aa04528a6c4044c5c0cd637&scope.project.id=9be09a7606624a74a92f8c33c2919615&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:59.421271 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db437311-abfe-46b3-8506-1f647a2ebb81 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:59.449554 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:52:59.468263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc1245-af35-45f1-b7cd-96bbdbf8fc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:59.469048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc1245-af35-45f1-b7cd-96bbdbf8fc49 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:59.469866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc1245-af35-45f1-b7cd-96bbdbf8fc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:59.470713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc1245-af35-45f1-b7cd-96bbdbf8fc49 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:59.473275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc1245-af35-45f1-b7cd-96bbdbf8fc49 None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:59.475950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc1245-af35-45f1-b7cd-96bbdbf8fc49 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:59.478932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 103/207] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:52:59 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:52:59.485803 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d3e98-f5ed-4caa-ab5d-f725b5776fac None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:52:59.631083 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d3e98-f5ed-4caa-ab5d-f725b5776fac None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:52:59.687711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b998d-2e73-4f9e-a96f-a37064f80276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:52:59.688718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b998d-2e73-4f9e-a96f-a37064f80276 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:52:59.689200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b998d-2e73-4f9e-a96f-a37064f80276 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:52:59.689680 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b998d-2e73-4f9e-a96f-a37064f80276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:52:59.691082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b998d-2e73-4f9e-a96f-a37064f80276 None admin] RBAC: Adding query filter params (role.id=0fdbf18b17e545d9929e22ebddc1d5b7, scope.project.id=9be09a7606624a74a92f8c33c2919615, user.id=f3d313994aa04528a6c4044c5c0cd637) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:52:59.691624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b998d-2e73-4f9e-a96f-a37064f80276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:52:59.694229 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b998d-2e73-4f9e-a96f-a37064f80276 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:52:59.703472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 105/208] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:52:59 2022] GET /identity/v3/role_assignments?user.id=f3d313994aa04528a6c4044c5c0cd637&scope.project.id=9be09a7606624a74a92f8c33c2919615&role.id=0fdbf18b17e545d9929e22ebddc1d5b7 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:00.269966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd96a-863d-47a6-8425-ce41d6f63086 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:00.270264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd96a-863d-47a6-8425-ce41d6f63086 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:00.270643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd96a-863d-47a6-8425-ce41d6f63086 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:00.272021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 104/209] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:00.281166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5bfa2-8351-44c5-9b74-e4345b537cbf None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:00.281938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5bfa2-8351-44c5-9b74-e4345b537cbf None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:00.281938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5bfa2-8351-44c5-9b74-e4345b537cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:00.303030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-07c5bfa2-8351-44c5-9b74-e4345b537cbf None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:00.304269 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-07c5bfa2-8351-44c5-9b74-e4345b537cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:00.334103 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:00.385436 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 106/210] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:00.553735 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b48f54-92a5-4132-aafa-408a2850ee57 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:00.554539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b48f54-92a5-4132-aafa-408a2850ee57 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:00.554539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b48f54-92a5-4132-aafa-408a2850ee57 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:00.555559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 105/211] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:00.568939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ce476-316f-4b42-a339-9d73dc2f083c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:00.569326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ce476-316f-4b42-a339-9d73dc2f083c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:00.569509 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ce476-316f-4b42-a339-9d73dc2f083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:00.598061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-964ce476-316f-4b42-a339-9d73dc2f083c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:00.599299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-964ce476-316f-4b42-a339-9d73dc2f083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:00.733270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 107/212] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:00.805453 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b48f54-92a5-4132-aafa-408a2850ee57 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:00.925896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b48f54-92a5-4132-aafa-408a2850ee57 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:00.962140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a4711-d92f-427f-8e77-43d2713ee6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:00.962832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a4711-d92f-427f-8e77-43d2713ee6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:00.963295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a4711-d92f-427f-8e77-43d2713ee6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:00.963579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a4711-d92f-427f-8e77-43d2713ee6c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:00.964757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a4711-d92f-427f-8e77-43d2713ee6c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:00.966213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a4711-d92f-427f-8e77-43d2713ee6c5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:00.968100 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 106/213] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:00.973490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ce476-316f-4b42-a339-9d73dc2f083c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:01.079042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:01.088962 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ce476-316f-4b42-a339-9d73dc2f083c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:01.100903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a4711-d92f-427f-8e77-43d2713ee6c5 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:01.140151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe918e9d-8bb0-4e32-8be6-ce0c91644b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:01.140812 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe918e9d-8bb0-4e32-8be6-ce0c91644b85 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:01.141101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe918e9d-8bb0-4e32-8be6-ce0c91644b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:01.141371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe918e9d-8bb0-4e32-8be6-ce0c91644b85 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:01.142062 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe918e9d-8bb0-4e32-8be6-ce0c91644b85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:01.143898 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe918e9d-8bb0-4e32-8be6-ce0c91644b85 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:01.184914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 108/214] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:53:00 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:53:01.267667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:01.316909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a4711-d92f-427f-8e77-43d2713ee6c5 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:01.356020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46cdfc-1f52-4d17-b11e-9cd138c23227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:01.357061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46cdfc-1f52-4d17-b11e-9cd138c23227 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:01.357563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46cdfc-1f52-4d17-b11e-9cd138c23227 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:01.358080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46cdfc-1f52-4d17-b11e-9cd138c23227 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:01.370241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46cdfc-1f52-4d17-b11e-9cd138c23227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-4c46cdfc-1f52-4d17-b11e-9cd138c23227 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:01.377421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:01.378357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:01.379205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:01.379205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:01.379205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:01.379205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:01.379205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:01.379205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:01.379205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:01.379205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:01.379205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:01.379205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:01.379205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:01.379205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:01.382241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 107/215] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:53:01.386511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe918e9d-8bb0-4e32-8be6-ce0c91644b85 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:01.570022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe918e9d-8bb0-4e32-8be6-ce0c91644b85 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:01.632919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b14973-db4c-4276-98fd-a42612c065c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:01.634317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b14973-db4c-4276-98fd-a42612c065c1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:01.635064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b14973-db4c-4276-98fd-a42612c065c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:01.635869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b14973-db4c-4276-98fd-a42612c065c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:01.637272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b14973-db4c-4276-98fd-a42612c065c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:01.638045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b14973-db4c-4276-98fd-a42612c065c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:01.641356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b14973-db4c-4276-98fd-a42612c065c1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:01.658702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 109/216] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:01.658959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51ecf-fa48-4baa-ab06-fbd0ecc5c6b3 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:01.659651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51ecf-fa48-4baa-ab06-fbd0ecc5c6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:01.659958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51ecf-fa48-4baa-ab06-fbd0ecc5c6b3 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:01.663844 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 108/217] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:01.668232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b14973-db4c-4276-98fd-a42612c065c1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:01.670595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092da5a4-0f17-4b40-b4ad-be5fc36149d8 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:01.671027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092da5a4-0f17-4b40-b4ad-be5fc36149d8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:01.671312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092da5a4-0f17-4b40-b4ad-be5fc36149d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:01.686550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:01.695758 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-092da5a4-0f17-4b40-b4ad-be5fc36149d8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:01.697011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-092da5a4-0f17-4b40-b4ad-be5fc36149d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:01.801981 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 109/218] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:01.815519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b14973-db4c-4276-98fd-a42612c065c1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:01.852977 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c30526-e22e-47ec-9f0b-6dd756dcf9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:01.853627 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c30526-e22e-47ec-9f0b-6dd756dcf9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:01.853906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c30526-e22e-47ec-9f0b-6dd756dcf9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:01.854181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c30526-e22e-47ec-9f0b-6dd756dcf9f2 None admin] PATH_INFO: `/v3/users/9258fab6e5b141c587821f9b7b6b554c` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:01.870175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c30526-e22e-47ec-9f0b-6dd756dcf9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=9258fab6e5b141c587821f9b7b6b554c)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:01.871695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c30526-e22e-47ec-9f0b-6dd756dcf9f2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:01.874969 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 110/219] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:01 2022] GET /identity/v3/users/9258fab6e5b141c587821f9b7b6b554c => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:01.880834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092da5a4-0f17-4b40-b4ad-be5fc36149d8 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:01.964025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:02.019235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092da5a4-0f17-4b40-b4ad-be5fc36149d8 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:02.086799 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76b97d-8d05-465e-8bc0-d7d7fd27c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:02.087777 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76b97d-8d05-465e-8bc0-d7d7fd27c9ec None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:02.088260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76b97d-8d05-465e-8bc0-d7d7fd27c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:02.088738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76b97d-8d05-465e-8bc0-d7d7fd27c9ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:02.205874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c30526-e22e-47ec-9f0b-6dd756dcf9f2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:02.236457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76b97d-8d05-465e-8bc0-d7d7fd27c9ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:02.238298 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76b97d-8d05-465e-8bc0-d7d7fd27c9ec None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:02.288614 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:02.329471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c30526-e22e-47ec-9f0b-6dd756dcf9f2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:02.350536 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:02.371386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3be95-d9df-44e0-a109-9dfdea5742c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:02.372412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3be95-d9df-44e0-a109-9dfdea5742c2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:02.373531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3be95-d9df-44e0-a109-9dfdea5742c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:02.374279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3be95-d9df-44e0-a109-9dfdea5742c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:02.395255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3be95-d9df-44e0-a109-9dfdea5742c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-e4b3be95-d9df-44e0-a109-9dfdea5742c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:02.406698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:02.407668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:02.408505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:02.408505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:02.408505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:02.408505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:02.408505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:02.408505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:02.408505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:02.408505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:02.408505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:02.408505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:02.408505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:53:02.408505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:02.411159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 111/220] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:53:02.421249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3be95-d9df-44e0-a109-9dfdea5742c2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:02.469735 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 110/221] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 20:53:02.475225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76b97d-8d05-465e-8bc0-d7d7fd27c9ec None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:02.539308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3be95-d9df-44e0-a109-9dfdea5742c2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:02.571165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:02.579707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa0d11-840d-403a-8408-5f5e2121e300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:02.580713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa0d11-840d-403a-8408-5f5e2121e300 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:02.581211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa0d11-840d-403a-8408-5f5e2121e300 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:02.581890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa0d11-840d-403a-8408-5f5e2121e300 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:02.582868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa0d11-840d-403a-8408-5f5e2121e300 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:02.583430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa0d11-840d-403a-8408-5f5e2121e300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:02.585152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa0d11-840d-403a-8408-5f5e2121e300 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:02.596466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 112/222] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:02.609308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa0d11-840d-403a-8408-5f5e2121e300 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:02.740494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76b97d-8d05-465e-8bc0-d7d7fd27c9ec None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:02.757867 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa0d11-840d-403a-8408-5f5e2121e300 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:02.783694 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047ff65-a3e0-40c4-84b4-2ea07bd35b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:02.784754 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047ff65-a3e0-40c4-84b4-2ea07bd35b29 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:02.785036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047ff65-a3e0-40c4-84b4-2ea07bd35b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:02.785307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047ff65-a3e0-40c4-84b4-2ea07bd35b29 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:02.786481 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047ff65-a3e0-40c4-84b4-2ea07bd35b29 None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:02.787979 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047ff65-a3e0-40c4-84b4-2ea07bd35b29 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:02.790832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 111/223] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:02 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:02.792017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eeb68-11b5-479e-9ecb-efdc93877f98 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:02.792301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eeb68-11b5-479e-9ecb-efdc93877f98 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:02.792577 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eeb68-11b5-479e-9ecb-efdc93877f98 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:02.798058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 112/224] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:02.798969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321eeb68-11b5-479e-9ecb-efdc93877f98 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:02.813708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619c910-e46e-4648-9fc4-a5b20090b226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:02.814391 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619c910-e46e-4648-9fc4-a5b20090b226 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:02.814780 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619c910-e46e-4648-9fc4-a5b20090b226 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:02.815078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619c910-e46e-4648-9fc4-a5b20090b226 None admin] PATH_INFO: `/v3/users/f3d313994aa04528a6c4044c5c0cd637` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:02.816327 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619c910-e46e-4648-9fc4-a5b20090b226 None admin] RBAC: Authorizing `identity:get_user(user_id=f3d313994aa04528a6c4044c5c0cd637)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:02.817878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619c910-e46e-4648-9fc4-a5b20090b226 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:02.819683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 113/225] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:02 2022] GET /identity/v3/users/f3d313994aa04528a6c4044c5c0cd637 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:02.820990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b313e61-2e68-4f96-8051-76585b077804 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:02.821277 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b313e61-2e68-4f96-8051-76585b077804 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:02.821554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b313e61-2e68-4f96-8051-76585b077804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:02.825261 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:02.843151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4b313e61-2e68-4f96-8051-76585b077804 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:02.844441 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4b313e61-2e68-4f96-8051-76585b077804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:02.927988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321eeb68-11b5-479e-9ecb-efdc93877f98 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:02.930489 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:02.950545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 114/226] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:02.956068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b313e61-2e68-4f96-8051-76585b077804 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:03.022851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27efbcd9-9f4b-42f7-99ff-19557a08c282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:03.024462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efbcd9-9f4b-42f7-99ff-19557a08c282 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:03.024948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efbcd9-9f4b-42f7-99ff-19557a08c282 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:03.025401 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efbcd9-9f4b-42f7-99ff-19557a08c282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:03.026712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27efbcd9-9f4b-42f7-99ff-19557a08c282 None admin] RBAC: Adding query filter params (role.id=40d451ce7e0143e682ac5d43622c57d2, scope.project.id=9be09a7606624a74a92f8c33c2919615, user.id=9258fab6e5b141c587821f9b7b6b554c) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:03.027206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27efbcd9-9f4b-42f7-99ff-19557a08c282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:03.030255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27efbcd9-9f4b-42f7-99ff-19557a08c282 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:03.041948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 113/227] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:53:02 2022] GET /identity/v3/role_assignments?user.id=9258fab6e5b141c587821f9b7b6b554c&scope.project.id=9be09a7606624a74a92f8c33c2919615&role.id=40d451ce7e0143e682ac5d43622c57d2 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:03.167009 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b313e61-2e68-4f96-8051-76585b077804 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:03.217876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e3613-0bec-4929-9a62-1c2f0f58060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:03.218539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e3613-0bec-4929-9a62-1c2f0f58060c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:03.218847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e3613-0bec-4929-9a62-1c2f0f58060c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:03.219120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e3613-0bec-4929-9a62-1c2f0f58060c None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:03.220339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e3613-0bec-4929-9a62-1c2f0f58060c None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:03.221794 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e3613-0bec-4929-9a62-1c2f0f58060c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:03.223662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 115/228] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:02 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:03.229821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27efbcd9-9f4b-42f7-99ff-19557a08c282 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:03.276643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e3613-0bec-4929-9a62-1c2f0f58060c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:03.397232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:03.404821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:03.449180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27efbcd9-9f4b-42f7-99ff-19557a08c282 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:03.492964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e3613-0bec-4929-9a62-1c2f0f58060c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:03.501743 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b938ea7-7b28-478b-acd7-971eac3e34d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:03.502956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b938ea7-7b28-478b-acd7-971eac3e34d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:03.503444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b938ea7-7b28-478b-acd7-971eac3e34d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:03.503972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b938ea7-7b28-478b-acd7-971eac3e34d2 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615/users/f3d313994aa04528a6c4044c5c0cd637/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:03.506546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b938ea7-7b28-478b-acd7-971eac3e34d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be09a7606624a74a92f8c33c2919615, user_id=f3d313994aa04528a6c4044c5c0cd637, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:03.508384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b938ea7-7b28-478b-acd7-971eac3e34d2 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:03.533410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 114/229] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:53:03 2022] PUT /identity/v3/projects/9be09a7606624a74a92f8c33c2919615/users/f3d313994aa04528a6c4044c5c0cd637/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:53:03.555264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48314de-cb22-4ffe-91f7-2312c6ee3aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:03.556360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48314de-cb22-4ffe-91f7-2312c6ee3aca None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:03.556988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48314de-cb22-4ffe-91f7-2312c6ee3aca None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:03.557530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48314de-cb22-4ffe-91f7-2312c6ee3aca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:03.577003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48314de-cb22-4ffe-91f7-2312c6ee3aca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-b48314de-cb22-4ffe-91f7-2312c6ee3aca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:03.582659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:03.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:03.584504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:03.584504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:03.584504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:03.584504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:03.584504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:03.584504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:03.584504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:03.584504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:03.584504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:03.584504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:03.584504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:03.584504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:03.587140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 116/230] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:53:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:03.593514 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b938ea7-7b28-478b-acd7-971eac3e34d2 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:03.718255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b938ea7-7b28-478b-acd7-971eac3e34d2 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:03.762959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee076d2-eda0-4780-8aa2-368b9d6432a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:03.764281 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee076d2-eda0-4780-8aa2-368b9d6432a3 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:03.764735 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee076d2-eda0-4780-8aa2-368b9d6432a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:03.765247 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee076d2-eda0-4780-8aa2-368b9d6432a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:03.766097 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee076d2-eda0-4780-8aa2-368b9d6432a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:03.766530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee076d2-eda0-4780-8aa2-368b9d6432a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:03.768241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee076d2-eda0-4780-8aa2-368b9d6432a3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:03.778260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 115/231] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:03.784900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48314de-cb22-4ffe-91f7-2312c6ee3aca None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:03.917944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48314de-cb22-4ffe-91f7-2312c6ee3aca None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:03.936872 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:03.958401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a681df-f619-4b2d-b057-fa34bacc12bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:03.959126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a681df-f619-4b2d-b057-fa34bacc12bf None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:03.959409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a681df-f619-4b2d-b057-fa34bacc12bf None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:03.959686 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a681df-f619-4b2d-b057-fa34bacc12bf None admin] PATH_INFO: `/v3/users/f3d313994aa04528a6c4044c5c0cd637` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:03.960967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a681df-f619-4b2d-b057-fa34bacc12bf None admin] RBAC: Authorizing `identity:get_user(user_id=f3d313994aa04528a6c4044c5c0cd637)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:03.962537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a681df-f619-4b2d-b057-fa34bacc12bf None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:03.964649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 117/232] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:03 2022] GET /identity/v3/users/f3d313994aa04528a6c4044c5c0cd637 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:03.970375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee076d2-eda0-4780-8aa2-368b9d6432a3 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:03.974490 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:04.065606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50203c2-59e3-4ac2-8d90-07f4d8097c29 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:04.065606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50203c2-59e3-4ac2-8d90-07f4d8097c29 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:04.065606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50203c2-59e3-4ac2-8d90-07f4d8097c29 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:04.067353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 118/233] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:53:04.073146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f0ae-8df2-4b69-8642-5bff310db12f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:04.073660 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f0ae-8df2-4b69-8642-5bff310db12f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:04.074147 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f0ae-8df2-4b69-8642-5bff310db12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:04.098960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee076d2-eda0-4780-8aa2-368b9d6432a3 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:04.124566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4501f0ae-8df2-4b69-8642-5bff310db12f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:04.126220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4501f0ae-8df2-4b69-8642-5bff310db12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:04.140541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18e4bc-e0f9-45d2-8081-2dada108b2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:04.141204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e4bc-e0f9-45d2-8081-2dada108b2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:04.141502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e4bc-e0f9-45d2-8081-2dada108b2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:04.141765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e4bc-e0f9-45d2-8081-2dada108b2b0 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:04.143028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18e4bc-e0f9-45d2-8081-2dada108b2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:04.144586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18e4bc-e0f9-45d2-8081-2dada108b2b0 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:04.146348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 116/234] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:03 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:04.152404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18e4bc-e0f9-45d2-8081-2dada108b2b0 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:04.236170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:04.273187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18e4bc-e0f9-45d2-8081-2dada108b2b0 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:04.313797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129c0c7-92e8-4435-a4f2-c25b38a4a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:04.314481 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129c0c7-92e8-4435-a4f2-c25b38a4a1a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:04.314796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129c0c7-92e8-4435-a4f2-c25b38a4a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:04.315081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129c0c7-92e8-4435-a4f2-c25b38a4a1a3 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615/users/f3d313994aa04528a6c4044c5c0cd637/roles/0fdbf18b17e545d9929e22ebddc1d5b7` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:04.317486 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129c0c7-92e8-4435-a4f2-c25b38a4a1a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be09a7606624a74a92f8c33c2919615, user_id=f3d313994aa04528a6c4044c5c0cd637, role_id=0fdbf18b17e545d9929e22ebddc1d5b7)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:04.319006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129c0c7-92e8-4435-a4f2-c25b38a4a1a3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:04.336713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 119/235] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:04.336903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 117/236] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:53:04 2022] PUT /identity/v3/projects/9be09a7606624a74a92f8c33c2919615/users/f3d313994aa04528a6c4044c5c0cd637/roles/0fdbf18b17e545d9929e22ebddc1d5b7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 20:53:04.380129 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85dfff-3720-4869-84e0-c981ac50d910 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:04.380438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85dfff-3720-4869-84e0-c981ac50d910 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:04.380690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85dfff-3720-4869-84e0-c981ac50d910 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:04.382125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 118/237] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:04.402663 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2e632-47f2-4887-be38-f59ede2ef808 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:04.403773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2e632-47f2-4887-be38-f59ede2ef808 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:04.405157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2e632-47f2-4887-be38-f59ede2ef808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:04.430974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-26b2e632-47f2-4887-be38-f59ede2ef808 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:04.432611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-26b2e632-47f2-4887-be38-f59ede2ef808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:04.536597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 120/238] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:04.683855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85dfff-3720-4869-84e0-c981ac50d910 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:04.810793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85dfff-3720-4869-84e0-c981ac50d910 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:04.848864 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:04.854514 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a45c0-e317-4b41-aa65-a98686f4857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:04.855314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a45c0-e317-4b41-aa65-a98686f4857d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:04.855614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a45c0-e317-4b41-aa65-a98686f4857d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:04.856021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a45c0-e317-4b41-aa65-a98686f4857d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:04.864077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2e632-47f2-4887-be38-f59ede2ef808 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:04.870277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a45c0-e317-4b41-aa65-a98686f4857d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-b48a45c0-e317-4b41-aa65-a98686f4857d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:04.875549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:04.876687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:04.877703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:04.877703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:04.877703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:04.877703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:04.877703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:04.877703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:04.877703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:04.877703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:04.877703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:04.877703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:04.877703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:53:04.877703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:04.881516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 119/239] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:04.889278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a45c0-e317-4b41-aa65-a98686f4857d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:05.007309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:05.116159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a45c0-e317-4b41-aa65-a98686f4857d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:05.169404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2e632-47f2-4887-be38-f59ede2ef808 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:05.207240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e794b0e-e766-40f9-b668-b01dde3b3f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:05.207927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e794b0e-e766-40f9-b668-b01dde3b3f13 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:05.208214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e794b0e-e766-40f9-b668-b01dde3b3f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:05.208496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e794b0e-e766-40f9-b668-b01dde3b3f13 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:05.209307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e794b0e-e766-40f9-b668-b01dde3b3f13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:05.209618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e794b0e-e766-40f9-b668-b01dde3b3f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:05.211196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e794b0e-e766-40f9-b668-b01dde3b3f13 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:05.230265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 120/240] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:05.235726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcaddb-8d8f-46a7-a6d7-8b85b9fbdfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:05.236380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcaddb-8d8f-46a7-a6d7-8b85b9fbdfbe None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:05.237449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e794b0e-e766-40f9-b668-b01dde3b3f13 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:05.238020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcaddb-8d8f-46a7-a6d7-8b85b9fbdfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:05.238297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcaddb-8d8f-46a7-a6d7-8b85b9fbdfbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:05.241793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcaddb-8d8f-46a7-a6d7-8b85b9fbdfbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:05.243288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcaddb-8d8f-46a7-a6d7-8b85b9fbdfbe None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:05.251965 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 121/241] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:05.258199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcaddb-8d8f-46a7-a6d7-8b85b9fbdfbe None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:05.344577 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:05.401916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e794b0e-e766-40f9-b668-b01dde3b3f13 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:05.427684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcaddb-8d8f-46a7-a6d7-8b85b9fbdfbe None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:05.451854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:05.452847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f7507-7ca6-4321-9299-11015327c9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:05.453750 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f7507-7ca6-4321-9299-11015327c9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:05.454282 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f7507-7ca6-4321-9299-11015327c9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:05.454725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f7507-7ca6-4321-9299-11015327c9a0 None admin] PATH_INFO: `/v3/users/429e42dbfd4f46f884de0977e8a4f288` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:05.470592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f7507-7ca6-4321-9299-11015327c9a0 None admin] RBAC: Authorizing `identity:get_user(user_id=429e42dbfd4f46f884de0977e8a4f288)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:05.472201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f7507-7ca6-4321-9299-11015327c9a0 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:05.474300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 121/242] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:05 2022] GET /identity/v3/users/429e42dbfd4f46f884de0977e8a4f288 => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:05.475778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9d8f-5a1f-4841-b13e-9d74b6bf837b None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:05.476128 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9d8f-5a1f-4841-b13e-9d74b6bf837b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:05.476500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9d8f-5a1f-4841-b13e-9d74b6bf837b None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:05.477876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 122/243] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:05.482507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb9d8f-5a1f-4841-b13e-9d74b6bf837b None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:05.493290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecde9d-c052-4c83-8e9a-e2db8344531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:05.494661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecde9d-c052-4c83-8e9a-e2db8344531b None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:05.495485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecde9d-c052-4c83-8e9a-e2db8344531b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:05.495966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecde9d-c052-4c83-8e9a-e2db8344531b None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:05.497109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecde9d-c052-4c83-8e9a-e2db8344531b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:05.500274 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecde9d-c052-4c83-8e9a-e2db8344531b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:05.536746 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 122/244] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:53:05 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 20:53:05.538488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe44b4d-d76b-44d5-b174-b534517c8451 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:05.539054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe44b4d-d76b-44d5-b174-b534517c8451 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:05.539545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe44b4d-d76b-44d5-b174-b534517c8451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:05.564690 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ebe44b4d-d76b-44d5-b174-b534517c8451 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:05.567474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ebe44b4d-d76b-44d5-b174-b534517c8451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:05.659331 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 123/245] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:05.673828 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb9d8f-5a1f-4841-b13e-9d74b6bf837b None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:05.699882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:05.744765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df213b6d-60ca-40f2-aa8b-3dc1a9eef0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:05.745402 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df213b6d-60ca-40f2-aa8b-3dc1a9eef0af None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:05.745693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df213b6d-60ca-40f2-aa8b-3dc1a9eef0af None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:05.745987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df213b6d-60ca-40f2-aa8b-3dc1a9eef0af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:05.850838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df213b6d-60ca-40f2-aa8b-3dc1a9eef0af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:05.852308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df213b6d-60ca-40f2-aa8b-3dc1a9eef0af None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:05.973351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 123/246] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:05.979422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df213b6d-60ca-40f2-aa8b-3dc1a9eef0af None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:05.979611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe44b4d-d76b-44d5-b174-b534517c8451 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:05.999388 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:06.131747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df213b6d-60ca-40f2-aa8b-3dc1a9eef0af None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:06.132831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:06.137798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe44b4d-d76b-44d5-b174-b534517c8451 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:06.181541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97896936-172d-48ba-860e-efe8cf3896a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:06.182474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97896936-172d-48ba-860e-efe8cf3896a1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:06.182959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97896936-172d-48ba-860e-efe8cf3896a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:06.183399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97896936-172d-48ba-860e-efe8cf3896a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:06.186493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bee2b-73a3-45e5-a905-bb89d6ded0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:06.187185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bee2b-73a3-45e5-a905-bb89d6ded0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:06.187474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bee2b-73a3-45e5-a905-bb89d6ded0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:06.187752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bee2b-73a3-45e5-a905-bb89d6ded0c1 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:06.188903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bee2b-73a3-45e5-a905-bb89d6ded0c1 None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:06.190363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bee2b-73a3-45e5-a905-bb89d6ded0c1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:06.192075 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 124/247] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:05 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:06.193218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88af0ea-f144-446f-aa8a-e7ad90e3da16 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:06.193513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88af0ea-f144-446f-aa8a-e7ad90e3da16 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:06.193780 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88af0ea-f144-446f-aa8a-e7ad90e3da16 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:06.196009 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 125/248] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:06.199414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97896936-172d-48ba-860e-efe8cf3896a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:06.201562 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88af0ea-f144-446f-aa8a-e7ad90e3da16 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-97896936-172d-48ba-860e-efe8cf3896a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:06.205732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:06.206648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:06.210257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:06.210257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:06.210257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:06.210257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:06.210257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:06.210257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:06.210257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:06.210257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:06.210257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:06.210257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:06.210257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:06.210257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:06.212683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 124/249] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:06.213952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a99bf0-abb4-4301-934d-52b71ece28a7 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:06.214246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a99bf0-abb4-4301-934d-52b71ece28a7 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:06.215949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a99bf0-abb4-4301-934d-52b71ece28a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:06.239976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-c6a99bf0-abb4-4301-934d-52b71ece28a7 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:06.242239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c6a99bf0-abb4-4301-934d-52b71ece28a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:06.332312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 125/250] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:06.333508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a99bf0-abb4-4301-934d-52b71ece28a7 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:06.336199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:06.361075 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88af0ea-f144-446f-aa8a-e7ad90e3da16 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:06.403364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792ab39-588e-40cc-92dc-f138e0b90301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:06.405336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792ab39-588e-40cc-92dc-f138e0b90301 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:06.405907 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792ab39-588e-40cc-92dc-f138e0b90301 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:06.406377 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792ab39-588e-40cc-92dc-f138e0b90301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:06.407336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792ab39-588e-40cc-92dc-f138e0b90301 None admin] RBAC: Adding query filter params (role.id=b1ad7360ee8a4c03bc87e2f9121a7d65, scope.project.id=9be09a7606624a74a92f8c33c2919615, user.id=429e42dbfd4f46f884de0977e8a4f288) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:06.407863 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792ab39-588e-40cc-92dc-f138e0b90301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:06.409795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792ab39-588e-40cc-92dc-f138e0b90301 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:06.416528 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 126/251] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:53:06 2022] GET /identity/v3/role_assignments?user.id=429e42dbfd4f46f884de0977e8a4f288&scope.project.id=9be09a7606624a74a92f8c33c2919615&role.id=b1ad7360ee8a4c03bc87e2f9121a7d65 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:06.485027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a99bf0-abb4-4301-934d-52b71ece28a7 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:06.532311 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10fd49-1303-428b-bac9-a58cf1c237af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:06.532859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10fd49-1303-428b-bac9-a58cf1c237af None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:06.533138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10fd49-1303-428b-bac9-a58cf1c237af None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:06.533412 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10fd49-1303-428b-bac9-a58cf1c237af None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:06.534136 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10fd49-1303-428b-bac9-a58cf1c237af None admin] RBAC: Adding query filter params (name=member) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:06.534438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10fd49-1303-428b-bac9-a58cf1c237af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:06.535881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10fd49-1303-428b-bac9-a58cf1c237af None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:06.552098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 126/252] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:06.557775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792ab39-588e-40cc-92dc-f138e0b90301 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:06.595109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:06.678418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792ab39-588e-40cc-92dc-f138e0b90301 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:06.720032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9699e50-f557-4e49-b50d-639b1c122688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:06.721072 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9699e50-f557-4e49-b50d-639b1c122688 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:06.721548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9699e50-f557-4e49-b50d-639b1c122688 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:06.722031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9699e50-f557-4e49-b50d-639b1c122688 None admin] PATH_INFO: `/v3/users/9258fab6e5b141c587821f9b7b6b554c` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:06.723451 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9699e50-f557-4e49-b50d-639b1c122688 None admin] RBAC: Authorizing `identity:get_user(user_id=9258fab6e5b141c587821f9b7b6b554c)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:06.725161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9699e50-f557-4e49-b50d-639b1c122688 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:06.727320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 127/253] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:06 2022] GET /identity/v3/users/9258fab6e5b141c587821f9b7b6b554c => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:06.732696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10fd49-1303-428b-bac9-a58cf1c237af None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:06.832227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:06.865618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9699e50-f557-4e49-b50d-639b1c122688 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:06.887131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10fd49-1303-428b-bac9-a58cf1c237af None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:06.943603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3580e88-66ca-418e-80a2-83858f63d21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:06.944272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3580e88-66ca-418e-80a2-83858f63d21f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:06.944559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3580e88-66ca-418e-80a2-83858f63d21f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:06.944884 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3580e88-66ca-418e-80a2-83858f63d21f None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:06.947231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3580e88-66ca-418e-80a2-83858f63d21f None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:06.948829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3580e88-66ca-418e-80a2-83858f63d21f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:06.954855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 127/254] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:06 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:06.968883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3580e88-66ca-418e-80a2-83858f63d21f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:06.984835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:06.989507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9699e50-f557-4e49-b50d-639b1c122688 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:07.026452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3712c-1b8e-47e8-8ee8-9354080414f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:07.027522 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3712c-1b8e-47e8-8ee8-9354080414f4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:07.028007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3712c-1b8e-47e8-8ee8-9354080414f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:07.028492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3712c-1b8e-47e8-8ee8-9354080414f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:07.040451 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3712c-1b8e-47e8-8ee8-9354080414f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f4a3712c-1b8e-47e8-8ee8-9354080414f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:07.047152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:07.048068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:07.048869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:07.048869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:07.048869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:07.048869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:07.048869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:07.048869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:07.048869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:07.048869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:07.048869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:07.048869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:07.048869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:53:07.048869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:07.051246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 128/255] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:53:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:53:07.057087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3712c-1b8e-47e8-8ee8-9354080414f4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:07.167537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3712c-1b8e-47e8-8ee8-9354080414f4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:07.167772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3580e88-66ca-418e-80a2-83858f63d21f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:07.209131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0a6ae-5671-45f0-a265-48eab1072e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:07.210118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0a6ae-5671-45f0-a265-48eab1072e83 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:07.210596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0a6ae-5671-45f0-a265-48eab1072e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:07.211091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0a6ae-5671-45f0-a265-48eab1072e83 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:07.211980 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0a6ae-5671-45f0-a265-48eab1072e83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:07.212481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0a6ae-5671-45f0-a265-48eab1072e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:07.214171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0a6ae-5671-45f0-a265-48eab1072e83 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:07.225563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 129/256] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:07.231504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48a46c-6d9e-4071-9794-0fab6483b23b None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:07.232509 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48a46c-6d9e-4071-9794-0fab6483b23b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:07.233130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48a46c-6d9e-4071-9794-0fab6483b23b None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:07.235067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 130/257] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:07.236384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:07.237820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48a46c-6d9e-4071-9794-0fab6483b23b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:07.245446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db606097-95a0-4f92-a74e-2caf9adca985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:07.246140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db606097-95a0-4f92-a74e-2caf9adca985 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:07.246427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db606097-95a0-4f92-a74e-2caf9adca985 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:07.246710 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db606097-95a0-4f92-a74e-2caf9adca985 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615/users/9258fab6e5b141c587821f9b7b6b554c/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:07.251551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db606097-95a0-4f92-a74e-2caf9adca985 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be09a7606624a74a92f8c33c2919615, user_id=9258fab6e5b141c587821f9b7b6b554c, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:07.253154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db606097-95a0-4f92-a74e-2caf9adca985 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:07.265652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:07.282367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 128/258] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:53:06 2022] PUT /identity/v3/projects/9be09a7606624a74a92f8c33c2919615/users/9258fab6e5b141c587821f9b7b6b554c/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 20:53:07.284069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beccbc-02f9-49e2-b3d4-db1dd792d43a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:07.284583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beccbc-02f9-49e2-b3d4-db1dd792d43a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:07.285066 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beccbc-02f9-49e2-b3d4-db1dd792d43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:07.340193 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-a3beccbc-02f9-49e2-b3d4-db1dd792d43a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:07.342700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a3beccbc-02f9-49e2-b3d4-db1dd792d43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:07.453363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48a46c-6d9e-4071-9794-0fab6483b23b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:07.524000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52805550-9c29-4364-aa9f-feb7bb17cdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:07.525114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52805550-9c29-4364-aa9f-feb7bb17cdae None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:07.525482 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52805550-9c29-4364-aa9f-feb7bb17cdae None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:07.526051 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52805550-9c29-4364-aa9f-feb7bb17cdae None admin] PATH_INFO: `/v3/users/f3d313994aa04528a6c4044c5c0cd637` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:07.528032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52805550-9c29-4364-aa9f-feb7bb17cdae None admin] RBAC: Authorizing `identity:get_user(user_id=f3d313994aa04528a6c4044c5c0cd637)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:07.532222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52805550-9c29-4364-aa9f-feb7bb17cdae None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:07.534811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 131/259] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:07 2022] GET /identity/v3/users/f3d313994aa04528a6c4044c5c0cd637 => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:07.540600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 129/260] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:07.541627 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52805550-9c29-4364-aa9f-feb7bb17cdae None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:07.660914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:07.681522 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52805550-9c29-4364-aa9f-feb7bb17cdae None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:07.731193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb26e4-c834-456d-83ef-be961f827e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:07.731770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb26e4-c834-456d-83ef-be961f827e80 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:07.732753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb26e4-c834-456d-83ef-be961f827e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:07.733028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb26e4-c834-456d-83ef-be961f827e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:07.845305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb26e4-c834-456d-83ef-be961f827e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:07.847346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb26e4-c834-456d-83ef-be961f827e80 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:07.988875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:08.007706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 132/261] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 20:53:08.016091 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beccbc-02f9-49e2-b3d4-db1dd792d43a None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:08.041309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb26e4-c834-456d-83ef-be961f827e80 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:08.179247 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beccbc-02f9-49e2-b3d4-db1dd792d43a None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:08.226109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa4784-11bc-4952-9fdf-b692349a3099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:08.226917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa4784-11bc-4952-9fdf-b692349a3099 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:08.227422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa4784-11bc-4952-9fdf-b692349a3099 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:08.227734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa4784-11bc-4952-9fdf-b692349a3099 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:08.229275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa4784-11bc-4952-9fdf-b692349a3099 None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:08.230942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa4784-11bc-4952-9fdf-b692349a3099 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:08.233150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 130/262] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:08 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:08.235157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:08.241334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa4784-11bc-4952-9fdf-b692349a3099 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:08.354322 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb26e4-c834-456d-83ef-be961f827e80 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:08.432096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b123e-3a34-4bab-b0d8-927e72114b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:08.433431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b123e-3a34-4bab-b0d8-927e72114b30 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:08.433915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b123e-3a34-4bab-b0d8-927e72114b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:08.434551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b123e-3a34-4bab-b0d8-927e72114b30 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:08.459795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa4784-11bc-4952-9fdf-b692349a3099 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:08.461118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b123e-3a34-4bab-b0d8-927e72114b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-744b123e-3a34-4bab-b0d8-927e72114b30 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:08.467734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:08.468697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:08.469554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:08.469554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:08.469554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:08.469554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:08.469554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:08.469554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:08.469554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:08.469554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:08.469554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:08.469554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:08.469554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:08.469554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:08.476608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 133/263] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:53:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:53:08.485014 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b123e-3a34-4bab-b0d8-927e72114b30 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:08.566847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d3564-bb3a-4c5c-b36b-07ee4e1bba32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:08.566847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d3564-bb3a-4c5c-b36b-07ee4e1bba32 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:08.566847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d3564-bb3a-4c5c-b36b-07ee4e1bba32 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:08.566847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d3564-bb3a-4c5c-b36b-07ee4e1bba32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:08.567197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d3564-bb3a-4c5c-b36b-07ee4e1bba32 None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=9be09a7606624a74a92f8c33c2919615, user.id=f3d313994aa04528a6c4044c5c0cd637) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:08.567285 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d3564-bb3a-4c5c-b36b-07ee4e1bba32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:08.569251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d3564-bb3a-4c5c-b36b-07ee4e1bba32 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:08.593039 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 131/264] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:53:08 2022] GET /identity/v3/role_assignments?user.id=f3d313994aa04528a6c4044c5c0cd637&scope.project.id=9be09a7606624a74a92f8c33c2919615&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 608 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:08.635132 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:08.737174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b123e-3a34-4bab-b0d8-927e72114b30 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:08.799921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2f7fe-b0c5-482e-ada9-7e767c26d15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:08.800693 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2f7fe-b0c5-482e-ada9-7e767c26d15f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:08.801206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2f7fe-b0c5-482e-ada9-7e767c26d15f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:08.801553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2f7fe-b0c5-482e-ada9-7e767c26d15f None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:08.802413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2f7fe-b0c5-482e-ada9-7e767c26d15f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:08.802722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2f7fe-b0c5-482e-ada9-7e767c26d15f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:08.804689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2f7fe-b0c5-482e-ada9-7e767c26d15f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:08.820032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 134/265] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:08.826913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d3564-bb3a-4c5c-b36b-07ee4e1bba32 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:08.891462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8519bf-32aa-41f8-b09c-8aa3bb3f21b3 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:08.891857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8519bf-32aa-41f8-b09c-8aa3bb3f21b3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:08.892206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8519bf-32aa-41f8-b09c-8aa3bb3f21b3 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:08.893912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 135/266] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:53:08.903507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74feaf7-310e-4536-a0cb-c4051e57c0dd None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:08.903924 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74feaf7-310e-4536-a0cb-c4051e57c0dd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:08.904203 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74feaf7-310e-4536-a0cb-c4051e57c0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:08.932213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c74feaf7-310e-4536-a0cb-c4051e57c0dd None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:08.937423 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c74feaf7-310e-4536-a0cb-c4051e57c0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:08.939208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:09.012136 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d3564-bb3a-4c5c-b36b-07ee4e1bba32 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:09.096107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 136/267] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:09.103506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7d21d-0e81-4087-bf74-3b7d8bde835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:09.104812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7d21d-0e81-4087-bf74-3b7d8bde835a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:09.105235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7d21d-0e81-4087-bf74-3b7d8bde835a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:09.105645 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7d21d-0e81-4087-bf74-3b7d8bde835a None admin] PATH_INFO: `/v3/users/f3d313994aa04528a6c4044c5c0cd637` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:09.111635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7d21d-0e81-4087-bf74-3b7d8bde835a None admin] RBAC: Authorizing `identity:get_user(user_id=f3d313994aa04528a6c4044c5c0cd637)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:09.113404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7d21d-0e81-4087-bf74-3b7d8bde835a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:09.115438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 132/268] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:08 2022] GET /identity/v3/users/f3d313994aa04528a6c4044c5c0cd637 => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:09.121377 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74feaf7-310e-4536-a0cb-c4051e57c0dd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:09.181589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:09.265967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74feaf7-310e-4536-a0cb-c4051e57c0dd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:09.327521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edfce0-b7c4-40dd-b103-2e4119ec3137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:09.328530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edfce0-b7c4-40dd-b103-2e4119ec3137 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:09.329010 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edfce0-b7c4-40dd-b103-2e4119ec3137 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:09.329479 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edfce0-b7c4-40dd-b103-2e4119ec3137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:09.343371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c68d0-a393-4b66-8a6f-a7732199325f None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:09.343371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c68d0-a393-4b66-8a6f-a7732199325f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:09.343654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c68d0-a393-4b66-8a6f-a7732199325f None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:09.345373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 133/269] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:53:09.351551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52921f90-0dbc-4893-ace9-ce71ab35cb1b None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:09.351990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52921f90-0dbc-4893-ace9-ce71ab35cb1b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:09.352476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52921f90-0dbc-4893-ace9-ce71ab35cb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:09.390149 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-52921f90-0dbc-4893-ace9-ce71ab35cb1b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:09.391647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-52921f90-0dbc-4893-ace9-ce71ab35cb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:09.426822 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edfce0-b7c4-40dd-b103-2e4119ec3137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:09.428728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edfce0-b7c4-40dd-b103-2e4119ec3137 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:09.476961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:09.552152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 134/270] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:09.561500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850a0e3-40c9-4f45-b451-c747ffab034e None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:09.561804 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850a0e3-40c9-4f45-b451-c747ffab034e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:09.562062 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850a0e3-40c9-4f45-b451-c747ffab034e None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:09.563878 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 135/271] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:53:09.564464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850a0e3-40c9-4f45-b451-c747ffab034e None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:09.592504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 137/272] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:09.594209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8738-01a0-4faa-be0d-8f6392d2e8d6 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:09.594721 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8738-01a0-4faa-be0d-8f6392d2e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:09.595157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8738-01a0-4faa-be0d-8f6392d2e8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:09.617066 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b88f8738-01a0-4faa-be0d-8f6392d2e8d6 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:09.619031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b88f8738-01a0-4faa-be0d-8f6392d2e8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:09.646853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:09.696512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 138/273] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:09.697483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f8738-01a0-4faa-be0d-8f6392d2e8d6 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:09.718469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850a0e3-40c9-4f45-b451-c747ffab034e None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:09.784036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8dd3c-d63a-4124-87b7-49020b31bf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:09.784693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8dd3c-d63a-4124-87b7-49020b31bf2c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:09.784978 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8dd3c-d63a-4124-87b7-49020b31bf2c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:09.785247 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8dd3c-d63a-4124-87b7-49020b31bf2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:09.804926 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:09.806499 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8dd3c-d63a-4124-87b7-49020b31bf2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-38b8dd3c-d63a-4124-87b7-49020b31bf2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:09.821389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:09.822374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:09.823214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:09.823214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:09.823214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:09.823214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:09.823214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:09.823214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:09.823214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:09.823214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:09.823214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:09.823214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:09.823214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:09.823214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:09.823214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 136/274] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:09.829169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8dd3c-d63a-4124-87b7-49020b31bf2c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:09.845041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f8738-01a0-4faa-be0d-8f6392d2e8d6 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:09.890435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd6af3-69b3-4986-ad3b-c304db7fa72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:09.891356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd6af3-69b3-4986-ad3b-c304db7fa72b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:09.891646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd6af3-69b3-4986-ad3b-c304db7fa72b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:09.891926 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd6af3-69b3-4986-ad3b-c304db7fa72b None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:09.893089 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd6af3-69b3-4986-ad3b-c304db7fa72b None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:09.894556 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd6af3-69b3-4986-ad3b-c304db7fa72b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:09.901577 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 139/275] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:09 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:09.902480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd6af3-69b3-4986-ad3b-c304db7fa72b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:09.976238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8dd3c-d63a-4124-87b7-49020b31bf2c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:09.991792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:10.017250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef559843-2b47-4ada-8d6a-93c34f76b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:10.017877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef559843-2b47-4ada-8d6a-93c34f76b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:10.018161 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef559843-2b47-4ada-8d6a-93c34f76b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:10.018439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef559843-2b47-4ada-8d6a-93c34f76b8e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:10.019156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef559843-2b47-4ada-8d6a-93c34f76b8e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:10.019464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef559843-2b47-4ada-8d6a-93c34f76b8e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:10.020964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef559843-2b47-4ada-8d6a-93c34f76b8e3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:10.031326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 137/276] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:10.032360 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef559843-2b47-4ada-8d6a-93c34f76b8e3 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:10.034542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd6af3-69b3-4986-ad3b-c304db7fa72b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:10.078838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000febf9-b66f-4dd6-9fb4-a17910574849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:10.079501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000febf9-b66f-4dd6-9fb4-a17910574849 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:10.079895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000febf9-b66f-4dd6-9fb4-a17910574849 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:10.080209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000febf9-b66f-4dd6-9fb4-a17910574849 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:10.081555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000febf9-b66f-4dd6-9fb4-a17910574849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:10.083202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000febf9-b66f-4dd6-9fb4-a17910574849 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:10.089183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 140/277] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:10.090089 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000febf9-b66f-4dd6-9fb4-a17910574849 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:10.099991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:10.152112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef559843-2b47-4ada-8d6a-93c34f76b8e3 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:10.192519 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cfc49-3531-4e6d-99d8-a2f5188f5a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:10.193125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cfc49-3531-4e6d-99d8-a2f5188f5a7d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:10.193409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cfc49-3531-4e6d-99d8-a2f5188f5a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:10.193681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cfc49-3531-4e6d-99d8-a2f5188f5a7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:10.194409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cfc49-3531-4e6d-99d8-a2f5188f5a7d None admin] RBAC: Adding query filter params (role.id=0fdbf18b17e545d9929e22ebddc1d5b7, scope.project.id=9be09a7606624a74a92f8c33c2919615, user.id=f3d313994aa04528a6c4044c5c0cd637) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:10.194716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cfc49-3531-4e6d-99d8-a2f5188f5a7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:10.196172 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cfc49-3531-4e6d-99d8-a2f5188f5a7d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:10.201839 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000febf9-b66f-4dd6-9fb4-a17910574849 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:10.202943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 138/278] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:53:10 2022] GET /identity/v3/role_assignments?user.id=f3d313994aa04528a6c4044c5c0cd637&scope.project.id=9be09a7606624a74a92f8c33c2919615&role.id=0fdbf18b17e545d9929e22ebddc1d5b7 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:10.203591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cfc49-3531-4e6d-99d8-a2f5188f5a7d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:10.247790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac6ae7-6b59-4a7d-a51d-2773b648eccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:10.248447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac6ae7-6b59-4a7d-a51d-2773b648eccd None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:10.248981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac6ae7-6b59-4a7d-a51d-2773b648eccd None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:10.249262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac6ae7-6b59-4a7d-a51d-2773b648eccd None admin] PATH_INFO: `/v3/users/5dd84b768c2e40cbadb6d53c92ed56a0` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:10.262072 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:10.266819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac6ae7-6b59-4a7d-a51d-2773b648eccd None admin] RBAC: Authorizing `identity:get_user(user_id=5dd84b768c2e40cbadb6d53c92ed56a0)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:10.268364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac6ae7-6b59-4a7d-a51d-2773b648eccd None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:10.270160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 141/279] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:10 2022] GET /identity/v3/users/5dd84b768c2e40cbadb6d53c92ed56a0 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:10.270160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac6ae7-6b59-4a7d-a51d-2773b648eccd None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:10.345186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:10.345986 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cfc49-3531-4e6d-99d8-a2f5188f5a7d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:10.385132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69705f-3453-4831-aeac-a7698b355a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:10.385778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69705f-3453-4831-aeac-a7698b355a25 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:10.386062 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69705f-3453-4831-aeac-a7698b355a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:10.386337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69705f-3453-4831-aeac-a7698b355a25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:10.395027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac6ae7-6b59-4a7d-a51d-2773b648eccd None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:10.399916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69705f-3453-4831-aeac-a7698b355a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-de69705f-3453-4831-aeac-a7698b355a25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:10.404990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:10.405965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 139/280] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:10.410369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fc562-f39b-40c2-af90-ec642786284f None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:10.411144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fc562-f39b-40c2-af90-ec642786284f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:10.411144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fc562-f39b-40c2-af90-ec642786284f None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:10.411144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 140/281] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:10.411144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fc562-f39b-40c2-af90-ec642786284f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:10.438393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8094b-566e-47c3-9279-04ebc98e4952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:10.439111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8094b-566e-47c3-9279-04ebc98e4952 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:10.439398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8094b-566e-47c3-9279-04ebc98e4952 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:10.439670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8094b-566e-47c3-9279-04ebc98e4952 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:10.440335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8094b-566e-47c3-9279-04ebc98e4952 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:10.441795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8094b-566e-47c3-9279-04ebc98e4952 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:10.462955 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 142/282] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:53:10 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:53:10.464186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8094b-566e-47c3-9279-04ebc98e4952 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:10.525955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:10.533796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fc562-f39b-40c2-af90-ec642786284f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:10.577773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82339d6-bf9a-444e-b264-4d0f5b1dca92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:10.578403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82339d6-bf9a-444e-b264-4d0f5b1dca92 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:10.578686 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82339d6-bf9a-444e-b264-4d0f5b1dca92 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:10.578993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82339d6-bf9a-444e-b264-4d0f5b1dca92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:10.579742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82339d6-bf9a-444e-b264-4d0f5b1dca92 None admin] RBAC: Adding query filter params (role.id=40d451ce7e0143e682ac5d43622c57d2, user.id=5dd84b768c2e40cbadb6d53c92ed56a0, scope.system=all) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:10.580605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82339d6-bf9a-444e-b264-4d0f5b1dca92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:10.581626 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82339d6-bf9a-444e-b264-4d0f5b1dca92 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:10.587635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 141/283] 10.222.0.17 () {56 vars in 1308 bytes} [Fri Aug 19 20:53:10 2022] GET /identity/v3/role_assignments?user.id=5dd84b768c2e40cbadb6d53c92ed56a0&scope.system=all&role.id=40d451ce7e0143e682ac5d43622c57d2 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:10.595625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8094b-566e-47c3-9279-04ebc98e4952 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:10.600296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b103c-d6bf-451d-a1d0-6fe9d416d486 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:10.600660 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b103c-d6bf-451d-a1d0-6fe9d416d486 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:10.600863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b103c-d6bf-451d-a1d0-6fe9d416d486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:10.629180 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:10.633906 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-708b103c-d6bf-451d-a1d0-6fe9d416d486 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:10.635836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-708b103c-d6bf-451d-a1d0-6fe9d416d486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:10.657284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b1264-980c-4952-9a6b-17470e91e743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:10.657848 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b1264-980c-4952-9a6b-17470e91e743 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:10.658181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b1264-980c-4952-9a6b-17470e91e743 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:10.658515 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b1264-980c-4952-9a6b-17470e91e743 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:10.659283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b1264-980c-4952-9a6b-17470e91e743 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:10.659620 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b1264-980c-4952-9a6b-17470e91e743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:10.661038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b1264-980c-4952-9a6b-17470e91e743 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:10.671669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 143/284] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:10.677328 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b1264-980c-4952-9a6b-17470e91e743 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:10.733315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 142/285] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:10.815636 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b1264-980c-4952-9a6b-17470e91e743 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:10.853314 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5392723-4ade-4df1-aa37-50d1b0559ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:10.853968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5392723-4ade-4df1-aa37-50d1b0559ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:10.854253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5392723-4ade-4df1-aa37-50d1b0559ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:10.854529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5392723-4ade-4df1-aa37-50d1b0559ea3 None admin] PATH_INFO: `/v3/users/429e42dbfd4f46f884de0977e8a4f288` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:10.855730 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5392723-4ade-4df1-aa37-50d1b0559ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=429e42dbfd4f46f884de0977e8a4f288)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:10.857848 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5392723-4ade-4df1-aa37-50d1b0559ea3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:10.859494 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 144/286] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:10 2022] GET /identity/v3/users/429e42dbfd4f46f884de0977e8a4f288 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:10.865121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b103c-d6bf-451d-a1d0-6fe9d416d486 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:10.987246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:10.996268 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b103c-d6bf-451d-a1d0-6fe9d416d486 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:11.023193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5392723-4ade-4df1-aa37-50d1b0559ea3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:11.045472 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4f10f-7b06-4af2-9243-258112668872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:11.046181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4f10f-7b06-4af2-9243-258112668872 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:11.046468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4f10f-7b06-4af2-9243-258112668872 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:11.046761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4f10f-7b06-4af2-9243-258112668872 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:11.048636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4f10f-7b06-4af2-9243-258112668872 None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:11.050112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4f10f-7b06-4af2-9243-258112668872 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:11.051805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 143/287] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:10 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:11.059566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4f10f-7b06-4af2-9243-258112668872 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:11.166536 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:11.175125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4f10f-7b06-4af2-9243-258112668872 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:11.213118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec762d4e-40fb-4ca7-8573-6efa2294aa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:11.213791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec762d4e-40fb-4ca7-8573-6efa2294aa91 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:11.214073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec762d4e-40fb-4ca7-8573-6efa2294aa91 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:11.214348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec762d4e-40fb-4ca7-8573-6efa2294aa91 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615/users/429e42dbfd4f46f884de0977e8a4f288/roles/b1ad7360ee8a4c03bc87e2f9121a7d65` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:11.216373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec762d4e-40fb-4ca7-8573-6efa2294aa91 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be09a7606624a74a92f8c33c2919615, user_id=429e42dbfd4f46f884de0977e8a4f288, role_id=b1ad7360ee8a4c03bc87e2f9121a7d65)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:11.217903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec762d4e-40fb-4ca7-8573-6efa2294aa91 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:11.235716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 144/288] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:53:11 2022] PUT /identity/v3/projects/9be09a7606624a74a92f8c33c2919615/users/429e42dbfd4f46f884de0977e8a4f288/roles/b1ad7360ee8a4c03bc87e2f9121a7d65 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 20:53:11.287034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5392723-4ade-4df1-aa37-50d1b0559ea3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:11.358293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee6b11-2f0b-4137-9130-29d7a985cb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:11.359107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee6b11-2f0b-4137-9130-29d7a985cb17 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:11.359398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee6b11-2f0b-4137-9130-29d7a985cb17 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:11.359683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee6b11-2f0b-4137-9130-29d7a985cb17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:11.382424 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee6b11-2f0b-4137-9130-29d7a985cb17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-3fee6b11-2f0b-4137-9130-29d7a985cb17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:11.388000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:11.389545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:11.390847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:11.390847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:11.390847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:11.390847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:11.390847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:11.390847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:11.390847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:11.390847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:11.390847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:11.390847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:11.390847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:11.390847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:11.390847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 145/289] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:53:11.396106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec762d4e-40fb-4ca7-8573-6efa2294aa91 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:11.431861 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:11.541621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec762d4e-40fb-4ca7-8573-6efa2294aa91 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:11.582042 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91675e-e4b4-4c5c-920d-1192b2af0f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:11.582664 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91675e-e4b4-4c5c-920d-1192b2af0f77 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:11.582989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91675e-e4b4-4c5c-920d-1192b2af0f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:11.583260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91675e-e4b4-4c5c-920d-1192b2af0f77 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:11.583941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91675e-e4b4-4c5c-920d-1192b2af0f77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:11.584246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91675e-e4b4-4c5c-920d-1192b2af0f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:11.585687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91675e-e4b4-4c5c-920d-1192b2af0f77 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:11.595964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 145/290] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:11.601242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee6b11-2f0b-4137-9130-29d7a985cb17 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:11.708553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee6b11-2f0b-4137-9130-29d7a985cb17 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:11.723091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:11.745649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bd8d7-44a8-4ee1-81c3-195d9d2d2332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:11.746372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd8d7-44a8-4ee1-81c3-195d9d2d2332 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:11.746662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd8d7-44a8-4ee1-81c3-195d9d2d2332 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:11.746991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd8d7-44a8-4ee1-81c3-195d9d2d2332 None admin] PATH_INFO: `/v3/users/9258fab6e5b141c587821f9b7b6b554c` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:11.748811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bd8d7-44a8-4ee1-81c3-195d9d2d2332 None admin] RBAC: Authorizing `identity:get_user(user_id=9258fab6e5b141c587821f9b7b6b554c)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:11.750275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bd8d7-44a8-4ee1-81c3-195d9d2d2332 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:11.752201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 146/291] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:11 2022] GET /identity/v3/users/9258fab6e5b141c587821f9b7b6b554c => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:11.760163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91675e-e4b4-4c5c-920d-1192b2af0f77 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:11.867804 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:11.887903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91675e-e4b4-4c5c-920d-1192b2af0f77 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:11.924343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e1d8f-c500-458a-8a73-4f90c67c2d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:11.924971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e1d8f-c500-458a-8a73-4f90c67c2d73 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:11.925253 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e1d8f-c500-458a-8a73-4f90c67c2d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:11.925529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e1d8f-c500-458a-8a73-4f90c67c2d73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:11.998000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e1d8f-c500-458a-8a73-4f90c67c2d73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:11.999525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e1d8f-c500-458a-8a73-4f90c67c2d73 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:12.089274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:12.109777 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 146/292] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:12.115256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bd8d7-44a8-4ee1-81c3-195d9d2d2332 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:12.281860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bd8d7-44a8-4ee1-81c3-195d9d2d2332 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:12.342844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a32e5-05b7-4704-b793-dab5dcbc4826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:12.343746 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a32e5-05b7-4704-b793-dab5dcbc4826 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:12.344176 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a32e5-05b7-4704-b793-dab5dcbc4826 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:12.344624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a32e5-05b7-4704-b793-dab5dcbc4826 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:12.347421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a32e5-05b7-4704-b793-dab5dcbc4826 None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:12.349028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a32e5-05b7-4704-b793-dab5dcbc4826 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:12.351198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 147/293] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:12 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:12.357403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e1d8f-c500-458a-8a73-4f90c67c2d73 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:12.522671 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e1d8f-c500-458a-8a73-4f90c67c2d73 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:12.575345 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ad88a-193d-4444-831c-bc3e8c40d0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:12.575967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ad88a-193d-4444-831c-bc3e8c40d0bc None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:12.576255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ad88a-193d-4444-831c-bc3e8c40d0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:12.576532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ad88a-193d-4444-831c-bc3e8c40d0bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:12.577272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ad88a-193d-4444-831c-bc3e8c40d0bc None admin] RBAC: Adding query filter params (role.id=40d451ce7e0143e682ac5d43622c57d2, scope.project.id=9be09a7606624a74a92f8c33c2919615, user.id=9258fab6e5b141c587821f9b7b6b554c) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:12.577582 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ad88a-193d-4444-831c-bc3e8c40d0bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:12.579037 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ad88a-193d-4444-831c-bc3e8c40d0bc None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:12.585070 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 147/294] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:53:12 2022] GET /identity/v3/role_assignments?user.id=9258fab6e5b141c587821f9b7b6b554c&scope.project.id=9be09a7606624a74a92f8c33c2919615&role.id=40d451ce7e0143e682ac5d43622c57d2 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:12.953585 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db99b8-71fb-462f-a44a-4e7a4e89e0a9 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:12.953981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db99b8-71fb-462f-a44a-4e7a4e89e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:12.954159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db99b8-71fb-462f-a44a-4e7a4e89e0a9 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:12.955808 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 148/295] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:12.960896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c382db-a000-4b8f-8afd-01ab1da8c01c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:12.961315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c382db-a000-4b8f-8afd-01ab1da8c01c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:12.961694 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c382db-a000-4b8f-8afd-01ab1da8c01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:12.981749 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-96c382db-a000-4b8f-8afd-01ab1da8c01c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:12.983736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-96c382db-a000-4b8f-8afd-01ab1da8c01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:13.030963 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a694d80-051b-4d85-b1af-bbe76b6d00c9 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:13.031293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a694d80-051b-4d85-b1af-bbe76b6d00c9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:13.031524 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a694d80-051b-4d85-b1af-bbe76b6d00c9 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:13.033424 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 149/296] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:13.043410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d7056-1652-419e-aa56-2ab81adb077d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:13.043707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d7056-1652-419e-aa56-2ab81adb077d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:13.043969 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d7056-1652-419e-aa56-2ab81adb077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:13.045652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:13.065529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-931d7056-1652-419e-aa56-2ab81adb077d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:13.066835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-931d7056-1652-419e-aa56-2ab81adb077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:13.077524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 148/297] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:13.125030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:13.159798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 150/298] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:13.369255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c382db-a000-4b8f-8afd-01ab1da8c01c None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:13.445588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d7056-1652-419e-aa56-2ab81adb077d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:13.485233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c382db-a000-4b8f-8afd-01ab1da8c01c None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:13.525910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334995aa-8245-4247-8acc-b1f3d137460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:13.526558 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334995aa-8245-4247-8acc-b1f3d137460d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:13.526870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334995aa-8245-4247-8acc-b1f3d137460d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:13.527149 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334995aa-8245-4247-8acc-b1f3d137460d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:13.542515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334995aa-8245-4247-8acc-b1f3d137460d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-334995aa-8245-4247-8acc-b1f3d137460d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:13.548736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:13.549687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:13.550808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:13.550808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:13.550808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:13.550808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:13.550808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:13.550808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:13.550808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:13.550808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:13.550808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:13.550808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:13.550808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:13.550808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:13.550808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 149/299] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:13.556127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686a5ac-7910-4237-a88d-1662e77f4a3f None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:13.556425 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686a5ac-7910-4237-a88d-1662e77f4a3f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:13.556705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686a5ac-7910-4237-a88d-1662e77f4a3f None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:13.558302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 150/300] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:13.558940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686a5ac-7910-4237-a88d-1662e77f4a3f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:13.585232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d7056-1652-419e-aa56-2ab81adb077d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:13.604285 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:13.623708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84afd39-6815-4aff-84fa-6db849a66e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:13.624284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84afd39-6815-4aff-84fa-6db849a66e8c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:13.624561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84afd39-6815-4aff-84fa-6db849a66e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:13.625008 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84afd39-6815-4aff-84fa-6db849a66e8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:13.636964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84afd39-6815-4aff-84fa-6db849a66e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-a84afd39-6815-4aff-84fa-6db849a66e8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:13.642415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:13.643543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:13.644458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:13.644458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:13.644458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:13.644458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:13.644458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:13.644458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:13.644458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:13.644458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:13.644458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:13.644458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:13.644458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:53:13.644458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:13.644458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 151/301] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:13.645287 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72194e1-4241-4787-adb9-301326af1077 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:13.645287 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72194e1-4241-4787-adb9-301326af1077 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:13.645495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72194e1-4241-4787-adb9-301326af1077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:13.665064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d72194e1-4241-4787-adb9-301326af1077 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:13.666278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d72194e1-4241-4787-adb9-301326af1077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:13.688269 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686a5ac-7910-4237-a88d-1662e77f4a3f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:13.697533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:13.725090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09547106-4a14-41dc-98c4-c1aa2e082631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:13.725713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09547106-4a14-41dc-98c4-c1aa2e082631 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:13.726004 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09547106-4a14-41dc-98c4-c1aa2e082631 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:13.726281 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09547106-4a14-41dc-98c4-c1aa2e082631 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:13.726984 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09547106-4a14-41dc-98c4-c1aa2e082631 None admin] RBAC: Adding query filter params (name=member) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:13.727293 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09547106-4a14-41dc-98c4-c1aa2e082631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:13.728667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09547106-4a14-41dc-98c4-c1aa2e082631 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:13.737019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 152/302] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:13.742108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 151/303] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:13.742262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72194e1-4241-4787-adb9-301326af1077 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:13.742339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bdc2d-c372-45a6-837a-4ff840d3ebec None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:13.742339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bdc2d-c372-45a6-837a-4ff840d3ebec None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:13.742339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bdc2d-c372-45a6-837a-4ff840d3ebec None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:13.742339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 152/304] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:13.742774 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bdc2d-c372-45a6-837a-4ff840d3ebec None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:13.874406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:13.882033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bdc2d-c372-45a6-837a-4ff840d3ebec None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:13.882709 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72194e1-4241-4787-adb9-301326af1077 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:13.918822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002c356-c522-4c1d-b6f1-b5bfb780d12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:13.920004 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c356-c522-4c1d-b6f1-b5bfb780d12b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:13.920380 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c356-c522-4c1d-b6f1-b5bfb780d12b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:13.920685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d08e6b-24a8-46fa-bf39-b7b88b4973bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:13.920886 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c356-c522-4c1d-b6f1-b5bfb780d12b None admin] PATH_INFO: `/v3/users/5dd84b768c2e40cbadb6d53c92ed56a0` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:13.921549 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d08e6b-24a8-46fa-bf39-b7b88b4973bd None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:13.921863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002c356-c522-4c1d-b6f1-b5bfb780d12b None admin] RBAC: Authorizing `identity:get_user(user_id=5dd84b768c2e40cbadb6d53c92ed56a0)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:13.922027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d08e6b-24a8-46fa-bf39-b7b88b4973bd None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:13.922719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d08e6b-24a8-46fa-bf39-b7b88b4973bd None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:13.923405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002c356-c522-4c1d-b6f1-b5bfb780d12b None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:13.923695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d08e6b-24a8-46fa-bf39-b7b88b4973bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:13.924144 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d08e6b-24a8-46fa-bf39-b7b88b4973bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:13.932480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 153/305] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:13 2022] GET /identity/v3/users/5dd84b768c2e40cbadb6d53c92ed56a0 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:13.932480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c441-43e9-477e-b34c-0f505af19b4d None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:13.932834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d08e6b-24a8-46fa-bf39-b7b88b4973bd None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:13.932968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c441-43e9-477e-b34c-0f505af19b4d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:13.932968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c441-43e9-477e-b34c-0f505af19b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:13.939664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 153/306] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:13.940389 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d08e6b-24a8-46fa-bf39-b7b88b4973bd None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:13.957334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-a0e1c441-43e9-477e-b34c-0f505af19b4d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:13.958867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a0e1c441-43e9-477e-b34c-0f505af19b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:13.971800 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:14.037998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 154/307] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:14.038902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c441-43e9-477e-b34c-0f505af19b4d None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:14.049473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d08e6b-24a8-46fa-bf39-b7b88b4973bd None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:14.086478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36b067-15b3-47ff-ad71-14b1a993d846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:14.087997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36b067-15b3-47ff-ad71-14b1a993d846 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:14.088874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36b067-15b3-47ff-ad71-14b1a993d846 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:14.089349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36b067-15b3-47ff-ad71-14b1a993d846 None admin] PATH_INFO: `/v3/system/users/5dd84b768c2e40cbadb6d53c92ed56a0/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:14.092180 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36b067-15b3-47ff-ad71-14b1a993d846 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5dd84b768c2e40cbadb6d53c92ed56a0, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:14.094550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36b067-15b3-47ff-ad71-14b1a993d846 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:14.106421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 154/308] 10.222.0.17 () {58 vars in 1334 bytes} [Fri Aug 19 20:53:13 2022] PUT /identity/v3/system/users/5dd84b768c2e40cbadb6d53c92ed56a0/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:53:14.107867 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36b067-15b3-47ff-ad71-14b1a993d846 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:14.165244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:14.177618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c441-43e9-477e-b34c-0f505af19b4d None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:14.229344 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42504f-b0da-4c35-9ee5-13e1df0f8245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:14.230168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42504f-b0da-4c35-9ee5-13e1df0f8245 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:14.230550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42504f-b0da-4c35-9ee5-13e1df0f8245 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:14.230990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42504f-b0da-4c35-9ee5-13e1df0f8245 None admin] PATH_INFO: `/v3/users/2133e10ef0414dfb8bbb55573dcb10a7` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:14.248253 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42504f-b0da-4c35-9ee5-13e1df0f8245 None admin] RBAC: Authorizing `identity:get_user(user_id=2133e10ef0414dfb8bbb55573dcb10a7)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:14.250271 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42504f-b0da-4c35-9ee5-13e1df0f8245 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:14.252519 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 155/309] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:14 2022] GET /identity/v3/users/2133e10ef0414dfb8bbb55573dcb10a7 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:14.264582 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42504f-b0da-4c35-9ee5-13e1df0f8245 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:14.275794 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:14.291155 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36b067-15b3-47ff-ad71-14b1a993d846 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:14.336597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1e49d-5363-4477-8a61-9239660dac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:14.337250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1e49d-5363-4477-8a61-9239660dac96 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:14.337539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1e49d-5363-4477-8a61-9239660dac96 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:14.337821 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1e49d-5363-4477-8a61-9239660dac96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:14.338969 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1e49d-5363-4477-8a61-9239660dac96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:14.340408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1e49d-5363-4477-8a61-9239660dac96 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:14.342245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 155/310] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:14.347221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1e49d-5363-4477-8a61-9239660dac96 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:14.380534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42504f-b0da-4c35-9ee5-13e1df0f8245 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:14.418422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f794ed-e090-4c9f-9580-cec6fb85b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:14.418982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f794ed-e090-4c9f-9580-cec6fb85b27a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:14.419303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f794ed-e090-4c9f-9580-cec6fb85b27a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:14.420119 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f794ed-e090-4c9f-9580-cec6fb85b27a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:14.421079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f794ed-e090-4c9f-9580-cec6fb85b27a None admin] RBAC: Adding query filter params (role.id=b1ad7360ee8a4c03bc87e2f9121a7d65, user.id=2133e10ef0414dfb8bbb55573dcb10a7, scope.system=all) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:14.421391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f794ed-e090-4c9f-9580-cec6fb85b27a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:14.422855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f794ed-e090-4c9f-9580-cec6fb85b27a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:14.428530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 156/311] 10.222.0.17 () {56 vars in 1308 bytes} [Fri Aug 19 20:53:14 2022] GET /identity/v3/role_assignments?user.id=2133e10ef0414dfb8bbb55573dcb10a7&scope.system=all&role.id=b1ad7360ee8a4c03bc87e2f9121a7d65 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:14.429343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f794ed-e090-4c9f-9580-cec6fb85b27a None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:14.456145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1e49d-5363-4477-8a61-9239660dac96 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:14.462003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:14.501258 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f88ea8-5ede-47c5-a7a1-5048b72656a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:14.501729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88ea8-5ede-47c5-a7a1-5048b72656a0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:14.502019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88ea8-5ede-47c5-a7a1-5048b72656a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:14.502302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88ea8-5ede-47c5-a7a1-5048b72656a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:14.515874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f88ea8-5ede-47c5-a7a1-5048b72656a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-30f88ea8-5ede-47c5-a7a1-5048b72656a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:14.521499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:14.522438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:14.523296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:14.523296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:14.523296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:14.523296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:14.523296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:14.523296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:14.523296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:14.523296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:14.523296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:14.523296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:14.523296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:53:14.523296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:14.523296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 156/312] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:14.530834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f88ea8-5ede-47c5-a7a1-5048b72656a0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:14.556270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:14.586763 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f794ed-e090-4c9f-9580-cec6fb85b27a None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:14.627434 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce1400-bf8e-4b09-aa12-d6a7cae259e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:14.628024 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce1400-bf8e-4b09-aa12-d6a7cae259e8 None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:14.628303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce1400-bf8e-4b09-aa12-d6a7cae259e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:14.628570 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce1400-bf8e-4b09-aa12-d6a7cae259e8 None admin] PATH_INFO: `/v3/groups` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:14.629198 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce1400-bf8e-4b09-aa12-d6a7cae259e8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:14.630902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce1400-bf8e-4b09-aa12-d6a7cae259e8 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:14.654767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 157/313] 10.222.0.17 () {60 vars in 1134 bytes} [Fri Aug 19 20:53:14 2022] POST /identity/v3/groups => generated 229 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:53:14.664343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f88ea8-5ede-47c5-a7a1-5048b72656a0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:14.706174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6468f9e-a933-4394-bbcd-495073dea72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:14.706802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6468f9e-a933-4394-bbcd-495073dea72e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:14.707089 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6468f9e-a933-4394-bbcd-495073dea72e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:14.707362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6468f9e-a933-4394-bbcd-495073dea72e None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:14.708108 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6468f9e-a933-4394-bbcd-495073dea72e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:14.708416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6468f9e-a933-4394-bbcd-495073dea72e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:14.709845 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6468f9e-a933-4394-bbcd-495073dea72e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:14.720924 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 157/314] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:14.727949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce1400-bf8e-4b09-aa12-d6a7cae259e8 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:14.842020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:14.873444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce1400-bf8e-4b09-aa12-d6a7cae259e8 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:14.915073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72070c26-e749-4e62-862a-62492ff4c10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:14.915719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72070c26-e749-4e62-862a-62492ff4c10f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:14.915999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72070c26-e749-4e62-862a-62492ff4c10f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:14.916277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72070c26-e749-4e62-862a-62492ff4c10f None admin] PATH_INFO: `/v3/users/429e42dbfd4f46f884de0977e8a4f288` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:14.917428 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72070c26-e749-4e62-862a-62492ff4c10f None admin] RBAC: Authorizing `identity:get_user(user_id=429e42dbfd4f46f884de0977e8a4f288)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:14.918903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72070c26-e749-4e62-862a-62492ff4c10f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:14.921553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 158/315] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:14 2022] GET /identity/v3/users/429e42dbfd4f46f884de0977e8a4f288 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:14.927083 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6468f9e-a933-4394-bbcd-495073dea72e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:15.014619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:15.040523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6468f9e-a933-4394-bbcd-495073dea72e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:15.078222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83ce38-42ae-4879-ab61-476519e319df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:15.079233 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ce38-42ae-4879-ab61-476519e319df None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:15.079719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ce38-42ae-4879-ab61-476519e319df None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:15.080183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ce38-42ae-4879-ab61-476519e319df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:15.163357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83ce38-42ae-4879-ab61-476519e319df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:15.164826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83ce38-42ae-4879-ab61-476519e319df None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:15.254533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:15.277927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 158/316] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:15.283827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72070c26-e749-4e62-862a-62492ff4c10f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:15.393122 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72070c26-e749-4e62-862a-62492ff4c10f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:15.428964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6d270-37a5-42ee-b6b1-9b98161a50ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:15.429613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6d270-37a5-42ee-b6b1-9b98161a50ba None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:15.429899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6d270-37a5-42ee-b6b1-9b98161a50ba None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:15.430176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6d270-37a5-42ee-b6b1-9b98161a50ba None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:15.431342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6d270-37a5-42ee-b6b1-9b98161a50ba None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:15.432800 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6d270-37a5-42ee-b6b1-9b98161a50ba None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:15.434780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 159/317] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:15 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:15.441485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83ce38-42ae-4879-ab61-476519e319df None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:15.550187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83ce38-42ae-4879-ab61-476519e319df None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:15.593951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791d42a-872c-4241-ba83-f29d059e08a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:15.594606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791d42a-872c-4241-ba83-f29d059e08a6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:15.594922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791d42a-872c-4241-ba83-f29d059e08a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:15.595195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791d42a-872c-4241-ba83-f29d059e08a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:15.595936 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791d42a-872c-4241-ba83-f29d059e08a6 None admin] RBAC: Adding query filter params (role.id=b1ad7360ee8a4c03bc87e2f9121a7d65, scope.project.id=9be09a7606624a74a92f8c33c2919615, user.id=429e42dbfd4f46f884de0977e8a4f288) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:15.596239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791d42a-872c-4241-ba83-f29d059e08a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:15.597687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791d42a-872c-4241-ba83-f29d059e08a6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:15.603804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 159/318] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:53:15 2022] GET /identity/v3/role_assignments?user.id=429e42dbfd4f46f884de0977e8a4f288&scope.project.id=9be09a7606624a74a92f8c33c2919615&role.id=b1ad7360ee8a4c03bc87e2f9121a7d65 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:16.172179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f6fa-f086-4d00-a5cd-fe60ae01650c None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:16.172473 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f6fa-f086-4d00-a5cd-fe60ae01650c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:16.172875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f6fa-f086-4d00-a5cd-fe60ae01650c None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:16.174465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 160/319] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:16.180118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832072a-eb03-4a52-91e3-ca296e17a9f0 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:16.180410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832072a-eb03-4a52-91e3-ca296e17a9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:16.180691 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832072a-eb03-4a52-91e3-ca296e17a9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:16.202047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9832072a-eb03-4a52-91e3-ca296e17a9f0 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:16.203345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9832072a-eb03-4a52-91e3-ca296e17a9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:16.251846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:16.282712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 160/320] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:16.426357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cf729-5592-4b7f-bee7-4d64dcadcfa9 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:16.426863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cf729-5592-4b7f-bee7-4d64dcadcfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:16.426863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cf729-5592-4b7f-bee7-4d64dcadcfa9 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:16.428301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 161/321] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:16.433122 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775a123-0c2f-4ec2-b0c4-c5b614b00271 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:16.433411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775a123-0c2f-4ec2-b0c4-c5b614b00271 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:16.433684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775a123-0c2f-4ec2-b0c4-c5b614b00271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:16.452674 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a775a123-0c2f-4ec2-b0c4-c5b614b00271 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:16.453852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a775a123-0c2f-4ec2-b0c4-c5b614b00271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:16.521060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 161/322] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:16.554309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cf729-5592-4b7f-bee7-4d64dcadcfa9 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:16.571359 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:16.661374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cf729-5592-4b7f-bee7-4d64dcadcfa9 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:16.695390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb5d01-bf54-480d-ac7a-4b2cfb44a736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:16.695951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb5d01-bf54-480d-ac7a-4b2cfb44a736 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:16.696234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb5d01-bf54-480d-ac7a-4b2cfb44a736 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:16.696511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb5d01-bf54-480d-ac7a-4b2cfb44a736 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:16.706757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb5d01-bf54-480d-ac7a-4b2cfb44a736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:16.708299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceb85e-d4f7-400e-a661-086c18904bd1 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:16.708587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceb85e-d4f7-400e-a661-086c18904bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:16.708859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceb85e-d4f7-400e-a661-086c18904bd1 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:16.710183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 162/323] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-ddeb5d01-bf54-480d-ac7a-4b2cfb44a736 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:16.712003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:16.712914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:16.713696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:16.713696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:16.713696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:16.713696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:16.713696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:16.713696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:16.713696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:16.713696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:16.713696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:16.713696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:16.713696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:16.713696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:16.713696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 162/324] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:16.715270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca590f9-e1bc-4bdf-81e9-4db7d007748d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:16.715556 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca590f9-e1bc-4bdf-81e9-4db7d007748d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:16.715889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca590f9-e1bc-4bdf-81e9-4db7d007748d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:16.720216 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb5d01-bf54-480d-ac7a-4b2cfb44a736 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:16.734606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-eca590f9-e1bc-4bdf-81e9-4db7d007748d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:16.735846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-eca590f9-e1bc-4bdf-81e9-4db7d007748d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:16.804171 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:16.815638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 163/325] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:16.816567 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca590f9-e1bc-4bdf-81e9-4db7d007748d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:16.832437 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb5d01-bf54-480d-ac7a-4b2cfb44a736 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:16.851747 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:16.869301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fc26f-5ad8-4fb4-a294-59dc2e1f2717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:16.869911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fc26f-5ad8-4fb4-a294-59dc2e1f2717 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:16.870192 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fc26f-5ad8-4fb4-a294-59dc2e1f2717 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:16.870463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fc26f-5ad8-4fb4-a294-59dc2e1f2717 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:16.871158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fc26f-5ad8-4fb4-a294-59dc2e1f2717 None admin] RBAC: Adding query filter params (name=member) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:16.871467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fc26f-5ad8-4fb4-a294-59dc2e1f2717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:16.873115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fc26f-5ad8-4fb4-a294-59dc2e1f2717 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:16.881977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 163/326] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:16.887506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fc26f-5ad8-4fb4-a294-59dc2e1f2717 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:16.922250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca590f9-e1bc-4bdf-81e9-4db7d007748d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:16.960219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b93d7-d4e2-4519-8468-3d6c93b3c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:16.960790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b93d7-d4e2-4519-8468-3d6c93b3c5ef None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:16.961080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b93d7-d4e2-4519-8468-3d6c93b3c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:16.961332 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b93d7-d4e2-4519-8468-3d6c93b3c5ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:16.973079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b93d7-d4e2-4519-8468-3d6c93b3c5ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-290b93d7-d4e2-4519-8468-3d6c93b3c5ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:16.977916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:16.979056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:16.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:16.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:16.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:16.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:16.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:16.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:16.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:16.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:16.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:16.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:16.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:53:16.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:16.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 164/327] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:16.985730 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b93d7-d4e2-4519-8468-3d6c93b3c5ef None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:16.998653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fc26f-5ad8-4fb4-a294-59dc2e1f2717 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:17.037647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af8c56-d3c3-4aa1-9864-1ffc91044965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:17.038536 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af8c56-d3c3-4aa1-9864-1ffc91044965 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:17.039011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af8c56-d3c3-4aa1-9864-1ffc91044965 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:17.039494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af8c56-d3c3-4aa1-9864-1ffc91044965 None admin] PATH_INFO: `/v3/users/5dd84b768c2e40cbadb6d53c92ed56a0` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:17.040929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af8c56-d3c3-4aa1-9864-1ffc91044965 None admin] RBAC: Authorizing `identity:get_user(user_id=5dd84b768c2e40cbadb6d53c92ed56a0)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:17.042643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af8c56-d3c3-4aa1-9864-1ffc91044965 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:17.044632 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 164/328] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:16 2022] GET /identity/v3/users/5dd84b768c2e40cbadb6d53c92ed56a0 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:17.050615 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af8c56-d3c3-4aa1-9864-1ffc91044965 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:17.054931 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:17.094254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:17.099884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b93d7-d4e2-4519-8468-3d6c93b3c5ef None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:17.136412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aae2f-2dcd-4830-9f84-90c1c1227832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:17.137019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aae2f-2dcd-4830-9f84-90c1c1227832 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:17.137436 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aae2f-2dcd-4830-9f84-90c1c1227832 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:17.137559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aae2f-2dcd-4830-9f84-90c1c1227832 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:17.138995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aae2f-2dcd-4830-9f84-90c1c1227832 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:17.139302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aae2f-2dcd-4830-9f84-90c1c1227832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:17.140678 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aae2f-2dcd-4830-9f84-90c1c1227832 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:17.149031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 165/329] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:17.149666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aae2f-2dcd-4830-9f84-90c1c1227832 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:17.159328 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af8c56-d3c3-4aa1-9864-1ffc91044965 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:17.196755 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc7988-f408-4e89-ba69-fc5ac00a9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:17.197832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc7988-f408-4e89-ba69-fc5ac00a9ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:17.198308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc7988-f408-4e89-ba69-fc5ac00a9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:17.198861 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc7988-f408-4e89-ba69-fc5ac00a9ff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:17.200217 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc7988-f408-4e89-ba69-fc5ac00a9ff1 None admin] RBAC: Adding query filter params (role.id=40d451ce7e0143e682ac5d43622c57d2, user.id=5dd84b768c2e40cbadb6d53c92ed56a0, scope.system=all) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:17.200848 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc7988-f408-4e89-ba69-fc5ac00a9ff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:17.203351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc7988-f408-4e89-ba69-fc5ac00a9ff1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:17.219235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 165/330] 10.222.0.17 () {56 vars in 1308 bytes} [Fri Aug 19 20:53:17 2022] GET /identity/v3/role_assignments?user.id=5dd84b768c2e40cbadb6d53c92ed56a0&scope.system=all&role.id=40d451ce7e0143e682ac5d43622c57d2 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:17.220508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc7988-f408-4e89-ba69-fc5ac00a9ff1 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:17.275125 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aae2f-2dcd-4830-9f84-90c1c1227832 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:17.302608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:17.318908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f185e54-371f-47ee-a967-ef7004735ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:17.319608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f185e54-371f-47ee-a967-ef7004735ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:17.319855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f185e54-371f-47ee-a967-ef7004735ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:17.320135 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f185e54-371f-47ee-a967-ef7004735ca6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:17.322067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f185e54-371f-47ee-a967-ef7004735ca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:17.324166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f185e54-371f-47ee-a967-ef7004735ca6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:17.330799 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 166/331] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:17.332790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f185e54-371f-47ee-a967-ef7004735ca6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:17.355479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc7988-f408-4e89-ba69-fc5ac00a9ff1 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:17.364649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:17.405007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a2226-8457-4a80-9156-3be06ede2325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:17.405799 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a2226-8457-4a80-9156-3be06ede2325 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:17.406089 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a2226-8457-4a80-9156-3be06ede2325 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:17.406376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a2226-8457-4a80-9156-3be06ede2325 None admin] PATH_INFO: `/v3/users/2133e10ef0414dfb8bbb55573dcb10a7` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:17.408718 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a2226-8457-4a80-9156-3be06ede2325 None admin] RBAC: Authorizing `identity:get_user(user_id=2133e10ef0414dfb8bbb55573dcb10a7)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:17.410226 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a2226-8457-4a80-9156-3be06ede2325 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:17.411978 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 166/332] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:17 2022] GET /identity/v3/users/2133e10ef0414dfb8bbb55573dcb10a7 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:17.417811 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a2226-8457-4a80-9156-3be06ede2325 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:17.461618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f185e54-371f-47ee-a967-ef7004735ca6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:17.497041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe729d51-6570-4540-8c93-83377f23365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:17.498156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe729d51-6570-4540-8c93-83377f23365f None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:17.498437 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe729d51-6570-4540-8c93-83377f23365f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:17.498716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe729d51-6570-4540-8c93-83377f23365f None admin] PATH_INFO: `/v3/groups` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:17.499394 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe729d51-6570-4540-8c93-83377f23365f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:17.500855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe729d51-6570-4540-8c93-83377f23365f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:17.518056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 167/333] 10.222.0.17 () {60 vars in 1134 bytes} [Fri Aug 19 20:53:17 2022] POST /identity/v3/groups => generated 226 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:53:17.531437 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a2226-8457-4a80-9156-3be06ede2325 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:17.568960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:17.575774 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1111dd-b08b-4c93-a85a-40dbb8c37828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:17.576466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1111dd-b08b-4c93-a85a-40dbb8c37828 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:17.576744 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1111dd-b08b-4c93-a85a-40dbb8c37828 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:17.577024 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1111dd-b08b-4c93-a85a-40dbb8c37828 None admin] PATH_INFO: `/v3/system/users/2133e10ef0414dfb8bbb55573dcb10a7/roles/b1ad7360ee8a4c03bc87e2f9121a7d65` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:17.578538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1111dd-b08b-4c93-a85a-40dbb8c37828 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2133e10ef0414dfb8bbb55573dcb10a7, role_id=b1ad7360ee8a4c03bc87e2f9121a7d65)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:17.579991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1111dd-b08b-4c93-a85a-40dbb8c37828 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:17.597650 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 167/334] 10.222.0.17 () {58 vars in 1334 bytes} [Fri Aug 19 20:53:17 2022] PUT /identity/v3/system/users/2133e10ef0414dfb8bbb55573dcb10a7/roles/b1ad7360ee8a4c03bc87e2f9121a7d65 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 20:53:19.731396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c9249-a95e-42a7-adb4-c1cc6a31d68f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:19.732824 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c9249-a95e-42a7-adb4-c1cc6a31d68f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:19.732824 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c9249-a95e-42a7-adb4-c1cc6a31d68f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:19.734165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 168/335] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:19.743200 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c37eb-cb9d-49b0-834e-b8733be132fc None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:19.743200 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c37eb-cb9d-49b0-834e-b8733be132fc None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:19.743200 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c37eb-cb9d-49b0-834e-b8733be132fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:19.767897 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-fe6c37eb-cb9d-49b0-834e-b8733be132fc None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:19.769127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-fe6c37eb-cb9d-49b0-834e-b8733be132fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:19.831225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e6296-aa2f-4ce0-ac81-17ef4fa3876b None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:19.831890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e6296-aa2f-4ce0-ac81-17ef4fa3876b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:19.832386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e6296-aa2f-4ce0-ac81-17ef4fa3876b None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:19.833933 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 169/336] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:53:19.839590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f672638-123f-43d5-a903-96de6204a29e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:19.840178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f672638-123f-43d5-a903-96de6204a29e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:19.840676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f672638-123f-43d5-a903-96de6204a29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:19.878868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-0f672638-123f-43d5-a903-96de6204a29e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:19.882096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0f672638-123f-43d5-a903-96de6204a29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:19.895303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 168/337] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:19.978608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 170/338] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:20.438553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0927a5-dbea-478f-8fd6-84a7e70a0c62 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:20.439294 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0927a5-dbea-478f-8fd6-84a7e70a0c62 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:20.439791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0927a5-dbea-478f-8fd6-84a7e70a0c62 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:20.441631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 169/339] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:20.447138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97db4b-32a5-4b70-8e05-58a627c32e1f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:20.447783 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97db4b-32a5-4b70-8e05-58a627c32e1f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:20.448278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97db4b-32a5-4b70-8e05-58a627c32e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:20.466796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0927a5-dbea-478f-8fd6-84a7e70a0c62 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:20.478423 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7d97db4b-32a5-4b70-8e05-58a627c32e1f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:20.479661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7d97db4b-32a5-4b70-8e05-58a627c32e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:20.502705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:20.587336 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0927a5-dbea-478f-8fd6-84a7e70a0c62 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:20.590459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 171/340] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:20.595839 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97db4b-32a5-4b70-8e05-58a627c32e1f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:20.650723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:20.685579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25dc17-3954-4bff-a99d-2d8dfbc21a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:20.686674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25dc17-3954-4bff-a99d-2d8dfbc21a40 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:20.687212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25dc17-3954-4bff-a99d-2d8dfbc21a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:20.687695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25dc17-3954-4bff-a99d-2d8dfbc21a40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:20.712506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25dc17-3954-4bff-a99d-2d8dfbc21a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-eb25dc17-3954-4bff-a99d-2d8dfbc21a40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:20.718666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:20.719670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:20.720491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:20.720491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:20.720491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:20.720491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:20.720491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:20.720491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:20.720491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:20.720491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:20.720491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:20.720491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:20.720491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:20.720491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:20.729739 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 170/341] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:53:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:20.736326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd732bfe-c34a-418e-b90a-5439a529759b None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:20.737818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd732bfe-c34a-418e-b90a-5439a529759b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:20.739033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd732bfe-c34a-418e-b90a-5439a529759b None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:20.740764 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 171/342] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:20.743002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd732bfe-c34a-418e-b90a-5439a529759b None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:20.848842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97db4b-32a5-4b70-8e05-58a627c32e1f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:20.921324 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5054c9-71fc-4227-bd8a-c7c8d804ef06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:20.921972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5054c9-71fc-4227-bd8a-c7c8d804ef06 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:20.922255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5054c9-71fc-4227-bd8a-c7c8d804ef06 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:20.922529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5054c9-71fc-4227-bd8a-c7c8d804ef06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:20.944304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5054c9-71fc-4227-bd8a-c7c8d804ef06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:20.946963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd732bfe-c34a-418e-b90a-5439a529759b None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-5a5054c9-71fc-4227-bd8a-c7c8d804ef06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:20.958197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:20.960035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:20.961668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:20.961668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:20.961668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:20.961668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:20.961668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:20.961668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:20.961668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:20.961668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:20.961668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:20.961668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:20.961668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:20.961668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:20.965515 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 172/343] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:20.965790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630324-b7f3-4233-8d83-ca1bed7e04b8 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:20.966574 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630324-b7f3-4233-8d83-ca1bed7e04b8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:20.968334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630324-b7f3-4233-8d83-ca1bed7e04b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:20.991120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:20.994106 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-88630324-b7f3-4233-8d83-ca1bed7e04b8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:20.995772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-88630324-b7f3-4233-8d83-ca1bed7e04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:21.001467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bce48-55a4-4e0e-b1ca-14d50a045e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:21.002093 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bce48-55a4-4e0e-b1ca-14d50a045e79 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:21.002366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bce48-55a4-4e0e-b1ca-14d50a045e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:21.002631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bce48-55a4-4e0e-b1ca-14d50a045e79 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:21.003396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bce48-55a4-4e0e-b1ca-14d50a045e79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:21.003701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bce48-55a4-4e0e-b1ca-14d50a045e79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:21.005502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bce48-55a4-4e0e-b1ca-14d50a045e79 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:21.017018 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 172/344] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:21.018006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bce48-55a4-4e0e-b1ca-14d50a045e79 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:21.073587 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:21.075913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 173/345] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:21.076852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88630324-b7f3-4233-8d83-ca1bed7e04b8 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:21.142213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bce48-55a4-4e0e-b1ca-14d50a045e79 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:21.184197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58523b1a-0768-4ac5-bc84-0e4dcffc3c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:21.185426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58523b1a-0768-4ac5-bc84-0e4dcffc3c75 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:21.185716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58523b1a-0768-4ac5-bc84-0e4dcffc3c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:21.186560 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58523b1a-0768-4ac5-bc84-0e4dcffc3c75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:21.205052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58523b1a-0768-4ac5-bc84-0e4dcffc3c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-58523b1a-0768-4ac5-bc84-0e4dcffc3c75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:21.213770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:21.215695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:21.217304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:21.217304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:21.217304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:21.217304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:21.217304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:21.217304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:21.217304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:21.217304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:21.217304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:21.217304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:21.217304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 20:53:21.217304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:21.217304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 173/346] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:21.218801 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58523b1a-0768-4ac5-bc84-0e4dcffc3c75 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:21.237164 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88630324-b7f3-4233-8d83-ca1bed7e04b8 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:21.278191 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08043b94-d14e-4c5e-b574-aa1d1fa56c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:21.279249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08043b94-d14e-4c5e-b574-aa1d1fa56c9f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:21.279528 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08043b94-d14e-4c5e-b574-aa1d1fa56c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:21.280260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08043b94-d14e-4c5e-b574-aa1d1fa56c9f None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:21.281160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08043b94-d14e-4c5e-b574-aa1d1fa56c9f None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:21.281478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08043b94-d14e-4c5e-b574-aa1d1fa56c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:21.282956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08043b94-d14e-4c5e-b574-aa1d1fa56c9f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:21.290111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:21.294030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 174/347] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:21.295662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08043b94-d14e-4c5e-b574-aa1d1fa56c9f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:21.421210 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08043b94-d14e-4c5e-b574-aa1d1fa56c9f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:21.458852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc1c4-81ed-4fdc-81f8-c6832c97762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:21.459637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc1c4-81ed-4fdc-81f8-c6832c97762a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:21.460043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc1c4-81ed-4fdc-81f8-c6832c97762a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:21.460323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc1c4-81ed-4fdc-81f8-c6832c97762a None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:21.461006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc1c4-81ed-4fdc-81f8-c6832c97762a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:21.461314 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc1c4-81ed-4fdc-81f8-c6832c97762a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:21.462687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc1c4-81ed-4fdc-81f8-c6832c97762a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:21.473508 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 175/348] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:21.474308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc1c4-81ed-4fdc-81f8-c6832c97762a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:21.528101 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58523b1a-0768-4ac5-bc84-0e4dcffc3c75 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:21.545025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:21.550572 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:21.601015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc1c4-81ed-4fdc-81f8-c6832c97762a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:21.604679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73fb81-28af-4126-b7ea-05efeb91aeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:21.605320 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73fb81-28af-4126-b7ea-05efeb91aeee None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:21.605601 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73fb81-28af-4126-b7ea-05efeb91aeee None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:21.605893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73fb81-28af-4126-b7ea-05efeb91aeee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:21.650245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3704ebc-8341-4715-a76e-139154b8554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:21.650912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3704ebc-8341-4715-a76e-139154b8554f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:21.651198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3704ebc-8341-4715-a76e-139154b8554f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:21.651478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3704ebc-8341-4715-a76e-139154b8554f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:21.690441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73fb81-28af-4126-b7ea-05efeb91aeee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:21.692034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73fb81-28af-4126-b7ea-05efeb91aeee None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:21.739199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3704ebc-8341-4715-a76e-139154b8554f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:21.742254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3704ebc-8341-4715-a76e-139154b8554f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:21.823691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 174/349] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:21.824566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73fb81-28af-4126-b7ea-05efeb91aeee None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:21.824877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:21.835757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:21.866700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 176/350] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:21.868424 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3704ebc-8341-4715-a76e-139154b8554f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:21.960313 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73fb81-28af-4126-b7ea-05efeb91aeee None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:22.010016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3704ebc-8341-4715-a76e-139154b8554f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:22.010707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b4352-d1e9-489b-a963-e731d9b58214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:22.011422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b4352-d1e9-489b-a963-e731d9b58214 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:22.012032 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b4352-d1e9-489b-a963-e731d9b58214 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:22.012323 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b4352-d1e9-489b-a963-e731d9b58214 None admin] PATH_INFO: `/v3/users/2133e10ef0414dfb8bbb55573dcb10a7` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:22.015438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b4352-d1e9-489b-a963-e731d9b58214 None admin] RBAC: Authorizing `identity:get_user(user_id=2133e10ef0414dfb8bbb55573dcb10a7)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:22.016932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b4352-d1e9-489b-a963-e731d9b58214 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:22.019026 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 175/351] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:53:21 2022] GET /identity/v3/users/2133e10ef0414dfb8bbb55573dcb10a7 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:22.020646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b4352-d1e9-489b-a963-e731d9b58214 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:22.073539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2634fb5-1a33-40f3-804f-325b077d4b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:22.074634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2634fb5-1a33-40f3-804f-325b077d4b2e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:22.074988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2634fb5-1a33-40f3-804f-325b077d4b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:22.075273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2634fb5-1a33-40f3-804f-325b077d4b2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:22.090876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2634fb5-1a33-40f3-804f-325b077d4b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-e2634fb5-1a33-40f3-804f-325b077d4b2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:22.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:22.099059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:22.099847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:22.099847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:22.099847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:22.099847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:22.099847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:22.099847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:22.099847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:22.099847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:22.099847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:22.099847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:22.099847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:22.099847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:22.099847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 177/352] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:22.101170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2634fb5-1a33-40f3-804f-325b077d4b2e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:22.132731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:22.139627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:22.173274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b4352-d1e9-489b-a963-e731d9b58214 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:22.215778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fe752-387e-4cfa-bf3d-ec93dd713f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:22.216042 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fe752-387e-4cfa-bf3d-ec93dd713f77 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:22.217332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fe752-387e-4cfa-bf3d-ec93dd713f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:22.217332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fe752-387e-4cfa-bf3d-ec93dd713f77 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:22.218529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fe752-387e-4cfa-bf3d-ec93dd713f77 None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:22.220052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fe752-387e-4cfa-bf3d-ec93dd713f77 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:22.221903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 176/353] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:22 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:22.226537 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fe752-387e-4cfa-bf3d-ec93dd713f77 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:22.272209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2634fb5-1a33-40f3-804f-325b077d4b2e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:22.318080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925f8ee-9757-44b5-8b39-0f321b5152d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:22.318080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925f8ee-9757-44b5-8b39-0f321b5152d4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:22.318390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925f8ee-9757-44b5-8b39-0f321b5152d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:22.318476 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925f8ee-9757-44b5-8b39-0f321b5152d4 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:22.319640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925f8ee-9757-44b5-8b39-0f321b5152d4 None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:22.321100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925f8ee-9757-44b5-8b39-0f321b5152d4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:22.322758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 178/354] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:22 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:22.323539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925f8ee-9757-44b5-8b39-0f321b5152d4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:22.360713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fe752-387e-4cfa-bf3d-ec93dd713f77 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:22.404224 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a73b68-00ff-4bd0-9cc6-fb274042472e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:22.404912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a73b68-00ff-4bd0-9cc6-fb274042472e None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:22.405195 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a73b68-00ff-4bd0-9cc6-fb274042472e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:22.405469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a73b68-00ff-4bd0-9cc6-fb274042472e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:22.406218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a73b68-00ff-4bd0-9cc6-fb274042472e None admin] RBAC: Adding query filter params (role.id=b1ad7360ee8a4c03bc87e2f9121a7d65, user.id=2133e10ef0414dfb8bbb55573dcb10a7, scope.system=all) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:22.406533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a73b68-00ff-4bd0-9cc6-fb274042472e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:22.408017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a73b68-00ff-4bd0-9cc6-fb274042472e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:22.418560 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:22.425076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 177/355] 10.222.0.17 () {56 vars in 1308 bytes} [Fri Aug 19 20:53:22 2022] GET /identity/v3/role_assignments?user.id=2133e10ef0414dfb8bbb55573dcb10a7&scope.system=all&role.id=b1ad7360ee8a4c03bc87e2f9121a7d65 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:22.425974 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a73b68-00ff-4bd0-9cc6-fb274042472e None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:22.432966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:22.456656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925f8ee-9757-44b5-8b39-0f321b5152d4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:22.513885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530e957-7385-4ba3-8e3e-87c6a066f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:22.514630 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530e957-7385-4ba3-8e3e-87c6a066f5ed None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:22.514975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530e957-7385-4ba3-8e3e-87c6a066f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:22.515261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530e957-7385-4ba3-8e3e-87c6a066f5ed None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:22.515956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530e957-7385-4ba3-8e3e-87c6a066f5ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:22.516269 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530e957-7385-4ba3-8e3e-87c6a066f5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:22.517700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530e957-7385-4ba3-8e3e-87c6a066f5ed None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:22.530865 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 179/356] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:22.531903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed73d6-cbe5-428c-8a41-50576be3e4bb None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:22.532196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed73d6-cbe5-428c-8a41-50576be3e4bb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:22.532472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed73d6-cbe5-428c-8a41-50576be3e4bb None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:22.536208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 180/357] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:22.536208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271993e-fe7e-487c-923b-ceb5132d26bd None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:22.536208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271993e-fe7e-487c-923b-ceb5132d26bd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:22.536208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271993e-fe7e-487c-923b-ceb5132d26bd None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:22.537699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 181/358] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:22.537904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271993e-fe7e-487c-923b-ceb5132d26bd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:22.584188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a73b68-00ff-4bd0-9cc6-fb274042472e None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:22.630280 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad54020-139c-4213-954f-c051655e0653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:22.630969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad54020-139c-4213-954f-c051655e0653 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:22.631258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad54020-139c-4213-954f-c051655e0653 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:22.631540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad54020-139c-4213-954f-c051655e0653 None admin] PATH_INFO: `/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:22.640635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad54020-139c-4213-954f-c051655e0653 None admin] RBAC: Authorizing `identity:get_group(group_id=ae3d7ae4c4074b48b787f32e35244b1b)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:22.642111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad54020-139c-4213-954f-c051655e0653 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:22.644586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 178/359] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:22 2022] GET /identity/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:22.645691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad54020-139c-4213-954f-c051655e0653 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:22.676910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271993e-fe7e-487c-923b-ceb5132d26bd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:22.721405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:22.721911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfa2ca-76e6-4d49-a752-b0e24c178bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:22.722561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfa2ca-76e6-4d49-a752-b0e24c178bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:22.723017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfa2ca-76e6-4d49-a752-b0e24c178bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:22.723137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfa2ca-76e6-4d49-a752-b0e24c178bc3 None admin] PATH_INFO: `/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:22.725034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfa2ca-76e6-4d49-a752-b0e24c178bc3 None admin] RBAC: Authorizing `identity:get_group(group_id=ae3d7ae4c4074b48b787f32e35244b1b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:22.726624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfa2ca-76e6-4d49-a752-b0e24c178bc3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:22.728253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 182/360] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:22 2022] GET /identity/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:22.729385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851cbf3-9d66-4e40-a46d-6090dd2aeef5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:22.729729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851cbf3-9d66-4e40-a46d-6090dd2aeef5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:22.730165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851cbf3-9d66-4e40-a46d-6090dd2aeef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:22.755510 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5851cbf3-9d66-4e40-a46d-6090dd2aeef5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:22.756713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5851cbf3-9d66-4e40-a46d-6090dd2aeef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:22.774471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:22.777436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad54020-139c-4213-954f-c051655e0653 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:22.825203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72062b-861d-4a5a-8c14-d789b0c016af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:22.826394 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72062b-861d-4a5a-8c14-d789b0c016af None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:22.826675 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72062b-861d-4a5a-8c14-d789b0c016af None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:22.826976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72062b-861d-4a5a-8c14-d789b0c016af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:22.850080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 183/361] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:22.851565 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c9a3a-d327-419d-b4a8-af431cff26e9 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:22.851678 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c9a3a-d327-419d-b4a8-af431cff26e9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:22.851912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c9a3a-d327-419d-b4a8-af431cff26e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:22.872728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d03c9a3a-d327-419d-b4a8-af431cff26e9 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:22.874892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d03c9a3a-d327-419d-b4a8-af431cff26e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:22.915374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72062b-861d-4a5a-8c14-d789b0c016af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:22.917370 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72062b-861d-4a5a-8c14-d789b0c016af None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:22.974190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 184/362] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:22.975190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c9a3a-d327-419d-b4a8-af431cff26e9 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:23.002585 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:23.055019 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 179/363] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:23.055997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72062b-861d-4a5a-8c14-d789b0c016af None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:23.090412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:23.122041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c9a3a-d327-419d-b4a8-af431cff26e9 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:23.168404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db99fdb-c366-4317-b96e-598dd4c29557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:23.169018 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db99fdb-c366-4317-b96e-598dd4c29557 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:23.169456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db99fdb-c366-4317-b96e-598dd4c29557 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:23.169741 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db99fdb-c366-4317-b96e-598dd4c29557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:23.170657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db99fdb-c366-4317-b96e-598dd4c29557 None admin] RBAC: Adding query filter params (group.id=ae3d7ae4c4074b48b787f32e35244b1b, role.id=0fdbf18b17e545d9929e22ebddc1d5b7, scope.project.id=90fb40089787468fac42f2a8bafe87dc) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:23.170995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db99fdb-c366-4317-b96e-598dd4c29557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:23.172441 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db99fdb-c366-4317-b96e-598dd4c29557 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:23.181769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 185/364] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Aug 19 20:53:22 2022] GET /identity/v3/role_assignments?group.id=ae3d7ae4c4074b48b787f32e35244b1b&scope.project.id=90fb40089787468fac42f2a8bafe87dc&role.id=0fdbf18b17e545d9929e22ebddc1d5b7 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:23.181769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db99fdb-c366-4317-b96e-598dd4c29557 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:23.213728 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72062b-861d-4a5a-8c14-d789b0c016af None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:23.262391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e241cf-5824-4756-bdc4-f52dd900649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:23.263580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e241cf-5824-4756-bdc4-f52dd900649c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:23.264005 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e241cf-5824-4756-bdc4-f52dd900649c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:23.264355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e241cf-5824-4756-bdc4-f52dd900649c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:23.265187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e241cf-5824-4756-bdc4-f52dd900649c None admin] RBAC: Adding query filter params (group.id=ae3d7ae4c4074b48b787f32e35244b1b, role.id=40d451ce7e0143e682ac5d43622c57d2, scope.project.id=90fb40089787468fac42f2a8bafe87dc) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:23.265571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e241cf-5824-4756-bdc4-f52dd900649c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:23.268184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e241cf-5824-4756-bdc4-f52dd900649c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:23.274614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 180/365] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Aug 19 20:53:23 2022] GET /identity/v3/role_assignments?group.id=ae3d7ae4c4074b48b787f32e35244b1b&scope.project.id=90fb40089787468fac42f2a8bafe87dc&role.id=40d451ce7e0143e682ac5d43622c57d2 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:23.275588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e241cf-5824-4756-bdc4-f52dd900649c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:23.319141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db99fdb-c366-4317-b96e-598dd4c29557 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:23.321482 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:23.381705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ed339-ccc8-4e2d-843e-e49f83e9b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:23.382669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ed339-ccc8-4e2d-843e-e49f83e9b2ec None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:23.382996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ed339-ccc8-4e2d-843e-e49f83e9b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:23.383279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ed339-ccc8-4e2d-843e-e49f83e9b2ec None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:23.384684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ed339-ccc8-4e2d-843e-e49f83e9b2ec None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:23.387426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ed339-ccc8-4e2d-843e-e49f83e9b2ec None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:23.390271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 186/366] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:23 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:23.393317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ed339-ccc8-4e2d-843e-e49f83e9b2ec None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:23.413563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:23.441562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e241cf-5824-4756-bdc4-f52dd900649c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:23.501044 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503b988-e9fe-45f8-95d0-674a2bdf8d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:23.501726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503b988-e9fe-45f8-95d0-674a2bdf8d44 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:23.502031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503b988-e9fe-45f8-95d0-674a2bdf8d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:23.502351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503b988-e9fe-45f8-95d0-674a2bdf8d44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:23.521219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503b988-e9fe-45f8-95d0-674a2bdf8d44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-4503b988-e9fe-45f8-95d0-674a2bdf8d44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:23.531688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:23.532670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 181/367] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:53:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:23.533488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503b988-e9fe-45f8-95d0-674a2bdf8d44 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:23.557016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ed339-ccc8-4e2d-843e-e49f83e9b2ec None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:23.603942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc72fac-8f2a-432f-a2b9-73a5b9f72d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:23.605027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc72fac-8f2a-432f-a2b9-73a5b9f72d4a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:23.605455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc72fac-8f2a-432f-a2b9-73a5b9f72d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:23.605852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc72fac-8f2a-432f-a2b9-73a5b9f72d4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:23.619264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc72fac-8f2a-432f-a2b9-73a5b9f72d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-7dc72fac-8f2a-432f-a2b9-73a5b9f72d4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:23.626290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:23.627281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:23.628082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:23.628082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:23.628082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:23.628082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:23.628082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:23.628082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:23.628082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:23.628082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:23.628082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:23.628082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:23.628082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:23.628082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:23.628082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 187/368] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:53:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:23.628747 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc72fac-8f2a-432f-a2b9-73a5b9f72d4a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:23.664520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:23.678793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503b988-e9fe-45f8-95d0-674a2bdf8d44 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:23.717391 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:23.718808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ff147-0bba-43d7-a3e0-4d4bcdcb22e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:23.719627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ff147-0bba-43d7-a3e0-4d4bcdcb22e6 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:23.720064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ff147-0bba-43d7-a3e0-4d4bcdcb22e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:23.720652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ff147-0bba-43d7-a3e0-4d4bcdcb22e6 None admin] PATH_INFO: `/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:23.721891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ff147-0bba-43d7-a3e0-4d4bcdcb22e6 None admin] RBAC: Authorizing `identity:get_group(group_id=ae3d7ae4c4074b48b787f32e35244b1b)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:23.723545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ff147-0bba-43d7-a3e0-4d4bcdcb22e6 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:23.725298 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 182/369] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:23 2022] GET /identity/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:23.726246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ff147-0bba-43d7-a3e0-4d4bcdcb22e6 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:23.755443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc72fac-8f2a-432f-a2b9-73a5b9f72d4a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:23.800533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4ef37-f574-43fb-b7bc-5b4d2e1537c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:23.801159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4ef37-f574-43fb-b7bc-5b4d2e1537c3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:23.801461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4ef37-f574-43fb-b7bc-5b4d2e1537c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:23.801709 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4ef37-f574-43fb-b7bc-5b4d2e1537c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:23.802444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4ef37-f574-43fb-b7bc-5b4d2e1537c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:23.802767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4ef37-f574-43fb-b7bc-5b4d2e1537c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:23.804276 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4ef37-f574-43fb-b7bc-5b4d2e1537c3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:23.814578 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 188/370] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:23.815473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4ef37-f574-43fb-b7bc-5b4d2e1537c3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:23.847083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ff147-0bba-43d7-a3e0-4d4bcdcb22e6 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:23.885840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782c022-26cd-46a1-b7d9-d791d001a8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:23.886803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782c022-26cd-46a1-b7d9-d791d001a8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:23.887253 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782c022-26cd-46a1-b7d9-d791d001a8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:23.887711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782c022-26cd-46a1-b7d9-d791d001a8e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:23.889116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782c022-26cd-46a1-b7d9-d791d001a8e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:23.889573 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782c022-26cd-46a1-b7d9-d791d001a8e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:23.891134 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782c022-26cd-46a1-b7d9-d791d001a8e4 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:23.900780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 183/371] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:23.901844 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782c022-26cd-46a1-b7d9-d791d001a8e4 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:23.924104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:23.963126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4ef37-f574-43fb-b7bc-5b4d2e1537c3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:23.995994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:24.003986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bdb83-e053-4fa0-9cac-c2373c47616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:24.004609 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bdb83-e053-4fa0-9cac-c2373c47616e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:24.005149 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bdb83-e053-4fa0-9cac-c2373c47616e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:24.005424 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bdb83-e053-4fa0-9cac-c2373c47616e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:24.006345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bdb83-e053-4fa0-9cac-c2373c47616e None admin] RBAC: Adding query filter params (group.id=ae3d7ae4c4074b48b787f32e35244b1b, role.id=40d451ce7e0143e682ac5d43622c57d2, scope.project.id=9be09a7606624a74a92f8c33c2919615) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:24.006657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bdb83-e053-4fa0-9cac-c2373c47616e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:24.008882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bdb83-e053-4fa0-9cac-c2373c47616e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:24.016992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782c022-26cd-46a1-b7d9-d791d001a8e4 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:24.017525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 189/372] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Aug 19 20:53:23 2022] GET /identity/v3/role_assignments?group.id=ae3d7ae4c4074b48b787f32e35244b1b&scope.project.id=9be09a7606624a74a92f8c33c2919615&role.id=40d451ce7e0143e682ac5d43622c57d2 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:24.018170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bdb83-e053-4fa0-9cac-c2373c47616e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:24.069340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84468ef2-387d-4e31-8424-489c0314f747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:24.070363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84468ef2-387d-4e31-8424-489c0314f747 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:24.070928 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84468ef2-387d-4e31-8424-489c0314f747 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:24.071469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84468ef2-387d-4e31-8424-489c0314f747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:24.163333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bdb83-e053-4fa0-9cac-c2373c47616e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:24.182837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84468ef2-387d-4e31-8424-489c0314f747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:24.184587 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84468ef2-387d-4e31-8424-489c0314f747 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:24.218361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:24.219892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded4ec2-4bcb-4747-b509-4210f1ee09cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:24.220825 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4ec2-4bcb-4747-b509-4210f1ee09cb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:24.221371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4ec2-4bcb-4747-b509-4210f1ee09cb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:24.221856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4ec2-4bcb-4747-b509-4210f1ee09cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:24.341158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 184/373] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:24.346767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84468ef2-387d-4e31-8424-489c0314f747 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:24.391277 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:24.405179 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded4ec2-4bcb-4747-b509-4210f1ee09cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:24.406664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded4ec2-4bcb-4747-b509-4210f1ee09cb None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:24.571814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84468ef2-387d-4e31-8424-489c0314f747 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:24.624813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:24.649752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 190/374] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:24.661009 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded4ec2-4bcb-4747-b509-4210f1ee09cb None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:24.665866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d1660-0db9-47dc-8025-bca8195894ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:24.666878 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d1660-0db9-47dc-8025-bca8195894ba None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:24.667420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d1660-0db9-47dc-8025-bca8195894ba None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:24.667908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d1660-0db9-47dc-8025-bca8195894ba None admin] PATH_INFO: `/v3/projects/ff8263e17f324e50a27d4a90ba61dbe6` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:24.669392 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d1660-0db9-47dc-8025-bca8195894ba None admin] RBAC: Authorizing `identity:get_project(project_id=ff8263e17f324e50a27d4a90ba61dbe6)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:24.671118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d1660-0db9-47dc-8025-bca8195894ba None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:24.673470 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 185/375] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:24 2022] GET /identity/v3/projects/ff8263e17f324e50a27d4a90ba61dbe6 => generated 344 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:24.680487 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d1660-0db9-47dc-8025-bca8195894ba None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:24.790466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:24.799929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded4ec2-4bcb-4747-b509-4210f1ee09cb None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:24.843900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420c6d9-e563-4e75-9181-f7e8acc62745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:24.844449 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420c6d9-e563-4e75-9181-f7e8acc62745 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:24.844728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420c6d9-e563-4e75-9181-f7e8acc62745 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:24.845140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420c6d9-e563-4e75-9181-f7e8acc62745 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:24.847220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420c6d9-e563-4e75-9181-f7e8acc62745 None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:24.848412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420c6d9-e563-4e75-9181-f7e8acc62745 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:24.854761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 191/376] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:24 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:24.860063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420c6d9-e563-4e75-9181-f7e8acc62745 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:24.898856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d1660-0db9-47dc-8025-bca8195894ba None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:24.995464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071be48-2ade-46e8-a5f4-93453c2b38d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:24.996130 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071be48-2ade-46e8-a5f4-93453c2b38d5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:24.996420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071be48-2ade-46e8-a5f4-93453c2b38d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:24.996702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071be48-2ade-46e8-a5f4-93453c2b38d5 None admin] PATH_INFO: `/v3/groups/ec1ee4f520bd437ab0a2b3c1bb574932` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:25.012309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071be48-2ade-46e8-a5f4-93453c2b38d5 None admin] RBAC: Authorizing `identity:get_group(group_id=ec1ee4f520bd437ab0a2b3c1bb574932)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:25.014674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071be48-2ade-46e8-a5f4-93453c2b38d5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:25.016755 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 186/377] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:24 2022] GET /identity/v3/groups/ec1ee4f520bd437ab0a2b3c1bb574932 => generated 229 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:25.017572 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420c6d9-e563-4e75-9181-f7e8acc62745 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:25.023112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071be48-2ade-46e8-a5f4-93453c2b38d5 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:25.062603 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c84c0-7446-4e99-a56f-c953bbd75735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:25.063287 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c84c0-7446-4e99-a56f-c953bbd75735 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:25.063573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c84c0-7446-4e99-a56f-c953bbd75735 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:25.063852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c84c0-7446-4e99-a56f-c953bbd75735 None admin] PATH_INFO: `/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:25.065998 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c84c0-7446-4e99-a56f-c953bbd75735 None admin] RBAC: Authorizing `identity:get_group(group_id=ae3d7ae4c4074b48b787f32e35244b1b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:25.067494 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c84c0-7446-4e99-a56f-c953bbd75735 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:25.069415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 192/378] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:24 2022] GET /identity/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:25.075268 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c84c0-7446-4e99-a56f-c953bbd75735 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:25.130377 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:25.152091 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:25.222221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c84c0-7446-4e99-a56f-c953bbd75735 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:25.229862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071be48-2ade-46e8-a5f4-93453c2b38d5 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:25.267312 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b8750-adbf-499f-a0b5-9ac4100e7797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:25.269534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4a38f-4fc1-4114-8d6f-1fa4c6744464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:25.270067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b8750-adbf-499f-a0b5-9ac4100e7797 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:25.270544 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b8750-adbf-499f-a0b5-9ac4100e7797 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:25.271398 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a38f-4fc1-4114-8d6f-1fa4c6744464 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:25.271874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b8750-adbf-499f-a0b5-9ac4100e7797 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:25.272666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a38f-4fc1-4114-8d6f-1fa4c6744464 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:25.273654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a38f-4fc1-4114-8d6f-1fa4c6744464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:25.274266 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b8750-adbf-499f-a0b5-9ac4100e7797 None admin] RBAC: Adding query filter params (group.id=ae3d7ae4c4074b48b787f32e35244b1b, role.id=0fdbf18b17e545d9929e22ebddc1d5b7, scope.project.id=9be09a7606624a74a92f8c33c2919615) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:25.274789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b8750-adbf-499f-a0b5-9ac4100e7797 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:25.275546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4a38f-4fc1-4114-8d6f-1fa4c6744464 None admin] RBAC: Adding query filter params (group.id=ec1ee4f520bd437ab0a2b3c1bb574932, role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=ff8263e17f324e50a27d4a90ba61dbe6) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:25.277202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b8750-adbf-499f-a0b5-9ac4100e7797 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:25.277738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4a38f-4fc1-4114-8d6f-1fa4c6744464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:25.279501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4a38f-4fc1-4114-8d6f-1fa4c6744464 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:25.291668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 187/379] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Aug 19 20:53:25 2022] GET /identity/v3/role_assignments?group.id=ec1ee4f520bd437ab0a2b3c1bb574932&scope.project.id=ff8263e17f324e50a27d4a90ba61dbe6&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:25.292185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 193/380] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Aug 19 20:53:25 2022] GET /identity/v3/role_assignments?group.id=ae3d7ae4c4074b48b787f32e35244b1b&scope.project.id=9be09a7606624a74a92f8c33c2919615&role.id=0fdbf18b17e545d9929e22ebddc1d5b7 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:25.660305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f939f-f56b-45b6-a566-1d63eb41cc76 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:25.661458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f939f-f56b-45b6-a566-1d63eb41cc76 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:25.661458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f939f-f56b-45b6-a566-1d63eb41cc76 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:25.662201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 194/381] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:25.669908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cae0b-7962-45f1-bf95-659ff3844d54 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:25.670288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cae0b-7962-45f1-bf95-659ff3844d54 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:25.670574 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cae0b-7962-45f1-bf95-659ff3844d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:25.692824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-de0cae0b-7962-45f1-bf95-659ff3844d54 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:25.694027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-de0cae0b-7962-45f1-bf95-659ff3844d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:25.790843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 188/382] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:26.005521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57d66e-d445-4a9c-8467-bf3e68723442 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:26.005721 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57d66e-d445-4a9c-8467-bf3e68723442 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:26.006240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57d66e-d445-4a9c-8467-bf3e68723442 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:26.008053 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 195/383] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:26.014389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fef9d-0a82-4717-adb8-57719ccf0282 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:26.014941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fef9d-0a82-4717-adb8-57719ccf0282 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:26.015396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fef9d-0a82-4717-adb8-57719ccf0282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:26.044956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-f00fef9d-0a82-4717-adb8-57719ccf0282 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:26.046883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f00fef9d-0a82-4717-adb8-57719ccf0282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:26.101793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:26.133236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 189/384] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:26.193316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57d66e-d445-4a9c-8467-bf3e68723442 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:26.326876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:26.334789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57d66e-d445-4a9c-8467-bf3e68723442 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:26.381391 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3faae7-266b-4717-96a3-0965373cb2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:26.382038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3faae7-266b-4717-96a3-0965373cb2ba None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:26.382323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3faae7-266b-4717-96a3-0965373cb2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:26.382595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3faae7-266b-4717-96a3-0965373cb2ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:26.399066 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3faae7-266b-4717-96a3-0965373cb2ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ad3faae7-266b-4717-96a3-0965373cb2ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:26.404443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:26.405517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:26.406703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:26.406703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:26.406703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:26.406703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:26.406703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:26.406703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:26.406703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:26.406703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:26.406703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:26.406703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:26.406703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:26.406703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:26.406703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 196/385] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:26.411757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fef9d-0a82-4717-adb8-57719ccf0282 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:26.473534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3faae7-266b-4717-96a3-0965373cb2ba None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:26.536557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fef9d-0a82-4717-adb8-57719ccf0282 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:26.588073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5edc29-67ca-4371-916b-2f2a10cc312f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:26.589137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5edc29-67ca-4371-916b-2f2a10cc312f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:26.589641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5edc29-67ca-4371-916b-2f2a10cc312f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:26.590115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5edc29-67ca-4371-916b-2f2a10cc312f None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:26.591073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5edc29-67ca-4371-916b-2f2a10cc312f None admin] RBAC: Adding query filter params (name=member) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:26.591767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5edc29-67ca-4371-916b-2f2a10cc312f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:26.593421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5edc29-67ca-4371-916b-2f2a10cc312f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:26.616431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 190/386] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:26.623193 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5edc29-67ca-4371-916b-2f2a10cc312f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:26.655544 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3faae7-266b-4717-96a3-0965373cb2ba None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:26.674840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:26.701394 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512f7d9-9f0e-47e3-a3d4-51840faac62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:26.703061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512f7d9-9f0e-47e3-a3d4-51840faac62d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:26.703650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512f7d9-9f0e-47e3-a3d4-51840faac62d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:26.704127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512f7d9-9f0e-47e3-a3d4-51840faac62d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:26.718254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512f7d9-9f0e-47e3-a3d4-51840faac62d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-d512f7d9-9f0e-47e3-a3d4-51840faac62d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:26.726221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:26.727246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:26.728104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:26.728104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:26.728104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:26.728104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:26.728104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:26.728104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:26.728104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:26.728104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:26.728104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:26.728104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:26.728104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:26.728104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:26.731202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 197/387] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:53:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:53:26.733214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a55b5d-aa22-4157-a0f5-9f3e02110aa7 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:26.735928 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a55b5d-aa22-4157-a0f5-9f3e02110aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:26.736498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a55b5d-aa22-4157-a0f5-9f3e02110aa7 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:26.738382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 198/388] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:26.745824 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a55b5d-aa22-4157-a0f5-9f3e02110aa7 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:26.756118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5edc29-67ca-4371-916b-2f2a10cc312f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:26.776113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:26.804842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da810e-3113-4a82-91c0-dddc4cdd4681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:26.805495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da810e-3113-4a82-91c0-dddc4cdd4681 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:26.805784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da810e-3113-4a82-91c0-dddc4cdd4681 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:26.806056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da810e-3113-4a82-91c0-dddc4cdd4681 None admin] PATH_INFO: `/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:26.807214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da810e-3113-4a82-91c0-dddc4cdd4681 None admin] RBAC: Authorizing `identity:get_group(group_id=ae3d7ae4c4074b48b787f32e35244b1b)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:26.808645 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da810e-3113-4a82-91c0-dddc4cdd4681 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:26.810249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 191/389] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:26 2022] GET /identity/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:26.811894 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdfdc1-5633-4ad8-9530-f0b7ac305034 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:26.812177 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdfdc1-5633-4ad8-9530-f0b7ac305034 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:26.812452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdfdc1-5633-4ad8-9530-f0b7ac305034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:26.856769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-2dbdfdc1-5633-4ad8-9530-f0b7ac305034 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:26.858575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2dbdfdc1-5633-4ad8-9530-f0b7ac305034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:26.912891 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a55b5d-aa22-4157-a0f5-9f3e02110aa7 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:26.969026 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83012f4a-6985-403e-b7a8-ae0f7b24719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:26.969657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83012f4a-6985-403e-b7a8-ae0f7b24719a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:26.969943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83012f4a-6985-403e-b7a8-ae0f7b24719a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:26.970222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83012f4a-6985-403e-b7a8-ae0f7b24719a None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:26.970928 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83012f4a-6985-403e-b7a8-ae0f7b24719a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:26.971279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83012f4a-6985-403e-b7a8-ae0f7b24719a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:26.972647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83012f4a-6985-403e-b7a8-ae0f7b24719a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:26.980209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 192/390] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:26.987023 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 199/391] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:26.987607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83012f4a-6985-403e-b7a8-ae0f7b24719a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:26.988517 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdfdc1-5633-4ad8-9530-f0b7ac305034 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:27.057630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:27.136241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:27.160987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83012f4a-6985-403e-b7a8-ae0f7b24719a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:27.198455 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdfdc1-5633-4ad8-9530-f0b7ac305034 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:27.198645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b692996-4b41-4344-be7c-822c91ffa970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:27.199322 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b692996-4b41-4344-be7c-822c91ffa970 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:27.199607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b692996-4b41-4344-be7c-822c91ffa970 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:27.199996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b692996-4b41-4344-be7c-822c91ffa970 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:27.202513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b692996-4b41-4344-be7c-822c91ffa970 None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:27.204024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b692996-4b41-4344-be7c-822c91ffa970 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:27.206006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 200/392] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:26 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:27.213725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b692996-4b41-4344-be7c-822c91ffa970 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:27.242970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17145520-9d6d-4d28-b81d-c20afb98abd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:27.244166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17145520-9d6d-4d28-b81d-c20afb98abd0 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:27.244457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17145520-9d6d-4d28-b81d-c20afb98abd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:27.244737 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17145520-9d6d-4d28-b81d-c20afb98abd0 None admin] PATH_INFO: `/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:27.246014 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17145520-9d6d-4d28-b81d-c20afb98abd0 None admin] RBAC: Authorizing `identity:get_group(group_id=ae3d7ae4c4074b48b787f32e35244b1b)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:27.248369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17145520-9d6d-4d28-b81d-c20afb98abd0 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:27.251249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 193/393] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:26 2022] GET /identity/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:27.259908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17145520-9d6d-4d28-b81d-c20afb98abd0 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:27.392479 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b692996-4b41-4344-be7c-822c91ffa970 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:27.427806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17145520-9d6d-4d28-b81d-c20afb98abd0 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:27.430048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:27.430347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b6801-84ff-4c1a-8258-635dcfc530e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:27.432392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b6801-84ff-4c1a-8258-635dcfc530e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:27.432392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b6801-84ff-4c1a-8258-635dcfc530e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:27.432392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b6801-84ff-4c1a-8258-635dcfc530e2 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc/groups/ae3d7ae4c4074b48b787f32e35244b1b/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:27.434864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b6801-84ff-4c1a-8258-635dcfc530e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=90fb40089787468fac42f2a8bafe87dc, group_id=ae3d7ae4c4074b48b787f32e35244b1b, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:27.436653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b6801-84ff-4c1a-8258-635dcfc530e2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:27.459647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 201/394] 10.222.0.17 () {58 vars in 1442 bytes} [Fri Aug 19 20:53:27 2022] PUT /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc/groups/ae3d7ae4c4074b48b787f32e35244b1b/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:53:27.459647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b6801-84ff-4c1a-8258-635dcfc530e2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:27.479186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:27.511592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b502744-b739-4228-99a7-53aec0af7d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:27.512694 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502744-b739-4228-99a7-53aec0af7d82 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:27.513557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502744-b739-4228-99a7-53aec0af7d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:27.514043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502744-b739-4228-99a7-53aec0af7d82 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:27.516624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b502744-b739-4228-99a7-53aec0af7d82 None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:27.518329 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b502744-b739-4228-99a7-53aec0af7d82 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:27.520551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 194/395] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:27 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:27.531803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b502744-b739-4228-99a7-53aec0af7d82 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:27.605909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b6801-84ff-4c1a-8258-635dcfc530e2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:27.652847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec057561-2001-4207-a725-a3d475c56cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:27.653951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057561-2001-4207-a725-a3d475c56cfe None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:27.654247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057561-2001-4207-a725-a3d475c56cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:27.654559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057561-2001-4207-a725-a3d475c56cfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:27.669924 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec057561-2001-4207-a725-a3d475c56cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ec057561-2001-4207-a725-a3d475c56cfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:27.677593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:27.678538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:27.679406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:27.679406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:27.679406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:27.679406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:27.679406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:27.679406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:27.679406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:27.679406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:27.679406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:27.679406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:27.679406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:27.679406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:27.679406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 202/396] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:27.688933 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec057561-2001-4207-a725-a3d475c56cfe None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:27.730414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b502744-b739-4228-99a7-53aec0af7d82 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:27.780215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc51ff-b8aa-4cfb-ac8e-96af3173d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:27.781870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc51ff-b8aa-4cfb-ac8e-96af3173d471 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:27.782308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc51ff-b8aa-4cfb-ac8e-96af3173d471 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:27.783106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc51ff-b8aa-4cfb-ac8e-96af3173d471 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc/groups/ae3d7ae4c4074b48b787f32e35244b1b/roles/0fdbf18b17e545d9929e22ebddc1d5b7` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:27.786483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc51ff-b8aa-4cfb-ac8e-96af3173d471 None admin] RBAC: Authorizing `identity:create_grant(project_id=90fb40089787468fac42f2a8bafe87dc, group_id=ae3d7ae4c4074b48b787f32e35244b1b, role_id=0fdbf18b17e545d9929e22ebddc1d5b7)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:27.788960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc51ff-b8aa-4cfb-ac8e-96af3173d471 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:27.791835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:27.808010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 195/397] 10.222.0.17 () {58 vars in 1442 bytes} [Fri Aug 19 20:53:27 2022] PUT /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc/groups/ae3d7ae4c4074b48b787f32e35244b1b/roles/0fdbf18b17e545d9929e22ebddc1d5b7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:53:27.813583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bb229-86ba-4096-933d-272aa45dbfb9 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:27.813583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bb229-86ba-4096-933d-272aa45dbfb9 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:27.813583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bb229-86ba-4096-933d-272aa45dbfb9 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:27.815643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 196/398] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:27.832714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5849e48-025e-4da7-a538-365ad1f2d4a5 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:27.833031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5849e48-025e-4da7-a538-365ad1f2d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:27.833269 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5849e48-025e-4da7-a538-365ad1f2d4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:27.859520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec057561-2001-4207-a725-a3d475c56cfe None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:27.866496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e5849e48-025e-4da7-a538-365ad1f2d4a5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:27.867717 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e5849e48-025e-4da7-a538-365ad1f2d4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:27.922618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:27.933922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdc40a-55a6-4735-b006-74830d543dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:27.936951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdc40a-55a6-4735-b006-74830d543dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:27.937244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdc40a-55a6-4735-b006-74830d543dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:27.938340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdc40a-55a6-4735-b006-74830d543dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:27.940091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdc40a-55a6-4735-b006-74830d543dc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:27.940402 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdc40a-55a6-4735-b006-74830d543dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:27.941824 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdc40a-55a6-4735-b006-74830d543dc4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:27.966194 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 203/399] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:27.975849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdc40a-55a6-4735-b006-74830d543dc4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:27.996313 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 197/400] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:28.033985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f57399-c670-48d7-8e3d-cecba2fe5094 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:28.034260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f57399-c670-48d7-8e3d-cecba2fe5094 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:28.034533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f57399-c670-48d7-8e3d-cecba2fe5094 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:28.036769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 198/401] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:53:28.041900 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa7681-f963-4509-ab68-15ecea513d88 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:28.042190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa7681-f963-4509-ab68-15ecea513d88 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:28.042462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa7681-f963-4509-ab68-15ecea513d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:28.069613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-87fa7681-f963-4509-ab68-15ecea513d88 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:28.071141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-87fa7681-f963-4509-ab68-15ecea513d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:28.131993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdc40a-55a6-4735-b006-74830d543dc4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:28.162586 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:28.173441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 199/402] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:28.188392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830aa7c1-019d-4604-a6f2-b13ef0fd33c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:28.189337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aa7c1-019d-4604-a6f2-b13ef0fd33c8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:28.189820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aa7c1-019d-4604-a6f2-b13ef0fd33c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:28.190299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aa7c1-019d-4604-a6f2-b13ef0fd33c8 None admin] PATH_INFO: `/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:28.191662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830aa7c1-019d-4604-a6f2-b13ef0fd33c8 None admin] RBAC: Authorizing `identity:get_group(group_id=ae3d7ae4c4074b48b787f32e35244b1b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:28.193343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830aa7c1-019d-4604-a6f2-b13ef0fd33c8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:28.195451 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 204/403] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:27 2022] GET /identity/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:28.201379 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa7681-f963-4509-ab68-15ecea513d88 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:28.303893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830aa7c1-019d-4604-a6f2-b13ef0fd33c8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:28.334522 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:28.346632 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa7681-f963-4509-ab68-15ecea513d88 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:28.387651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68223d17-497f-4437-b64f-a978fd7c58b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:28.389043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68223d17-497f-4437-b64f-a978fd7c58b6 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:28.389323 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68223d17-497f-4437-b64f-a978fd7c58b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:28.389596 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68223d17-497f-4437-b64f-a978fd7c58b6 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:28.390822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68223d17-497f-4437-b64f-a978fd7c58b6 None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:28.392790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68223d17-497f-4437-b64f-a978fd7c58b6 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:28.395327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 200/404] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:28 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:28.400755 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68223d17-497f-4437-b64f-a978fd7c58b6 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:28.515879 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830aa7c1-019d-4604-a6f2-b13ef0fd33c8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:28.530534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68223d17-497f-4437-b64f-a978fd7c58b6 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:28.554676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029584b3-2db6-4608-9a97-0b5302c91061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:28.555506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029584b3-2db6-4608-9a97-0b5302c91061 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:28.555870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029584b3-2db6-4608-9a97-0b5302c91061 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:28.556219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029584b3-2db6-4608-9a97-0b5302c91061 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:28.570966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029584b3-2db6-4608-9a97-0b5302c91061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:28.575028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54969ac5-fe0a-4cb4-a8b4-12728769c66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:28.576599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54969ac5-fe0a-4cb4-a8b4-12728769c66a None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:28.577034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54969ac5-fe0a-4cb4-a8b4-12728769c66a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:28.577583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54969ac5-fe0a-4cb4-a8b4-12728769c66a None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615/groups/ae3d7ae4c4074b48b787f32e35244b1b/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-029584b3-2db6-4608-9a97-0b5302c91061 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:28.578073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:28.579030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:28.579855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:28.579855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:28.579855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:28.579855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:28.579855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:28.579855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:28.579855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:28.579855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:28.579855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:28.579855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:28.579855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:53:28.579855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:28.584581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 205/405] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:53:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:28.585639 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029584b3-2db6-4608-9a97-0b5302c91061 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:28.587278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54969ac5-fe0a-4cb4-a8b4-12728769c66a None admin] RBAC: Authorizing `identity:create_grant(project_id=9be09a7606624a74a92f8c33c2919615, group_id=ae3d7ae4c4074b48b787f32e35244b1b, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:28.589283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54969ac5-fe0a-4cb4-a8b4-12728769c66a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:28.615326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 201/406] 10.222.0.17 () {58 vars in 1442 bytes} [Fri Aug 19 20:53:28 2022] PUT /identity/v3/projects/9be09a7606624a74a92f8c33c2919615/groups/ae3d7ae4c4074b48b787f32e35244b1b/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:53:28.616238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54969ac5-fe0a-4cb4-a8b4-12728769c66a None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:28.673738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:28.764041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:28.775439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54969ac5-fe0a-4cb4-a8b4-12728769c66a None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:28.834155 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029584b3-2db6-4608-9a97-0b5302c91061 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:28.834366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2456fc2-b864-47c4-a4d0-f6294091f549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:28.834796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2456fc2-b864-47c4-a4d0-f6294091f549 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:28.835083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2456fc2-b864-47c4-a4d0-f6294091f549 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:28.835359 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2456fc2-b864-47c4-a4d0-f6294091f549 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:28.836145 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2456fc2-b864-47c4-a4d0-f6294091f549 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:28.836479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2456fc2-b864-47c4-a4d0-f6294091f549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:28.837924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2456fc2-b864-47c4-a4d0-f6294091f549 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:28.848047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 202/407] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:28.855760 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2456fc2-b864-47c4-a4d0-f6294091f549 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:28.872753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1090b-4414-456f-a8b8-9f0fb5a90738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:28.873401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1090b-4414-456f-a8b8-9f0fb5a90738 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:28.873684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1090b-4414-456f-a8b8-9f0fb5a90738 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:28.873955 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1090b-4414-456f-a8b8-9f0fb5a90738 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:28.886358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1090b-4414-456f-a8b8-9f0fb5a90738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-fea1090b-4414-456f-a8b8-9f0fb5a90738 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:28.892160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:28.893113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:28.893915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:28.893915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:28.893915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:28.893915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:28.893915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:28.893915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:28.893915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:28.893915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:28.893915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:28.893915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:28.893915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:28.893915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:28.893915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 206/408] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:53:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:28.900969 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1090b-4414-456f-a8b8-9f0fb5a90738 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:29.012119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1090b-4414-456f-a8b8-9f0fb5a90738 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:29.031571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:29.059001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e02833-6558-4982-a484-2856b2a7d5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:29.059978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e02833-6558-4982-a484-2856b2a7d5aa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:29.060664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e02833-6558-4982-a484-2856b2a7d5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:29.064038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e02833-6558-4982-a484-2856b2a7d5aa None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:29.064877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e02833-6558-4982-a484-2856b2a7d5aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:29.065330 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e02833-6558-4982-a484-2856b2a7d5aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:29.069041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e02833-6558-4982-a484-2856b2a7d5aa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:29.083497 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:29.086771 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 207/409] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:29.092955 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e02833-6558-4982-a484-2856b2a7d5aa None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:29.128203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2456fc2-b864-47c4-a4d0-f6294091f549 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:29.204497 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec79a3-fedf-44ee-b29d-021c86b8e584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:29.205545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec79a3-fedf-44ee-b29d-021c86b8e584 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:29.206048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec79a3-fedf-44ee-b29d-021c86b8e584 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:29.206540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec79a3-fedf-44ee-b29d-021c86b8e584 None admin] PATH_INFO: `/v3/groups/ec1ee4f520bd437ab0a2b3c1bb574932` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:29.211492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec79a3-fedf-44ee-b29d-021c86b8e584 None admin] RBAC: Authorizing `identity:get_group(group_id=ec1ee4f520bd437ab0a2b3c1bb574932)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:29.213392 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec79a3-fedf-44ee-b29d-021c86b8e584 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:29.222322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 203/410] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:28 2022] GET /identity/v3/groups/ec1ee4f520bd437ab0a2b3c1bb574932 => generated 229 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:29.222322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec79a3-fedf-44ee-b29d-021c86b8e584 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:29.299534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e02833-6558-4982-a484-2856b2a7d5aa None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:29.361098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c669fd-f8b3-47a7-9038-76afa0c92ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:29.362681 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c669fd-f8b3-47a7-9038-76afa0c92ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:29.363400 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c669fd-f8b3-47a7-9038-76afa0c92ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:29.363905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c669fd-f8b3-47a7-9038-76afa0c92ec6 None admin] PATH_INFO: `/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:29.365407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c669fd-f8b3-47a7-9038-76afa0c92ec6 None admin] RBAC: Authorizing `identity:get_group(group_id=ae3d7ae4c4074b48b787f32e35244b1b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:29.367213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c669fd-f8b3-47a7-9038-76afa0c92ec6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:29.369510 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 208/411] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:29 2022] GET /identity/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:29.374783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec79a3-fedf-44ee-b29d-021c86b8e584 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:29.376348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c669fd-f8b3-47a7-9038-76afa0c92ec6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:29.414545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc53369-2227-4887-b244-a1e9a7a922e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:29.415312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc53369-2227-4887-b244-a1e9a7a922e2 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:29.415523 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc53369-2227-4887-b244-a1e9a7a922e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:29.415806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc53369-2227-4887-b244-a1e9a7a922e2 None admin] PATH_INFO: `/v3/projects/ff8263e17f324e50a27d4a90ba61dbe6` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:29.417048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc53369-2227-4887-b244-a1e9a7a922e2 None admin] RBAC: Authorizing `identity:get_project(project_id=ff8263e17f324e50a27d4a90ba61dbe6)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:29.418824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc53369-2227-4887-b244-a1e9a7a922e2 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:29.421420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 204/412] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:29 2022] GET /identity/v3/projects/ff8263e17f324e50a27d4a90ba61dbe6 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:29.427496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc53369-2227-4887-b244-a1e9a7a922e2 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:29.448284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:29.477756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:29.549980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc53369-2227-4887-b244-a1e9a7a922e2 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:29.584351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c669fd-f8b3-47a7-9038-76afa0c92ec6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:29.593381 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753da54-5161-4150-b34b-b1b8c0f4e3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:29.594577 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753da54-5161-4150-b34b-b1b8c0f4e3b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:29.599244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753da54-5161-4150-b34b-b1b8c0f4e3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:29.599947 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753da54-5161-4150-b34b-b1b8c0f4e3b3 None admin] PATH_INFO: `/v3/projects/ff8263e17f324e50a27d4a90ba61dbe6/groups/ec1ee4f520bd437ab0a2b3c1bb574932/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:29.603210 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753da54-5161-4150-b34b-b1b8c0f4e3b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff8263e17f324e50a27d4a90ba61dbe6, group_id=ec1ee4f520bd437ab0a2b3c1bb574932, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:29.605123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753da54-5161-4150-b34b-b1b8c0f4e3b3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:29.634410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 205/413] 10.222.0.17 () {58 vars in 1442 bytes} [Fri Aug 19 20:53:29 2022] PUT /identity/v3/projects/ff8263e17f324e50a27d4a90ba61dbe6/groups/ec1ee4f520bd437ab0a2b3c1bb574932/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 20:53:29.636219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317151-a7a8-4558-a511-7237771943d2 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:29.636724 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317151-a7a8-4558-a511-7237771943d2 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:29.637215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317151-a7a8-4558-a511-7237771943d2 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:29.639191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 206/414] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:29.649867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c2170-c751-4df9-9630-418e36ddb904 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:29.649867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c2170-c751-4df9-9630-418e36ddb904 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:29.649867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c2170-c751-4df9-9630-418e36ddb904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:29.670518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-628c2170-c751-4df9-9630-418e36ddb904 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:29.671875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-628c2170-c751-4df9-9630-418e36ddb904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:29.675476 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8673ce-ff66-48dc-a4e2-25d71f8bbccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:29.676539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8673ce-ff66-48dc-a4e2-25d71f8bbccb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:29.677021 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8673ce-ff66-48dc-a4e2-25d71f8bbccb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:29.677547 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8673ce-ff66-48dc-a4e2-25d71f8bbccb None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:29.679034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8673ce-ff66-48dc-a4e2-25d71f8bbccb None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:29.680809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8673ce-ff66-48dc-a4e2-25d71f8bbccb None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:29.683284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 209/415] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:29 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:29.689555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8673ce-ff66-48dc-a4e2-25d71f8bbccb None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:29.754514 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 207/416] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:29.843002 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8673ce-ff66-48dc-a4e2-25d71f8bbccb None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:29.859540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:29.885569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c849c0-b3d9-4064-835f-3d3c74046f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:29.886645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c849c0-b3d9-4064-835f-3d3c74046f53 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:29.887171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c849c0-b3d9-4064-835f-3d3c74046f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:29.887787 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c849c0-b3d9-4064-835f-3d3c74046f53 None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615/groups/ae3d7ae4c4074b48b787f32e35244b1b/roles/0fdbf18b17e545d9929e22ebddc1d5b7` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:29.890821 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c849c0-b3d9-4064-835f-3d3c74046f53 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be09a7606624a74a92f8c33c2919615, group_id=ae3d7ae4c4074b48b787f32e35244b1b, role_id=0fdbf18b17e545d9929e22ebddc1d5b7)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:29.892551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c849c0-b3d9-4064-835f-3d3c74046f53 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:29.917590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 210/417] 10.222.0.17 () {58 vars in 1442 bytes} [Fri Aug 19 20:53:29 2022] PUT /identity/v3/projects/9be09a7606624a74a92f8c33c2919615/groups/ae3d7ae4c4074b48b787f32e35244b1b/roles/0fdbf18b17e545d9929e22ebddc1d5b7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 20:53:30.040060 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c2170-c751-4df9-9630-418e36ddb904 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:30.049829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:30.158243 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c2170-c751-4df9-9630-418e36ddb904 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:30.199577 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77c208-0a72-4b10-9679-b25dad15e900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:30.201144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77c208-0a72-4b10-9679-b25dad15e900 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:30.201629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77c208-0a72-4b10-9679-b25dad15e900 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:30.202101 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77c208-0a72-4b10-9679-b25dad15e900 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:30.218120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77c208-0a72-4b10-9679-b25dad15e900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-3b77c208-0a72-4b10-9679-b25dad15e900 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:30.223365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:30.224317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:30.225160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:30.225160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:30.225160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:30.225160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:30.225160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:30.225160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:30.225160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:30.225160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:30.225160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:30.225160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:30.225160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:30.225160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:30.233262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 208/418] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:30.238944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c849c0-b3d9-4064-835f-3d3c74046f53 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:30.349923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c849c0-b3d9-4064-835f-3d3c74046f53 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:30.394275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b64c92-6982-46c1-bdd5-7dd3e6e6db6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:30.395720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b64c92-6982-46c1-bdd5-7dd3e6e6db6e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:30.396228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b64c92-6982-46c1-bdd5-7dd3e6e6db6e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:30.396708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b64c92-6982-46c1-bdd5-7dd3e6e6db6e None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:30.397591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b64c92-6982-46c1-bdd5-7dd3e6e6db6e None admin] RBAC: Adding query filter params (name=member) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:30.398121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b64c92-6982-46c1-bdd5-7dd3e6e6db6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:30.399737 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b64c92-6982-46c1-bdd5-7dd3e6e6db6e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:30.410382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 211/419] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:30.415718 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77c208-0a72-4b10-9679-b25dad15e900 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:30.505160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:30.541964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77c208-0a72-4b10-9679-b25dad15e900 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:30.578783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e315dc8-8f2e-417d-b941-ceae23c1317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:30.579626 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315dc8-8f2e-417d-b941-ceae23c1317e None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:30.579913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315dc8-8f2e-417d-b941-ceae23c1317e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:30.580187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315dc8-8f2e-417d-b941-ceae23c1317e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:30.651398 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e315dc8-8f2e-417d-b941-ceae23c1317e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:30.652864 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e315dc8-8f2e-417d-b941-ceae23c1317e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:30.721781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:30.759242 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 209/420] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:30.767511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b64c92-6982-46c1-bdd5-7dd3e6e6db6e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:30.826467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:30.890550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70f0a-4cab-408e-ab83-d85037bcf619 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:30.890888 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70f0a-4cab-408e-ab83-d85037bcf619 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:30.891169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70f0a-4cab-408e-ab83-d85037bcf619 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:30.896594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 210/421] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:30.898316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653e17d-43f9-46a6-97c1-bfcad7d8e453 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:30.898609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653e17d-43f9-46a6-97c1-bfcad7d8e453 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:30.898933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653e17d-43f9-46a6-97c1-bfcad7d8e453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:30.907509 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b64c92-6982-46c1-bdd5-7dd3e6e6db6e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:30.918328 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-5653e17d-43f9-46a6-97c1-bfcad7d8e453 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:30.919881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5653e17d-43f9-46a6-97c1-bfcad7d8e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:30.950242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f45ef5-5787-4e06-816a-7ab9c75e88a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:30.951000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f45ef5-5787-4e06-816a-7ab9c75e88a0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:30.951284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f45ef5-5787-4e06-816a-7ab9c75e88a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:30.951577 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f45ef5-5787-4e06-816a-7ab9c75e88a0 None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:30.952748 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f45ef5-5787-4e06-816a-7ab9c75e88a0 None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:30.954226 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f45ef5-5787-4e06-816a-7ab9c75e88a0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:30.960405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 212/422] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:30 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:30.965232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f45ef5-5787-4e06-816a-7ab9c75e88a0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:31.009977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 211/423] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:31.047599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8347d7-6bd4-4f11-8ae7-7479d1e7b18a None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:31.048510 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8347d7-6bd4-4f11-8ae7-7479d1e7b18a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:31.049000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8347d7-6bd4-4f11-8ae7-7479d1e7b18a None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:31.051569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 212/424] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:53:31.061151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777a9e5-2a86-4c4d-a57e-bd8259ac094a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:31.062173 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777a9e5-2a86-4c4d-a57e-bd8259ac094a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:31.062853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777a9e5-2a86-4c4d-a57e-bd8259ac094a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:31.084925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-6777a9e5-2a86-4c4d-a57e-bd8259ac094a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:31.086537 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6777a9e5-2a86-4c4d-a57e-bd8259ac094a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:31.140916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f45ef5-5787-4e06-816a-7ab9c75e88a0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:31.148592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:31.172703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 213/425] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:31.214502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa6bc6-472a-4c3a-9024-ba25cf8e6261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:31.215433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa6bc6-472a-4c3a-9024-ba25cf8e6261 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:31.215923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa6bc6-472a-4c3a-9024-ba25cf8e6261 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:31.216352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa6bc6-472a-4c3a-9024-ba25cf8e6261 None admin] PATH_INFO: `/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:31.226929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa6bc6-472a-4c3a-9024-ba25cf8e6261 None admin] RBAC: Authorizing `identity:get_group(group_id=ae3d7ae4c4074b48b787f32e35244b1b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:31.228670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa6bc6-472a-4c3a-9024-ba25cf8e6261 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:31.230831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 213/426] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:30 2022] GET /identity/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:31.238843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777a9e5-2a86-4c4d-a57e-bd8259ac094a None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:31.286681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:31.366035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777a9e5-2a86-4c4d-a57e-bd8259ac094a None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:31.402681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef0873-d2c8-49e9-a64e-545b2ab6517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:31.403346 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef0873-d2c8-49e9-a64e-545b2ab6517f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:31.403631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef0873-d2c8-49e9-a64e-545b2ab6517f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:31.403907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef0873-d2c8-49e9-a64e-545b2ab6517f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:31.404640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef0873-d2c8-49e9-a64e-545b2ab6517f None admin] RBAC: Adding query filter params (group.id=ae3d7ae4c4074b48b787f32e35244b1b, role.id=40d451ce7e0143e682ac5d43622c57d2, scope.project.id=90fb40089787468fac42f2a8bafe87dc) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:31.404950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef0873-d2c8-49e9-a64e-545b2ab6517f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:31.406466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef0873-d2c8-49e9-a64e-545b2ab6517f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:31.412890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 214/427] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Aug 19 20:53:31 2022] GET /identity/v3/role_assignments?group.id=ae3d7ae4c4074b48b787f32e35244b1b&scope.project.id=90fb40089787468fac42f2a8bafe87dc&role.id=40d451ce7e0143e682ac5d43622c57d2 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:31.455043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa6bc6-472a-4c3a-9024-ba25cf8e6261 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:31.511048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef0873-d2c8-49e9-a64e-545b2ab6517f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:31.631251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa6bc6-472a-4c3a-9024-ba25cf8e6261 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:31.645676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:31.658351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef0873-d2c8-49e9-a64e-545b2ab6517f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:31.675974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46257c32-5764-426f-97e4-a4cbf859feb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:31.676941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46257c32-5764-426f-97e4-a4cbf859feb9 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:31.677432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46257c32-5764-426f-97e4-a4cbf859feb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:31.677857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46257c32-5764-426f-97e4-a4cbf859feb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:31.691954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46257c32-5764-426f-97e4-a4cbf859feb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-46257c32-5764-426f-97e4-a4cbf859feb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:31.698706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:31.699878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:31.701521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:31.701521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:31.701521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:31.701521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:31.701521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:31.701521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:31.701521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:31.701521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:31.701521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:31.701521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:31.701521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:31.701521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:31.703653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 214/428] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:53:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:31.707841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4615891-c325-4a30-833d-6e10f9cd3caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:31.709444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615891-c325-4a30-833d-6e10f9cd3caa None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:31.709658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46257c32-5764-426f-97e4-a4cbf859feb9 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:31.709775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615891-c325-4a30-833d-6e10f9cd3caa None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:31.709989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615891-c325-4a30-833d-6e10f9cd3caa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:31.727273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4615891-c325-4a30-833d-6e10f9cd3caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-b4615891-c325-4a30-833d-6e10f9cd3caa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:31.737792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:31.738779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:31.739595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:31.739595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:31.739595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:31.739595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:31.739595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:31.739595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:31.739595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:31.739595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:31.739595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:31.739595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:31.739595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 20:53:31.739595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:31.740348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 215/429] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:53:31.746231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4615891-c325-4a30-833d-6e10f9cd3caa None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:31.758905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:31.843744 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46257c32-5764-426f-97e4-a4cbf859feb9 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:31.864915 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4615891-c325-4a30-833d-6e10f9cd3caa None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:31.883738 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f8f93-d79c-48c4-b4de-afb498cb0735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:31.884434 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f8f93-d79c-48c4-b4de-afb498cb0735 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:31.884721 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f8f93-d79c-48c4-b4de-afb498cb0735 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:31.884994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f8f93-d79c-48c4-b4de-afb498cb0735 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:31.885667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f8f93-d79c-48c4-b4de-afb498cb0735 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:31.885968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f8f93-d79c-48c4-b4de-afb498cb0735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:31.887497 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f8f93-d79c-48c4-b4de-afb498cb0735 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:31.898633 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 215/430] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:31.903093 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e12ea-c061-4f3c-8042-cda13e997127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:31.904483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e12ea-c061-4f3c-8042-cda13e997127 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:31.904788 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e12ea-c061-4f3c-8042-cda13e997127 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:31.905058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e12ea-c061-4f3c-8042-cda13e997127 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:31.905702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e12ea-c061-4f3c-8042-cda13e997127 None admin] RBAC: Adding query filter params (name=member) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:31.906005 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e12ea-c061-4f3c-8042-cda13e997127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:31.907495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e12ea-c061-4f3c-8042-cda13e997127 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:31.910247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f8f93-d79c-48c4-b4de-afb498cb0735 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:31.922495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 216/431] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:53:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:31.924119 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e12ea-c061-4f3c-8042-cda13e997127 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:31.951217 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:32.033620 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:32.044464 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f8f93-d79c-48c4-b4de-afb498cb0735 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:32.052699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e12ea-c061-4f3c-8042-cda13e997127 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:32.086308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c62b9-9515-4926-a5be-8a1798f44d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:32.087165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c62b9-9515-4926-a5be-8a1798f44d42 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:32.087458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c62b9-9515-4926-a5be-8a1798f44d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:32.087793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c62b9-9515-4926-a5be-8a1798f44d42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:32.093345 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35662568-6924-4616-abb5-ad7eadf6493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:32.093987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35662568-6924-4616-abb5-ad7eadf6493b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:32.094405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35662568-6924-4616-abb5-ad7eadf6493b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:32.094614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35662568-6924-4616-abb5-ad7eadf6493b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:32.169288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c62b9-9515-4926-a5be-8a1798f44d42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:32.170692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35662568-6924-4616-abb5-ad7eadf6493b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:32.171129 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c62b9-9515-4926-a5be-8a1798f44d42 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:32.172187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35662568-6924-4616-abb5-ad7eadf6493b None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:32.188979 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:32.291542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:32.300382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 217/432] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 20:53:32.301486 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43826d6-7271-4ec6-8cf1-d63c4d10d465 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:32.301777 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43826d6-7271-4ec6-8cf1-d63c4d10d465 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:32.302054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43826d6-7271-4ec6-8cf1-d63c4d10d465 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:32.303385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 216/433] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:32.303562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 218/434] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:32.306207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c62b9-9515-4926-a5be-8a1798f44d42 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:32.308743 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49f6f-3403-4b2b-a34c-f695b1bc1fb3 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:32.309211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49f6f-3403-4b2b-a34c-f695b1bc1fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:32.310218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49f6f-3403-4b2b-a34c-f695b1bc1fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:32.330479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-99a49f6f-3403-4b2b-a34c-f695b1bc1fb3 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:32.332937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-99a49f6f-3403-4b2b-a34c-f695b1bc1fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:32.405124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 219/435] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:32.406255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a49f6f-3403-4b2b-a34c-f695b1bc1fb3 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:32.418321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c62b9-9515-4926-a5be-8a1798f44d42 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:32.449766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:32.458070 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1ff6e-3b8c-4ab0-a123-8ced726c6d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:32.458715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1ff6e-3b8c-4ab0-a123-8ced726c6d5b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:32.459016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1ff6e-3b8c-4ab0-a123-8ced726c6d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:32.459292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1ff6e-3b8c-4ab0-a123-8ced726c6d5b None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:32.460420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1ff6e-3b8c-4ab0-a123-8ced726c6d5b None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:32.461852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1ff6e-3b8c-4ab0-a123-8ced726c6d5b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:32.468946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 217/436] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:32 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:32.468946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d128f-8a81-4789-af75-b38136fcc3a2 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:32.468946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d128f-8a81-4789-af75-b38136fcc3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:32.468946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d128f-8a81-4789-af75-b38136fcc3a2 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:32.468946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 218/437] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:32.470534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d128f-8a81-4789-af75-b38136fcc3a2 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:32.517459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a49f6f-3403-4b2b-a34c-f695b1bc1fb3 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:32.539796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:32.556882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3868f-0aae-4a4d-b1c6-8a676825b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:32.557522 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3868f-0aae-4a4d-b1c6-8a676825b8cc None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:32.557805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3868f-0aae-4a4d-b1c6-8a676825b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:32.558077 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3868f-0aae-4a4d-b1c6-8a676825b8cc None admin] PATH_INFO: `/v3/projects/90fb40089787468fac42f2a8bafe87dc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:32.559232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3868f-0aae-4a4d-b1c6-8a676825b8cc None admin] RBAC: Authorizing `identity:get_project(project_id=90fb40089787468fac42f2a8bafe87dc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:32.561310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3868f-0aae-4a4d-b1c6-8a676825b8cc None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:32.566784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 220/438] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:32 2022] GET /identity/v3/projects/90fb40089787468fac42f2a8bafe87dc => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:32.566784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff849f2-387f-4547-8254-7559da26930f None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:32.566784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff849f2-387f-4547-8254-7559da26930f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:32.566784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff849f2-387f-4547-8254-7559da26930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:32.583108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-4ff849f2-387f-4547-8254-7559da26930f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:32.584300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4ff849f2-387f-4547-8254-7559da26930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:32.597252 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d128f-8a81-4789-af75-b38136fcc3a2 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:32.632761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f2c62-7947-4bad-84b0-efa11f44c873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:32.633402 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f2c62-7947-4bad-84b0-efa11f44c873 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:32.633743 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f2c62-7947-4bad-84b0-efa11f44c873 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:32.633974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f2c62-7947-4bad-84b0-efa11f44c873 None admin] PATH_INFO: `/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:32.635117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f2c62-7947-4bad-84b0-efa11f44c873 None admin] RBAC: Authorizing `identity:get_group(group_id=ae3d7ae4c4074b48b787f32e35244b1b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:32.636575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f2c62-7947-4bad-84b0-efa11f44c873 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:32.638914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 219/439] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:32 2022] GET /identity/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:32.644438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f2c62-7947-4bad-84b0-efa11f44c873 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:32.658969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 221/440] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:32.660116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff849f2-387f-4547-8254-7559da26930f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:32.708169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:32.761132 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f2c62-7947-4bad-84b0-efa11f44c873 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:32.781831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff849f2-387f-4547-8254-7559da26930f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:32.796696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:32.803702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655fd3d-389f-4bd3-ad01-fbda7bd344a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:32.804394 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655fd3d-389f-4bd3-ad01-fbda7bd344a5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:32.804659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655fd3d-389f-4bd3-ad01-fbda7bd344a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:32.804932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655fd3d-389f-4bd3-ad01-fbda7bd344a5 None admin] PATH_INFO: `/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:32.806087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655fd3d-389f-4bd3-ad01-fbda7bd344a5 None admin] RBAC: Authorizing `identity:get_group(group_id=ae3d7ae4c4074b48b787f32e35244b1b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:32.807743 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655fd3d-389f-4bd3-ad01-fbda7bd344a5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:32.813933 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 220/441] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:32 2022] GET /identity/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:32.814668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655fd3d-389f-4bd3-ad01-fbda7bd344a5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:32.829335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b2f8c-3e07-41af-b1e4-1d25fcff0fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:32.829955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2f8c-3e07-41af-b1e4-1d25fcff0fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:32.830246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2f8c-3e07-41af-b1e4-1d25fcff0fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:32.830503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2f8c-3e07-41af-b1e4-1d25fcff0fb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:32.831346 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b2f8c-3e07-41af-b1e4-1d25fcff0fb1 None admin] RBAC: Adding query filter params (group.id=ae3d7ae4c4074b48b787f32e35244b1b, role.id=40d451ce7e0143e682ac5d43622c57d2, scope.project.id=9be09a7606624a74a92f8c33c2919615) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:32.831651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b2f8c-3e07-41af-b1e4-1d25fcff0fb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:32.833076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b2f8c-3e07-41af-b1e4-1d25fcff0fb1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:32.839233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 222/442] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Aug 19 20:53:32 2022] GET /identity/v3/role_assignments?group.id=ae3d7ae4c4074b48b787f32e35244b1b&scope.project.id=9be09a7606624a74a92f8c33c2919615&role.id=40d451ce7e0143e682ac5d43622c57d2 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:32.839903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b2f8c-3e07-41af-b1e4-1d25fcff0fb1 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:32.950534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655fd3d-389f-4bd3-ad01-fbda7bd344a5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:32.979194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b2f8c-3e07-41af-b1e4-1d25fcff0fb1 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:32.982317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:32.994295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d83923-427f-4528-9cbe-83019b650336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:32.994980 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d83923-427f-4528-9cbe-83019b650336 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:32.995380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d83923-427f-4528-9cbe-83019b650336 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:32.995769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d83923-427f-4528-9cbe-83019b650336 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:33.009671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d83923-427f-4528-9cbe-83019b650336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-a7d83923-427f-4528-9cbe-83019b650336 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:33.015171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:33.016084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:33.016903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:33.016903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:33.016903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:33.016903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:33.016903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:33.016903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:33.016903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:33.016903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:33.016903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:33.016903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:33.016903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:53:33.016903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:33.016903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 221/443] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:53:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:33.017561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d83923-427f-4528-9cbe-83019b650336 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:33.029121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a6e01-7fae-4075-83ec-ae64289778cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:33.029743 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a6e01-7fae-4075-83ec-ae64289778cb None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:33.030027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a6e01-7fae-4075-83ec-ae64289778cb None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:33.030307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a6e01-7fae-4075-83ec-ae64289778cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:33.031098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a6e01-7fae-4075-83ec-ae64289778cb None admin] RBAC: Adding query filter params (group.id=ae3d7ae4c4074b48b787f32e35244b1b, role.id=0fdbf18b17e545d9929e22ebddc1d5b7, scope.project.id=90fb40089787468fac42f2a8bafe87dc) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:33.031410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a6e01-7fae-4075-83ec-ae64289778cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:33.032860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a6e01-7fae-4075-83ec-ae64289778cb None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:33.039926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 223/444] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Aug 19 20:53:32 2022] GET /identity/v3/role_assignments?group.id=ae3d7ae4c4074b48b787f32e35244b1b&scope.project.id=90fb40089787468fac42f2a8bafe87dc&role.id=0fdbf18b17e545d9929e22ebddc1d5b7 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:33.040669 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a6e01-7fae-4075-83ec-ae64289778cb None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:33.105140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:33.162019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d83923-427f-4528-9cbe-83019b650336 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:33.175026 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a6e01-7fae-4075-83ec-ae64289778cb None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:33.204596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8de56-99d0-48de-95e2-74ae730a079a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:33.204815 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8de56-99d0-48de-95e2-74ae730a079a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:33.204932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8de56-99d0-48de-95e2-74ae730a079a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:33.205728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8de56-99d0-48de-95e2-74ae730a079a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:33.219440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8de56-99d0-48de-95e2-74ae730a079a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:33.221595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42dfbf6-3e11-4e9a-834d-ee0577466ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:33.222218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42dfbf6-3e11-4e9a-834d-ee0577466ddd None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:33.222501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42dfbf6-3e11-4e9a-834d-ee0577466ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:33.222881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42dfbf6-3e11-4e9a-834d-ee0577466ddd None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:33.223513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42dfbf6-3e11-4e9a-834d-ee0577466ddd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:33.223964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42dfbf6-3e11-4e9a-834d-ee0577466ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:33.225492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42dfbf6-3e11-4e9a-834d-ee0577466ddd None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-65f8de56-99d0-48de-95e2-74ae730a079a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:33.225692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:33.226881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:33.227893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:33.227893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:33.227893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:33.227893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:33.227893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:33.227893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:33.227893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:33.227893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:33.227893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:33.227893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:33.227893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:33.227893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:33.227893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 222/445] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:53:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:33.233760 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8de56-99d0-48de-95e2-74ae730a079a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:33.242340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 224/446] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:33.249535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42dfbf6-3e11-4e9a-834d-ee0577466ddd None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:33.292866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:33.364017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8de56-99d0-48de-95e2-74ae730a079a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:33.380579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42dfbf6-3e11-4e9a-834d-ee0577466ddd None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:33.397214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:33.417783 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939b27c-03bc-4530-99b9-67f69a0707fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:33.418691 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939b27c-03bc-4530-99b9-67f69a0707fe None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:33.419832 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939b27c-03bc-4530-99b9-67f69a0707fe None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:33.420272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f880-5990-49dc-96bf-d0f03f87cc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:33.420697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939b27c-03bc-4530-99b9-67f69a0707fe None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:33.420895 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f880-5990-49dc-96bf-d0f03f87cc9d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:33.421186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f880-5990-49dc-96bf-d0f03f87cc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:33.421465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f880-5990-49dc-96bf-d0f03f87cc9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:33.421666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939b27c-03bc-4530-99b9-67f69a0707fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:33.422153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939b27c-03bc-4530-99b9-67f69a0707fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:33.423383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939b27c-03bc-4530-99b9-67f69a0707fe None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:33.433339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 223/447] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:33.439995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939b27c-03bc-4530-99b9-67f69a0707fe None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:33.505926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197f880-5990-49dc-96bf-d0f03f87cc9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:33.507341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197f880-5990-49dc-96bf-d0f03f87cc9d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:33.548676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:33.569151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939b27c-03bc-4530-99b9-67f69a0707fe None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:33.608699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7f84c-d5bc-47c9-b428-ab8a0bad3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:33.609321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7f84c-d5bc-47c9-b428-ab8a0bad3b25 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:33.609614 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7f84c-d5bc-47c9-b428-ab8a0bad3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:33.609882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7f84c-d5bc-47c9-b428-ab8a0bad3b25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:33.633584 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 225/448] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 20:53:33.640204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f880-5990-49dc-96bf-d0f03f87cc9d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:33.667375 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:33.688611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7f84c-d5bc-47c9-b428-ab8a0bad3b25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:33.690087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7f84c-d5bc-47c9-b428-ab8a0bad3b25 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:33.741151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f880-5990-49dc-96bf-d0f03f87cc9d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:33.775040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:33.781967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd0332-879f-4fdf-ab80-0356abfcf8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:33.782605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd0332-879f-4fdf-ab80-0356abfcf8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:33.782926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd0332-879f-4fdf-ab80-0356abfcf8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:33.783207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd0332-879f-4fdf-ab80-0356abfcf8d3 None admin] PATH_INFO: `/v3/projects/ff8263e17f324e50a27d4a90ba61dbe6` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:33.784363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd0332-879f-4fdf-ab80-0356abfcf8d3 None admin] RBAC: Authorizing `identity:get_project(project_id=ff8263e17f324e50a27d4a90ba61dbe6)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:33.785793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd0332-879f-4fdf-ab80-0356abfcf8d3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:33.787457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 226/449] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:33 2022] GET /identity/v3/projects/ff8263e17f324e50a27d4a90ba61dbe6 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:33.793011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd0332-879f-4fdf-ab80-0356abfcf8d3 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:33.799075 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 224/450] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 20:53:33.804569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7f84c-d5bc-47c9-b428-ab8a0bad3b25 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:33.885804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:33.893690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd0332-879f-4fdf-ab80-0356abfcf8d3 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:33.907965 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7f84c-d5bc-47c9-b428-ab8a0bad3b25 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:33.928214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ae514-12fe-4380-a02a-99b008dcb51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:33.928847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ae514-12fe-4380-a02a-99b008dcb51b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:33.929132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ae514-12fe-4380-a02a-99b008dcb51b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:33.929411 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ae514-12fe-4380-a02a-99b008dcb51b None admin] PATH_INFO: `/v3/groups/ec1ee4f520bd437ab0a2b3c1bb574932` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:33.930540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ae514-12fe-4380-a02a-99b008dcb51b None admin] RBAC: Authorizing `identity:get_group(group_id=ec1ee4f520bd437ab0a2b3c1bb574932)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:33.932019 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ae514-12fe-4380-a02a-99b008dcb51b None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:33.933595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 227/451] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:33 2022] GET /identity/v3/groups/ec1ee4f520bd437ab0a2b3c1bb574932 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:33.940288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ae514-12fe-4380-a02a-99b008dcb51b None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:33.942055 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a22ef-a90f-49ae-8477-7d8ff4132d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:33.942693 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a22ef-a90f-49ae-8477-7d8ff4132d6c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:33.943292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a22ef-a90f-49ae-8477-7d8ff4132d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:33.943570 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a22ef-a90f-49ae-8477-7d8ff4132d6c None admin] PATH_INFO: `/v3/projects/9be09a7606624a74a92f8c33c2919615` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:33.945523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a22ef-a90f-49ae-8477-7d8ff4132d6c None admin] RBAC: Authorizing `identity:get_project(project_id=9be09a7606624a74a92f8c33c2919615)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:33.946997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a22ef-a90f-49ae-8477-7d8ff4132d6c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:33.948630 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 225/452] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:53:33 2022] GET /identity/v3/projects/9be09a7606624a74a92f8c33c2919615 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:33.955115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a22ef-a90f-49ae-8477-7d8ff4132d6c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:34.021389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:34.068891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ae514-12fe-4380-a02a-99b008dcb51b None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:34.075551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a22ef-a90f-49ae-8477-7d8ff4132d6c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:34.105018 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36198497-6418-45e1-87b7-94b273b702ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:34.105627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36198497-6418-45e1-87b7-94b273b702ce None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:34.105910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36198497-6418-45e1-87b7-94b273b702ce None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:34.106188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36198497-6418-45e1-87b7-94b273b702ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:34.107749 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36198497-6418-45e1-87b7-94b273b702ce None admin] RBAC: Adding query filter params (group.id=ec1ee4f520bd437ab0a2b3c1bb574932, role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=ff8263e17f324e50a27d4a90ba61dbe6) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:34.108063 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36198497-6418-45e1-87b7-94b273b702ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:34.109497 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36198497-6418-45e1-87b7-94b273b702ce None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:34.111703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94be78-540e-40a4-b326-1250659ebf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:34.112347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94be78-540e-40a4-b326-1250659ebf34 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:34.112634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94be78-540e-40a4-b326-1250659ebf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:34.112912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94be78-540e-40a4-b326-1250659ebf34 None admin] PATH_INFO: `/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:34.114049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94be78-540e-40a4-b326-1250659ebf34 None admin] RBAC: Authorizing `identity:get_group(group_id=ae3d7ae4c4074b48b787f32e35244b1b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:34.115509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 228/453] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Aug 19 20:53:33 2022] GET /identity/v3/role_assignments?group.id=ec1ee4f520bd437ab0a2b3c1bb574932&scope.project.id=ff8263e17f324e50a27d4a90ba61dbe6&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:34.115618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94be78-540e-40a4-b326-1250659ebf34 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:34.121594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 226/454] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Aug 19 20:53:33 2022] GET /identity/v3/groups/ae3d7ae4c4074b48b787f32e35244b1b => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:34.123573 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36198497-6418-45e1-87b7-94b273b702ce None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:34.233308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36198497-6418-45e1-87b7-94b273b702ce None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:34.263369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:34.270386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451456ff-5b45-4afd-97ba-1f76876c079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:34.271026 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451456ff-5b45-4afd-97ba-1f76876c079d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:34.271315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451456ff-5b45-4afd-97ba-1f76876c079d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:34.271642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451456ff-5b45-4afd-97ba-1f76876c079d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:34.272342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451456ff-5b45-4afd-97ba-1f76876c079d None admin] RBAC: Adding query filter params (group.id=ae3d7ae4c4074b48b787f32e35244b1b, role.id=0fdbf18b17e545d9929e22ebddc1d5b7, scope.project.id=9be09a7606624a74a92f8c33c2919615) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:34.272656 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451456ff-5b45-4afd-97ba-1f76876c079d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:34.274119 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451456ff-5b45-4afd-97ba-1f76876c079d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:34.281086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 229/455] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Aug 19 20:53:34 2022] GET /identity/v3/role_assignments?group.id=ae3d7ae4c4074b48b787f32e35244b1b&scope.project.id=9be09a7606624a74a92f8c33c2919615&role.id=0fdbf18b17e545d9929e22ebddc1d5b7 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:36.722948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd8766-5de7-47f6-956c-7b72a824518a None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:36.724018 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd8766-5de7-47f6-956c-7b72a824518a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:36.724553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd8766-5de7-47f6-956c-7b72a824518a None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:36.726508 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 227/456] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:36.733336 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3947a-7593-4542-a7be-0b1fdea6adc7 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:36.734179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3947a-7593-4542-a7be-0b1fdea6adc7 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:36.734611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3947a-7593-4542-a7be-0b1fdea6adc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:36.761773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-1da3947a-7593-4542-a7be-0b1fdea6adc7 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:36.763634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1da3947a-7593-4542-a7be-0b1fdea6adc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:36.860273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 230/457] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:37.036409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b75917-020d-4418-be41-e3e8531db724 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:37.036842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b75917-020d-4418-be41-e3e8531db724 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:37.037131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b75917-020d-4418-be41-e3e8531db724 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:37.038795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 228/458] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:37.046773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a5c47-4c8d-4156-a99a-59d2fed72962 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:37.047495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a5c47-4c8d-4156-a99a-59d2fed72962 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:37.048048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a5c47-4c8d-4156-a99a-59d2fed72962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:37.076356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-8c5a5c47-4c8d-4156-a99a-59d2fed72962 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:37.077911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8c5a5c47-4c8d-4156-a99a-59d2fed72962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:37.175558 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 231/459] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:37.241956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635cb01-fb87-4087-8d93-b3587983ce83 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:37.242584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635cb01-fb87-4087-8d93-b3587983ce83 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:37.243130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635cb01-fb87-4087-8d93-b3587983ce83 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:37.243384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a5c47-4c8d-4156-a99a-59d2fed72962 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:37.245128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 229/460] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:37.250571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8ce74-29f2-4d3c-ad20-5fc2f684ca3d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:37.250880 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8ce74-29f2-4d3c-ad20-5fc2f684ca3d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:37.251161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8ce74-29f2-4d3c-ad20-5fc2f684ca3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:37.280257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c6c8ce74-29f2-4d3c-ad20-5fc2f684ca3d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:37.281455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c6c8ce74-29f2-4d3c-ad20-5fc2f684ca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:37.308768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:37.353532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:37.402879 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 230/461] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:37.431272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a5c47-4c8d-4156-a99a-59d2fed72962 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:37.485198 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42346f78-1272-49de-9097-cb9a04e1ae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:37.485843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346f78-1272-49de-9097-cb9a04e1ae48 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:37.486123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346f78-1272-49de-9097-cb9a04e1ae48 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:37.486392 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346f78-1272-49de-9097-cb9a04e1ae48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:37.498794 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8ce74-29f2-4d3c-ad20-5fc2f684ca3d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:37.507187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42346f78-1272-49de-9097-cb9a04e1ae48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:37.508902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42346f78-1272-49de-9097-cb9a04e1ae48 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-42346f78-1272-49de-9097-cb9a04e1ae48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:37.541634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:37.542939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:37.544218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:37.544218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:37.544218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:37.554199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 232/462] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:53:37.559337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42346f78-1272-49de-9097-cb9a04e1ae48 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:37.713641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8ce74-29f2-4d3c-ad20-5fc2f684ca3d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:37.724750 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42346f78-1272-49de-9097-cb9a04e1ae48 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:37.734690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:37.774807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2a2ad-d09c-40cb-aa80-9a75b19e658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:37.775529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a2ad-d09c-40cb-aa80-9a75b19e658d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:37.775817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a2ad-d09c-40cb-aa80-9a75b19e658d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:37.776193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a2ad-d09c-40cb-aa80-9a75b19e658d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:37.777725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df7240-525e-4973-9fe8-40abf137bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:37.778534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7240-525e-4973-9fe8-40abf137bc50 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:37.778985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7240-525e-4973-9fe8-40abf137bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:37.779491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7240-525e-4973-9fe8-40abf137bc50 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:37.780136 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df7240-525e-4973-9fe8-40abf137bc50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:37.780443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df7240-525e-4973-9fe8-40abf137bc50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:37.781897 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df7240-525e-4973-9fe8-40abf137bc50 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:37.788162 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2a2ad-d09c-40cb-aa80-9a75b19e658d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:37.790124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2a2ad-d09c-40cb-aa80-9a75b19e658d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:37.799186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 233/463] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:37.800532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:37.801815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e249e-e1d1-4c9d-a344-766e37409ab7 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:37.802163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e249e-e1d1-4c9d-a344-766e37409ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:37.802440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e249e-e1d1-4c9d-a344-766e37409ab7 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:37.804443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 234/464] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:37.806108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e249e-e1d1-4c9d-a344-766e37409ab7 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-eee2a2ad-d09c-40cb-aa80-9a75b19e658d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:37.811471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:37.812364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:37.813219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:37.813219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:37.813219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:37.813219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 231/465] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:53:37.813840 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2a2ad-d09c-40cb-aa80-9a75b19e658d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:37.925655 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e249e-e1d1-4c9d-a344-766e37409ab7 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:37.928838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2a2ad-d09c-40cb-aa80-9a75b19e658d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:37.967686 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01ca0a-d17e-4c11-b385-7cf46562979b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:37.968331 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01ca0a-d17e-4c11-b385-7cf46562979b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:37.968632 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01ca0a-d17e-4c11-b385-7cf46562979b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:37.968881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01ca0a-d17e-4c11-b385-7cf46562979b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:37.972756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a980f6-8ea0-4957-822f-c6e11be4176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:37.973155 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a980f6-8ea0-4957-822f-c6e11be4176d None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:37.973442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a980f6-8ea0-4957-822f-c6e11be4176d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:37.973718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a980f6-8ea0-4957-822f-c6e11be4176d None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:37.974386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a980f6-8ea0-4957-822f-c6e11be4176d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:37.975873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a980f6-8ea0-4957-822f-c6e11be4176d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:37.980393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01ca0a-d17e-4c11-b385-7cf46562979b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:37.982658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01ca0a-d17e-4c11-b385-7cf46562979b None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:38.001603 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 232/466] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:53:37 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-1d01ca0a-d17e-4c11-b385-7cf46562979b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:38.001824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:38.002831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:38.009439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:38.009439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:38.009439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:38.009439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 235/467] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:38.009439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01ca0a-d17e-4c11-b385-7cf46562979b None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:38.013278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699c5c-12c3-48a2-b2fc-85df2bb09ffd None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:38.015081 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699c5c-12c3-48a2-b2fc-85df2bb09ffd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:38.015581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699c5c-12c3-48a2-b2fc-85df2bb09ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:38.045483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-bf699c5c-12c3-48a2-b2fc-85df2bb09ffd None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:38.047085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bf699c5c-12c3-48a2-b2fc-85df2bb09ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:38.048821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:38.131018 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:38.165493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 233/468] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:38.166683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf699c5c-12c3-48a2-b2fc-85df2bb09ffd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:38.187015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01ca0a-d17e-4c11-b385-7cf46562979b None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:38.229145 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8c5af-60ed-4380-a9d0-a09ba85c280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:38.229734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8c5af-60ed-4380-a9d0-a09ba85c280f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:38.230099 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8c5af-60ed-4380-a9d0-a09ba85c280f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:38.230439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8c5af-60ed-4380-a9d0-a09ba85c280f None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:38.231509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8c5af-60ed-4380-a9d0-a09ba85c280f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:38.232116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8c5af-60ed-4380-a9d0-a09ba85c280f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:38.234173 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8c5af-60ed-4380-a9d0-a09ba85c280f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:38.249527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 236/469] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:38.260191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8c5af-60ed-4380-a9d0-a09ba85c280f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:38.312381 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf699c5c-12c3-48a2-b2fc-85df2bb09ffd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:38.360465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b31c7e-b656-484b-93e8-ae01032a6ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:38.361466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b31c7e-b656-484b-93e8-ae01032a6ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:38.361966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b31c7e-b656-484b-93e8-ae01032a6ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:38.362460 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b31c7e-b656-484b-93e8-ae01032a6ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:38.363361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b31c7e-b656-484b-93e8-ae01032a6ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:38.363891 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b31c7e-b656-484b-93e8-ae01032a6ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:38.365491 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b31c7e-b656-484b-93e8-ae01032a6ab5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:38.386557 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 234/470] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:38.393300 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b31c7e-b656-484b-93e8-ae01032a6ab5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:38.426329 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:38.460752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:38.464380 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8c5af-60ed-4380-a9d0-a09ba85c280f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:38.517636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f6914-cfce-420d-97ec-be94f05e4b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:38.518605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f6914-cfce-420d-97ec-be94f05e4b29 None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:38.518937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f6914-cfce-420d-97ec-be94f05e4b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:38.519209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f6914-cfce-420d-97ec-be94f05e4b29 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:38.519858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f6914-cfce-420d-97ec-be94f05e4b29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:38.521830 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f6914-cfce-420d-97ec-be94f05e4b29 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:38.535288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b31c7e-b656-484b-93e8-ae01032a6ab5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:38.551315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 237/471] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:53:38 2022] POST /identity/v3/users => generated 248 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:53:38.552596 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311fe97-e8d6-4970-bf75-9c1543143cc2 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:38.552899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311fe97-e8d6-4970-bf75-9c1543143cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:38.553176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311fe97-e8d6-4970-bf75-9c1543143cc2 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:38.558948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 238/472] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:38.558948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311fe97-e8d6-4970-bf75-9c1543143cc2 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:38.598387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6edd55-c607-4e78-b74f-56d5d09189c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:38.599090 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6edd55-c607-4e78-b74f-56d5d09189c1 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:38.599378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6edd55-c607-4e78-b74f-56d5d09189c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:38.599638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6edd55-c607-4e78-b74f-56d5d09189c1 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:38.600307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6edd55-c607-4e78-b74f-56d5d09189c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:38.602208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6edd55-c607-4e78-b74f-56d5d09189c1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:38.634495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 235/473] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:53:38 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:53:38.636029 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a184fd5-c4f4-4559-b922-8765358ea13a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:38.636286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a184fd5-c4f4-4559-b922-8765358ea13a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:38.636634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a184fd5-c4f4-4559-b922-8765358ea13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:38.662939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2a184fd5-c4f4-4559-b922-8765358ea13a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:38.664540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2a184fd5-c4f4-4559-b922-8765358ea13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:38.780501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311fe97-e8d6-4970-bf75-9c1543143cc2 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:38.822791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 236/474] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:38.852096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb0b51-35f9-4429-a1bd-7283d87e7bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:38.853016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb0b51-35f9-4429-a1bd-7283d87e7bfc None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:38.853451 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb0b51-35f9-4429-a1bd-7283d87e7bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:38.853874 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb0b51-35f9-4429-a1bd-7283d87e7bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:38.856460 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:38.869606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb0b51-35f9-4429-a1bd-7283d87e7bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:38.871138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb0b51-35f9-4429-a1bd-7283d87e7bfc None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-44cb0b51-35f9-4429-a1bd-7283d87e7bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:38.890396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:38.892386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:38.894115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:38.894115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:38.894115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:38.894115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 239/475] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:38.897646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a184fd5-c4f4-4559-b922-8765358ea13a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:38.943253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:39.067535 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a184fd5-c4f4-4559-b922-8765358ea13a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:39.118884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dab6f-5fb7-487b-a380-7bcb4b53e558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:39.119535 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dab6f-5fb7-487b-a380-7bcb4b53e558 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:39.119819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dab6f-5fb7-487b-a380-7bcb4b53e558 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:39.120097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dab6f-5fb7-487b-a380-7bcb4b53e558 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:39.120897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dab6f-5fb7-487b-a380-7bcb4b53e558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:39.121213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dab6f-5fb7-487b-a380-7bcb4b53e558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:39.125111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dab6f-5fb7-487b-a380-7bcb4b53e558 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:39.125501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb0b51-35f9-4429-a1bd-7283d87e7bfc None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:39.146546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 237/476] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:39.147842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dab6f-5fb7-487b-a380-7bcb4b53e558 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:39.277932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:39.292243 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dab6f-5fb7-487b-a380-7bcb4b53e558 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:39.313925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb0b51-35f9-4429-a1bd-7283d87e7bfc None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:39.347743 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890e9c1-ccba-45e4-8a8a-aff465d90a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:39.348743 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890e9c1-ccba-45e4-8a8a-aff465d90a3f None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:39.349217 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890e9c1-ccba-45e4-8a8a-aff465d90a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:39.349548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890e9c1-ccba-45e4-8a8a-aff465d90a3f None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:39.350441 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890e9c1-ccba-45e4-8a8a-aff465d90a3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:39.353307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890e9c1-ccba-45e4-8a8a-aff465d90a3f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:39.392910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 238/477] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:53:39 2022] POST /identity/v3/users => generated 249 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 20:53:39.410706 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d474c4-de35-428c-9220-fcf6ca0928fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:39.411282 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d474c4-de35-428c-9220-fcf6ca0928fe None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:39.411561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d474c4-de35-428c-9220-fcf6ca0928fe None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:39.411835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d474c4-de35-428c-9220-fcf6ca0928fe None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:39.412637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d474c4-de35-428c-9220-fcf6ca0928fe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:39.414078 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d474c4-de35-428c-9220-fcf6ca0928fe None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:39.437151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.sql.core [None req-e8d474c4-de35-428c-9220-fcf6ca0928fe None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 19 20:53:39.437151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 19 20:53:39.437151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [parameters: {'id': 'f5ba19d0b2594b2d9e3f89a14607ad20', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 19 20:53:39.437151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81640) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-e8d474c4-de35-428c-9220-fcf6ca0928fe None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application conn.query(q) Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application result.read() Aug 19 20:53:39.461794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return ref.to_dict() Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 20:53:39.462793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application next(self.gen) Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application yield resource Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application next(self.gen) Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise self.value Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application session.commit() Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 20:53:39.463708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self.session.flush() Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application compat.raise_( Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 20:53:39.464559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 20:53:39.465463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application conn.query(q) Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application result.read() Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 20:53:39.467502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [parameters: {'id': 'f5ba19d0b2594b2d9e3f89a14607ad20', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:39.468565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 19 20:53:39.469366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:39.470218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 240/478] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Aug 19 20:53:39 2022] POST /identity/v3/roles => generated 144 bytes in 338 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:39.471651 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890e9c1-ccba-45e4-8a8a-aff465d90a3f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:39.685552 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890e9c1-ccba-45e4-8a8a-aff465d90a3f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:39.727691 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57014d-5091-40f3-bb16-635f5e4ded83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:39.728412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57014d-5091-40f3-bb16-635f5e4ded83 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:39.728698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57014d-5091-40f3-bb16-635f5e4ded83 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:39.728969 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57014d-5091-40f3-bb16-635f5e4ded83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:39.747873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57014d-5091-40f3-bb16-635f5e4ded83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-4e57014d-5091-40f3-bb16-635f5e4ded83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:39.753480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:39.756817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:39.759323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:39.759323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:39.759323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:39.759323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:39.759323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:39.759323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:39.759323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:39.759323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:39.759323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:39.759323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:39.759323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 20:53:39.759323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:39.759323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 239/479] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:53:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:39.766773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d474c4-de35-428c-9220-fcf6ca0928fe None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:39.855191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:39.912101 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d474c4-de35-428c-9220-fcf6ca0928fe None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:39.954203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84aa6a-f13e-4c07-8c08-856ee838f1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:39.954767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84aa6a-f13e-4c07-8c08-856ee838f1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:39.955074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84aa6a-f13e-4c07-8c08-856ee838f1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:39.955355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84aa6a-f13e-4c07-8c08-856ee838f1b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:39.956047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84aa6a-f13e-4c07-8c08-856ee838f1b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:39.956355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84aa6a-f13e-4c07-8c08-856ee838f1b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:39.957750 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84aa6a-f13e-4c07-8c08-856ee838f1b2 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:39.968308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 241/480] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:40.490791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a481970-0f07-425e-81f0-d6935d8ca7de None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:40.491321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a481970-0f07-425e-81f0-d6935d8ca7de None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:40.491426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a481970-0f07-425e-81f0-d6935d8ca7de None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:40.493070 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 240/481] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:53:40.499361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff02ff-4c30-4ce0-b952-4f295bfe9cb6 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:40.499697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff02ff-4c30-4ce0-b952-4f295bfe9cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:40.499978 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff02ff-4c30-4ce0-b952-4f295bfe9cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:40.524390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7aff02ff-4c30-4ce0-b952-4f295bfe9cb6 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:40.525649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7aff02ff-4c30-4ce0-b952-4f295bfe9cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:40.618864 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 242/482] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:40.902133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a481970-0f07-425e-81f0-d6935d8ca7de None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:40.918227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:41.127898 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a481970-0f07-425e-81f0-d6935d8ca7de None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:41.173352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a55e4b-24ac-4fbc-922c-342373a51530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:41.174011 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a55e4b-24ac-4fbc-922c-342373a51530 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:41.174294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a55e4b-24ac-4fbc-922c-342373a51530 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:41.174571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a55e4b-24ac-4fbc-922c-342373a51530 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:41.189225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a55e4b-24ac-4fbc-922c-342373a51530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-15a55e4b-24ac-4fbc-922c-342373a51530 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:41.196297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:41.200214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:41.201024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:41.201024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:41.201024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:41.201024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:41.201024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:41.201024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:41.201024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:41.201024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:41.201024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:41.201024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:41.201024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:41.201024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:41.201024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 241/483] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:41.203267 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff02ff-4c30-4ce0-b952-4f295bfe9cb6 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:41.317374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:41.358715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac77ee8-8d06-4e0f-8e54-a93c688ad8fc None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:41.359554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac77ee8-8d06-4e0f-8e54-a93c688ad8fc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:41.360253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac77ee8-8d06-4e0f-8e54-a93c688ad8fc None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:41.363701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 242/484] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:53:41.373528 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c9b31-9c52-4e0d-ad9b-db1e50aa8fc0 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:41.374311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c9b31-9c52-4e0d-ad9b-db1e50aa8fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:41.375047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c9b31-9c52-4e0d-ad9b-db1e50aa8fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:41.425786 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c75c9b31-9c52-4e0d-ad9b-db1e50aa8fc0 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:41.426095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c75c9b31-9c52-4e0d-ad9b-db1e50aa8fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:41.485163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff02ff-4c30-4ce0-b952-4f295bfe9cb6 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:41.579592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed19aa4-8316-4723-a72a-8f552bd5055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:41.580858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19aa4-8316-4723-a72a-8f552bd5055b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:41.581495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19aa4-8316-4723-a72a-8f552bd5055b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:41.582179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19aa4-8316-4723-a72a-8f552bd5055b None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:41.583651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed19aa4-8316-4723-a72a-8f552bd5055b None admin] RBAC: Adding query filter params (name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:41.584390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed19aa4-8316-4723-a72a-8f552bd5055b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:41.587203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed19aa4-8316-4723-a72a-8f552bd5055b None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:41.587710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:41.604335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 243/485] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:41.604747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 243/486] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:53:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:41.612056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c9b31-9c52-4e0d-ad9b-db1e50aa8fc0 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:41.850878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c9b31-9c52-4e0d-ad9b-db1e50aa8fc0 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:41.942146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c693e1-1a70-447c-a606-02c0d4f6ed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:41.943236 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c693e1-1a70-447c-a606-02c0d4f6ed3b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:41.943731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c693e1-1a70-447c-a606-02c0d4f6ed3b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:41.944220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c693e1-1a70-447c-a606-02c0d4f6ed3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:41.969954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c693e1-1a70-447c-a606-02c0d4f6ed3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:41.972748 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c693e1-1a70-447c-a606-02c0d4f6ed3b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-34c693e1-1a70-447c-a606-02c0d4f6ed3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:42.010350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:42.011346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:42.013014 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:42.013014 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:42.013014 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:42.013340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 244/487] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:42.020743 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed19aa4-8316-4723-a72a-8f552bd5055b None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:42.061840 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8eab4-a3b9-4c8a-a81c-c7520b0346b1 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:42.062606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8eab4-a3b9-4c8a-a81c-c7520b0346b1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:42.063438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8eab4-a3b9-4c8a-a81c-c7520b0346b1 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:42.066438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 245/488] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:42.079626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94abf-a14d-45bb-99d2-bd5c82a213cd None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:42.080481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94abf-a14d-45bb-99d2-bd5c82a213cd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:42.081248 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94abf-a14d-45bb-99d2-bd5c82a213cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:42.120119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-38f94abf-a14d-45bb-99d2-bd5c82a213cd None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:42.121352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-38f94abf-a14d-45bb-99d2-bd5c82a213cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:42.211468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed19aa4-8316-4723-a72a-8f552bd5055b None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:42.215365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:42.227051 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:42.264019 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece594d-265c-4e72-9454-056e383fe9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:42.264991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece594d-265c-4e72-9454-056e383fe9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:42.265435 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece594d-265c-4e72-9454-056e383fe9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:42.265948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece594d-265c-4e72-9454-056e383fe9f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:42.266770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece594d-265c-4e72-9454-056e383fe9f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:42.267328 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece594d-265c-4e72-9454-056e383fe9f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:42.268880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece594d-265c-4e72-9454-056e383fe9f8 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:42.279725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 246/489] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:42.282912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f94abf-a14d-45bb-99d2-bd5c82a213cd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:42.290186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 244/490] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:42.293218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece594d-265c-4e72-9454-056e383fe9f8 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:42.509908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f94abf-a14d-45bb-99d2-bd5c82a213cd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:42.556850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece594d-265c-4e72-9454-056e383fe9f8 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:42.576720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d2119-0002-4849-a80d-5c95b1fe85ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:42.578292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2119-0002-4849-a80d-5c95b1fe85ba None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:42.579104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2119-0002-4849-a80d-5c95b1fe85ba None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:42.579841 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2119-0002-4849-a80d-5c95b1fe85ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:42.600516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d2119-0002-4849-a80d-5c95b1fe85ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-5a6d2119-0002-4849-a80d-5c95b1fe85ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:42.614357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:42.616241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:42.617809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:42.617809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:42.617809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:42.617809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:42.617809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:42.617809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:42.617809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:42.617809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:42.617809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:42.617809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:42.617809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:42.617809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:42.622596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 247/491] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:42.636938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d2119-0002-4849-a80d-5c95b1fe85ba None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:42.665939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27635e-f350-4cd8-b39c-f22ad371f73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:42.666884 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27635e-f350-4cd8-b39c-f22ad371f73f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:42.667317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27635e-f350-4cd8-b39c-f22ad371f73f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:42.667737 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27635e-f350-4cd8-b39c-f22ad371f73f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:42.677331 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27635e-f350-4cd8-b39c-f22ad371f73f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:42.679275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27635e-f350-4cd8-b39c-f22ad371f73f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-3f27635e-f350-4cd8-b39c-f22ad371f73f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:53:42.694235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:42.695276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:42.696184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:42.696184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:42.696184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:53:42.696184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:53:42.696184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:53:42.696184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:53:42.696184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:53:42.696184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:53:42.696184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:53:42.696184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:42.706037 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 245/492] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Aug 19 20:53:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:53:42.707368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27635e-f350-4cd8-b39c-f22ad371f73f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:42.735669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:42.755993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:42.822426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d2119-0002-4849-a80d-5c95b1fe85ba None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:42.864996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547cb8c-872a-4720-aa7e-ea5055ae2e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:42.866006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547cb8c-872a-4720-aa7e-ea5055ae2e0d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:42.866502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547cb8c-872a-4720-aa7e-ea5055ae2e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:42.867066 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547cb8c-872a-4720-aa7e-ea5055ae2e0d None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:42.868074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547cb8c-872a-4720-aa7e-ea5055ae2e0d None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:42.868629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547cb8c-872a-4720-aa7e-ea5055ae2e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:42.870296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547cb8c-872a-4720-aa7e-ea5055ae2e0d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:42.881124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 248/493] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:53:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:42.882505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547cb8c-872a-4720-aa7e-ea5055ae2e0d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:42.936245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27635e-f350-4cd8-b39c-f22ad371f73f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:42.999583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88efc2-bb9f-4465-b333-a6e9ffd771b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:43.000677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88efc2-bb9f-4465-b333-a6e9ffd771b6 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:43.001181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88efc2-bb9f-4465-b333-a6e9ffd771b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:43.001676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88efc2-bb9f-4465-b333-a6e9ffd771b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:43.023250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88efc2-bb9f-4465-b333-a6e9ffd771b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-ca88efc2-bb9f-4465-b333-a6e9ffd771b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:43.036010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:43.037003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:43.037808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:43.037808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:43.037808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:43.037808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:43.037808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:43.037808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:43.037808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:43.037808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:43.037808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:43.037808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:43.037808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:43.037808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:43.039422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 246/494] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:43.039544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88efc2-bb9f-4465-b333-a6e9ffd771b6 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:43.049922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:43.055265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547cb8c-872a-4720-aa7e-ea5055ae2e0d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:43.119888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94426d-8901-40a8-806f-3cfc5c02969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:43.120904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94426d-8901-40a8-806f-3cfc5c02969d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:43.121294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94426d-8901-40a8-806f-3cfc5c02969d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:43.121644 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94426d-8901-40a8-806f-3cfc5c02969d None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:43.122767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94426d-8901-40a8-806f-3cfc5c02969d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:43.123201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94426d-8901-40a8-806f-3cfc5c02969d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:43.124927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94426d-8901-40a8-806f-3cfc5c02969d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:43.166395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 249/495] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Aug 19 20:53:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:43.167817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad085a-0812-4482-8c3d-2625b0c56777 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:43.168326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad085a-0812-4482-8c3d-2625b0c56777 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:43.168495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad085a-0812-4482-8c3d-2625b0c56777 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:43.174837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 250/496] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:43.174837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad085a-0812-4482-8c3d-2625b0c56777 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:43.192571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:43.222086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88efc2-bb9f-4465-b333-a6e9ffd771b6 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:43.281773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a539688-14b7-4082-b89e-2aadee58c21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:43.282766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a539688-14b7-4082-b89e-2aadee58c21b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:43.283284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a539688-14b7-4082-b89e-2aadee58c21b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:43.283793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a539688-14b7-4082-b89e-2aadee58c21b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:43.292750 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad085a-0812-4482-8c3d-2625b0c56777 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:43.304200 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a539688-14b7-4082-b89e-2aadee58c21b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:43.307056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a539688-14b7-4082-b89e-2aadee58c21b None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:43.332109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19760735-69e3-4de7-ad7d-1413f6800670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:43.332734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19760735-69e3-4de7-ad7d-1413f6800670 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:43.333021 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19760735-69e3-4de7-ad7d-1413f6800670 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:43.333304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19760735-69e3-4de7-ad7d-1413f6800670 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:43.333988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19760735-69e3-4de7-ad7d-1413f6800670 None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-7a539688-14b7-4082-b89e-2aadee58c21b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:43.334087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:43.334983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:43.335875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:43.335875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:43.335875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:43.336036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19760735-69e3-4de7-ad7d-1413f6800670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:43.336104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 247/497] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:43.336168 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19760735-69e3-4de7-ad7d-1413f6800670 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:43.338096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8ca9e-9cbe-4d32-a4b6-0db58b398a44 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:43.338558 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8ca9e-9cbe-4d32-a4b6-0db58b398a44 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:43.340491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8ca9e-9cbe-4d32-a4b6-0db58b398a44 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:43.341864 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 248/498] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:43.343624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8ca9e-9cbe-4d32-a4b6-0db58b398a44 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:43.354566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 251/499] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:53:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:43.355884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fcd30-26ad-4ba3-9be0-e59cc97065fd None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:43.356181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fcd30-26ad-4ba3-9be0-e59cc97065fd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:43.356511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fcd30-26ad-4ba3-9be0-e59cc97065fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:43.377472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8a2fcd30-26ad-4ba3-9be0-e59cc97065fd None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:43.378758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8a2fcd30-26ad-4ba3-9be0-e59cc97065fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:43.397077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:43.469173 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 252/500] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:43.470038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fcd30-26ad-4ba3-9be0-e59cc97065fd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:43.479277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8ca9e-9cbe-4d32-a4b6-0db58b398a44 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:43.533163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdccdd4-de71-4579-9ecb-fc370cd0854d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:43.534022 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdccdd4-de71-4579-9ecb-fc370cd0854d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:43.534494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdccdd4-de71-4579-9ecb-fc370cd0854d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:43.534989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdccdd4-de71-4579-9ecb-fc370cd0854d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:43.541366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:43.643328 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fcd30-26ad-4ba3-9be0-e59cc97065fd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:43.649060 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdccdd4-de71-4579-9ecb-fc370cd0854d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:43.651607 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdccdd4-de71-4579-9ecb-fc370cd0854d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:43.705908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63479b88-a94f-40e8-a8f7-665e1524582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:43.706895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479b88-a94f-40e8-a8f7-665e1524582e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:43.707261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479b88-a94f-40e8-a8f7-665e1524582e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:43.707713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479b88-a94f-40e8-a8f7-665e1524582e None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:43.708816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63479b88-a94f-40e8-a8f7-665e1524582e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:43.709316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63479b88-a94f-40e8-a8f7-665e1524582e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:43.711306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63479b88-a94f-40e8-a8f7-665e1524582e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:43.747546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 253/501] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:43.750501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971190d-84b1-4d17-a663-60facf29997b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:43.751160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971190d-84b1-4d17-a663-60facf29997b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:43.751574 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971190d-84b1-4d17-a663-60facf29997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:43.776180 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-3971190d-84b1-4d17-a663-60facf29997b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:43.777830 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3971190d-84b1-4d17-a663-60facf29997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:43.782784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:43.815741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 249/502] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:43.816893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdccdd4-de71-4579-9ecb-fc370cd0854d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:43.874043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:43.876931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 254/503] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:43.888750 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971190d-84b1-4d17-a663-60facf29997b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:43.958571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdccdd4-de71-4579-9ecb-fc370cd0854d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:44.011053 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26298fd-99ab-4c1e-9e2c-eceaf028e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:44.012404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26298fd-99ab-4c1e-9e2c-eceaf028e91b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:44.013813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26298fd-99ab-4c1e-9e2c-eceaf028e91b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:44.014539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26298fd-99ab-4c1e-9e2c-eceaf028e91b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:44.029507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26298fd-99ab-4c1e-9e2c-eceaf028e91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:44.033363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26298fd-99ab-4c1e-9e2c-eceaf028e91b None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-c26298fd-99ab-4c1e-9e2c-eceaf028e91b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:44.059424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:44.061362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:44.062199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:44.062199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:44.062199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:44.068998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 250/504] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:44.068998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26298fd-99ab-4c1e-9e2c-eceaf028e91b None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:44.084429 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971190d-84b1-4d17-a663-60facf29997b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:44.143570 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1ca13-0920-4390-9f37-855aada8cd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:44.144378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1ca13-0920-4390-9f37-855aada8cd36 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:44.144827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1ca13-0920-4390-9f37-855aada8cd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:44.145593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1ca13-0920-4390-9f37-855aada8cd36 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:44.156139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1ca13-0920-4390-9f37-855aada8cd36 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:44.157608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1ca13-0920-4390-9f37-855aada8cd36 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:44.161856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-a4d1ca13-0920-4390-9f37-855aada8cd36 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:53:44.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:44.176767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:44.179225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:44.179225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:44.179225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:53:44.179225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:53:44.179225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:53:44.179225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:53:44.179225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:53:44.179225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:53:44.179225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 20:53:44.179225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:44.179225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 255/505] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:44.179225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1ca13-0920-4390-9f37-855aada8cd36 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:44.213526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:44.227565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26298fd-99ab-4c1e-9e2c-eceaf028e91b None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:44.268452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7c7bc-8653-4e9f-8d29-03e1b2e6ac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:44.269094 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7c7bc-8653-4e9f-8d29-03e1b2e6ac67 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:44.269382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7c7bc-8653-4e9f-8d29-03e1b2e6ac67 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:44.269657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7c7bc-8653-4e9f-8d29-03e1b2e6ac67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:44.281986 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7c7bc-8653-4e9f-8d29-03e1b2e6ac67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:44.283530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7c7bc-8653-4e9f-8d29-03e1b2e6ac67 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-86a7c7bc-8653-4e9f-8d29-03e1b2e6ac67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:44.299415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:44.300941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:44.302575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:44.302575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:44.302575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:44.302575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 251/506] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:44.302575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7c7bc-8653-4e9f-8d29-03e1b2e6ac67 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:44.346138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1ca13-0920-4390-9f37-855aada8cd36 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:44.389273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8869782-6640-494a-8a28-bf259a20a322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:44.389922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8869782-6640-494a-8a28-bf259a20a322 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:44.390204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8869782-6640-494a-8a28-bf259a20a322 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:44.390485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8869782-6640-494a-8a28-bf259a20a322 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:44.402920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8869782-6640-494a-8a28-bf259a20a322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-e8869782-6640-494a-8a28-bf259a20a322 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:44.408474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:44.409615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:44.410542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:44.410542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:44.410542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:44.410542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:44.410542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:44.410542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:44.410542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:44.410542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:44.410542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:44.410542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:44.410542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:44.410542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:44.410542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 256/507] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:44.411328 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8869782-6640-494a-8a28-bf259a20a322 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:44.439721 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7c7bc-8653-4e9f-8d29-03e1b2e6ac67 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:44.478631 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:44.484107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab772c-1c6e-4278-9997-9b88681ae58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:44.485359 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab772c-1c6e-4278-9997-9b88681ae58e None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:44.485751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab772c-1c6e-4278-9997-9b88681ae58e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:44.486256 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab772c-1c6e-4278-9997-9b88681ae58e None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:44.487501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab772c-1c6e-4278-9997-9b88681ae58e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:44.488176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab772c-1c6e-4278-9997-9b88681ae58e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:44.490843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab772c-1c6e-4278-9997-9b88681ae58e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:44.504368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:44.508304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 252/508] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:44.509440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab772c-1c6e-4278-9997-9b88681ae58e None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:44.541864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8869782-6640-494a-8a28-bf259a20a322 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:44.582317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b7d6e-36f9-48d5-9525-736ab2dd89f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:44.583347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7d6e-36f9-48d5-9525-736ab2dd89f8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:44.583696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7d6e-36f9-48d5-9525-736ab2dd89f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:44.584070 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7d6e-36f9-48d5-9525-736ab2dd89f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:44.595674 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b7d6e-36f9-48d5-9525-736ab2dd89f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:44.597216 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b7d6e-36f9-48d5-9525-736ab2dd89f8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-577b7d6e-36f9-48d5-9525-736ab2dd89f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:44.614940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:44.616319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:44.618452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:44.618452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:44.618452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:44.618452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 257/509] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:44.618452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b7d6e-36f9-48d5-9525-736ab2dd89f8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:44.626769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab772c-1c6e-4278-9997-9b88681ae58e None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:44.671477 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8120d-011e-4499-9ba1-df0c6b99903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:44.672472 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8120d-011e-4499-9ba1-df0c6b99903d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:44.672761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8120d-011e-4499-9ba1-df0c6b99903d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:44.673040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8120d-011e-4499-9ba1-df0c6b99903d None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:44.674419 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8120d-011e-4499-9ba1-df0c6b99903d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:44.675028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8120d-011e-4499-9ba1-df0c6b99903d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:44.677927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8120d-011e-4499-9ba1-df0c6b99903d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:44.730932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 253/510] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Aug 19 20:53:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:44.732575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8120d-011e-4499-9ba1-df0c6b99903d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:44.747684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b7d6e-36f9-48d5-9525-736ab2dd89f8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:44.763971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:44.799379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feb335-1d39-432a-9722-95517c8100b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:44.800019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb335-1d39-432a-9722-95517c8100b8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:44.800303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb335-1d39-432a-9722-95517c8100b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:44.800581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb335-1d39-432a-9722-95517c8100b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:44.801263 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feb335-1d39-432a-9722-95517c8100b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:44.801570 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feb335-1d39-432a-9722-95517c8100b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:44.803068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feb335-1d39-432a-9722-95517c8100b8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:44.817544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:44.819027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 258/511] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:44.820565 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feb335-1d39-432a-9722-95517c8100b8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:44.867542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8120d-011e-4499-9ba1-df0c6b99903d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:44.917084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa047f6-630b-48d5-832c-eadb148c38b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:44.917965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa047f6-630b-48d5-832c-eadb148c38b7 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:44.918470 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa047f6-630b-48d5-832c-eadb148c38b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:44.919020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa047f6-630b-48d5-832c-eadb148c38b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:44.920454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa047f6-630b-48d5-832c-eadb148c38b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:44.921018 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa047f6-630b-48d5-832c-eadb148c38b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:44.923429 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa047f6-630b-48d5-832c-eadb148c38b7 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:44.941333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 254/512] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:53:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:44.942970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa047f6-630b-48d5-832c-eadb148c38b7 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:44.958671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feb335-1d39-432a-9722-95517c8100b8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:45.004386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd9567-e806-4f2c-8284-8403de81baa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:45.005304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd9567-e806-4f2c-8284-8403de81baa0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:45.005590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd9567-e806-4f2c-8284-8403de81baa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:45.005861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd9567-e806-4f2c-8284-8403de81baa0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:45.015168 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd9567-e806-4f2c-8284-8403de81baa0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:45.016692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd9567-e806-4f2c-8284-8403de81baa0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-75bd9567-e806-4f2c-8284-8403de81baa0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:53:45.031123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:45.032539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:45.033643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:45.033643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:45.033643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:53:45.033643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:53:45.033643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:53:45.033643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:53:45.033643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:53:45.033643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:53:45.033643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 20:53:45.033643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:45.033643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 259/513] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:45.033643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd9567-e806-4f2c-8284-8403de81baa0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:45.071240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:45.088146 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa047f6-630b-48d5-832c-eadb148c38b7 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:45.113056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:45.133221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801acfc-232b-46d8-99eb-2c97446b6bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:45.134110 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801acfc-232b-46d8-99eb-2c97446b6bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:45.134557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801acfc-232b-46d8-99eb-2c97446b6bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:45.134998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801acfc-232b-46d8-99eb-2c97446b6bf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:45.135790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801acfc-232b-46d8-99eb-2c97446b6bf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:45.136293 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801acfc-232b-46d8-99eb-2c97446b6bf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:45.137926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801acfc-232b-46d8-99eb-2c97446b6bf4 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:45.154665 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 255/514] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:45.155262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801acfc-232b-46d8-99eb-2c97446b6bf4 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:45.199848 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd9567-e806-4f2c-8284-8403de81baa0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:45.241478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53320e2-5198-4c31-a335-8fab6f352e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:45.242121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53320e2-5198-4c31-a335-8fab6f352e17 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:45.242403 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53320e2-5198-4c31-a335-8fab6f352e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:45.242684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53320e2-5198-4c31-a335-8fab6f352e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:45.280697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801acfc-232b-46d8-99eb-2c97446b6bf4 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:45.323249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d6452-89f9-44d8-9820-1ce9d0c8e634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:45.323884 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d6452-89f9-44d8-9820-1ce9d0c8e634 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:45.324160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d6452-89f9-44d8-9820-1ce9d0c8e634 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:45.324434 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d6452-89f9-44d8-9820-1ce9d0c8e634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:45.331461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53320e2-5198-4c31-a335-8fab6f352e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:45.332003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d6452-89f9-44d8-9820-1ce9d0c8e634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:45.332964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53320e2-5198-4c31-a335-8fab6f352e17 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:45.333436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d6452-89f9-44d8-9820-1ce9d0c8e634 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-067d6452-89f9-44d8-9820-1ce9d0c8e634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:53:45.350492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:45.351469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:45.352532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:53:45.352532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:53:45.352532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:53:45.352532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:53:45.352532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:53:45.352532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:53:45.352532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:45.352532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:45.352532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 256/515] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:45.352532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d6452-89f9-44d8-9820-1ce9d0c8e634 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:45.376853 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:45.402161 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:45.451661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 260/516] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:45.452529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53320e2-5198-4c31-a335-8fab6f352e17 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:45.463344 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d6452-89f9-44d8-9820-1ce9d0c8e634 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:45.499351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31990a-71d3-4b31-b5fa-3946c9a3f5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:45.499985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31990a-71d3-4b31-b5fa-3946c9a3f5fa None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:45.500265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31990a-71d3-4b31-b5fa-3946c9a3f5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:45.500537 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31990a-71d3-4b31-b5fa-3946c9a3f5fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:45.511691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31990a-71d3-4b31-b5fa-3946c9a3f5fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:45.513775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31990a-71d3-4b31-b5fa-3946c9a3f5fa None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-6b31990a-71d3-4b31-b5fa-3946c9a3f5fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:45.529121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:45.530123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:45.531033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:45.531033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:45.531033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:45.531033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 257/517] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:45.531252 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31990a-71d3-4b31-b5fa-3946c9a3f5fa None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:45.558066 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53320e2-5198-4c31-a335-8fab6f352e17 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:45.588632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:45.594683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a59d14-42aa-4a80-b1a8-5c439ef7ec73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:45.595326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a59d14-42aa-4a80-b1a8-5c439ef7ec73 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:45.595600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a59d14-42aa-4a80-b1a8-5c439ef7ec73 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:45.595875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a59d14-42aa-4a80-b1a8-5c439ef7ec73 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:45.596605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a59d14-42aa-4a80-b1a8-5c439ef7ec73 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:45.596909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a59d14-42aa-4a80-b1a8-5c439ef7ec73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:45.598329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a59d14-42aa-4a80-b1a8-5c439ef7ec73 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:45.615995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 261/518] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Aug 19 20:53:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:45.616835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a59d14-42aa-4a80-b1a8-5c439ef7ec73 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:45.626207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:45.635657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31990a-71d3-4b31-b5fa-3946c9a3f5fa None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:45.671983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a991d2-cbf3-46dd-a331-b15fa9d52bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:45.672512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a991d2-cbf3-46dd-a331-b15fa9d52bb0 None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:45.672796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a991d2-cbf3-46dd-a331-b15fa9d52bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:45.673071 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a991d2-cbf3-46dd-a331-b15fa9d52bb0 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:45.673724 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a991d2-cbf3-46dd-a331-b15fa9d52bb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:45.675204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a991d2-cbf3-46dd-a331-b15fa9d52bb0 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:45.696309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 258/519] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:53:45 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:53:45.697399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a991d2-cbf3-46dd-a331-b15fa9d52bb0 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:45.737212 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a59d14-42aa-4a80-b1a8-5c439ef7ec73 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:45.789273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b6df0-0cf9-44f8-a26d-835049f30196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:45.789932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b6df0-0cf9-44f8-a26d-835049f30196 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:45.790187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b6df0-0cf9-44f8-a26d-835049f30196 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:45.790457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b6df0-0cf9-44f8-a26d-835049f30196 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:45.791230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b6df0-0cf9-44f8-a26d-835049f30196 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:45.791543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b6df0-0cf9-44f8-a26d-835049f30196 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:45.793736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b6df0-0cf9-44f8-a26d-835049f30196 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:45.819927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 262/520] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:53:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:45.819927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b6df0-0cf9-44f8-a26d-835049f30196 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:45.829848 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a991d2-cbf3-46dd-a331-b15fa9d52bb0 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:45.877841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d867d-bc0d-47f8-96c4-87dd34bf7af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:45.878497 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d867d-bc0d-47f8-96c4-87dd34bf7af0 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:45.879879 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d867d-bc0d-47f8-96c4-87dd34bf7af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:45.880427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d867d-bc0d-47f8-96c4-87dd34bf7af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:45.883363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:45.894457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d867d-bc0d-47f8-96c4-87dd34bf7af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:45.896294 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d867d-bc0d-47f8-96c4-87dd34bf7af0 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:45.906431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-af5d867d-bc0d-47f8-96c4-87dd34bf7af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:45.913893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:45.915058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:45.916073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:45.916073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:45.916073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:45.916073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 259/521] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:45.918373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d867d-bc0d-47f8-96c4-87dd34bf7af0 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:45.951860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b6df0-0cf9-44f8-a26d-835049f30196 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:45.990014 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222643cb-da78-47c8-901e-1ca100c95bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:45.990638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222643cb-da78-47c8-901e-1ca100c95bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:45.990947 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222643cb-da78-47c8-901e-1ca100c95bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:45.991221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222643cb-da78-47c8-901e-1ca100c95bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:45.991878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222643cb-da78-47c8-901e-1ca100c95bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:45.992183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222643cb-da78-47c8-901e-1ca100c95bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:45.993564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222643cb-da78-47c8-901e-1ca100c95bb4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:46.006992 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 263/522] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:46.007734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222643cb-da78-47c8-901e-1ca100c95bb4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:46.036150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d867d-bc0d-47f8-96c4-87dd34bf7af0 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:46.078915 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c515f7-2a2f-4e19-b447-9cca3f60a7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:46.080122 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c515f7-2a2f-4e19-b447-9cca3f60a7bd None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:46.080591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c515f7-2a2f-4e19-b447-9cca3f60a7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:46.081036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c515f7-2a2f-4e19-b447-9cca3f60a7bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:46.123902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222643cb-da78-47c8-901e-1ca100c95bb4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:46.136497 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:46.160306 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:46.162878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3201d-d70d-40cd-83f9-87943d1f9968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:46.163638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c515f7-2a2f-4e19-b447-9cca3f60a7bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:46.164160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3201d-d70d-40cd-83f9-87943d1f9968 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:46.164601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3201d-d70d-40cd-83f9-87943d1f9968 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:46.164884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3201d-d70d-40cd-83f9-87943d1f9968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:46.165284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c515f7-2a2f-4e19-b447-9cca3f60a7bd None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:46.165650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3201d-d70d-40cd-83f9-87943d1f9968 None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=83e51beb8d0e4219af906860ce906500) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:46.165971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3201d-d70d-40cd-83f9-87943d1f9968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:46.167494 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3201d-d70d-40cd-83f9-87943d1f9968 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:46.182770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 264/523] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:53:46 2022] GET /identity/v3/role_assignments?user.id=83e51beb8d0e4219af906860ce906500&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:46.182770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3201d-d70d-40cd-83f9-87943d1f9968 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:46.305830 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 260/524] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:46.306841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c515f7-2a2f-4e19-b447-9cca3f60a7bd None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:46.332289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3201d-d70d-40cd-83f9-87943d1f9968 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:46.382649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e313a12-d693-4792-9a57-33115b3adae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:46.383623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e313a12-d693-4792-9a57-33115b3adae4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:46.384080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e313a12-d693-4792-9a57-33115b3adae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:46.384539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e313a12-d693-4792-9a57-33115b3adae4 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:46.385626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e313a12-d693-4792-9a57-33115b3adae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:46.386718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e313a12-d693-4792-9a57-33115b3adae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:46.389272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e313a12-d693-4792-9a57-33115b3adae4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:46.408040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 265/525] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:46.409870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e313a12-d693-4792-9a57-33115b3adae4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:46.425301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:46.428970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c515f7-2a2f-4e19-b447-9cca3f60a7bd None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:46.455020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:46.471929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e068c23-05f0-4da3-a70f-ffec022c4547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:46.472919 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e068c23-05f0-4da3-a70f-ffec022c4547 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:46.473342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e068c23-05f0-4da3-a70f-ffec022c4547 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:46.473850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e068c23-05f0-4da3-a70f-ffec022c4547 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:46.482726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e068c23-05f0-4da3-a70f-ffec022c4547 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:46.484658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e068c23-05f0-4da3-a70f-ffec022c4547 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-1e068c23-05f0-4da3-a70f-ffec022c4547 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:53:46.498075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:46.499151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:46.500041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:46.500041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:46.500041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:53:46.500041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:53:46.500041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:53:46.500041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:53:46.500041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:53:46.500041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:53:46.500041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 20:53:46.500041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:46.507086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 261/526] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:46.508515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e068c23-05f0-4da3-a70f-ffec022c4547 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:46.532840 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e313a12-d693-4792-9a57-33115b3adae4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:46.583543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd14cd2-d688-41fb-8316-ee35add78a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:46.584197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd14cd2-d688-41fb-8316-ee35add78a14 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:46.584550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd14cd2-d688-41fb-8316-ee35add78a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:46.584896 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd14cd2-d688-41fb-8316-ee35add78a14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:46.600388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd14cd2-d688-41fb-8316-ee35add78a14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:46.602525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd14cd2-d688-41fb-8316-ee35add78a14 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-bfd14cd2-d688-41fb-8316-ee35add78a14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:46.625579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:46.626590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:46.627580 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:46.627580 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:46.627580 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:46.627580 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 266/527] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:46.628624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd14cd2-d688-41fb-8316-ee35add78a14 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:46.634251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e068c23-05f0-4da3-a70f-ffec022c4547 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:46.673281 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e92d81-ef51-48ec-b8e4-3647042d766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:46.674310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e92d81-ef51-48ec-b8e4-3647042d766c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:46.674808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e92d81-ef51-48ec-b8e4-3647042d766c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:46.675280 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e92d81-ef51-48ec-b8e4-3647042d766c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:46.682949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e92d81-ef51-48ec-b8e4-3647042d766c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:46.685562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e92d81-ef51-48ec-b8e4-3647042d766c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-f2e92d81-ef51-48ec-b8e4-3647042d766c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:53:46.698946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:46.701203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:46.702215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:53:46.702215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:53:46.702215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:53:46.702215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:53:46.702215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:53:46.702215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:53:46.702215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:46.702215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:46.705244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 262/528] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:46.706413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e92d81-ef51-48ec-b8e4-3647042d766c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:46.740318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:46.747938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:46.762755 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd14cd2-d688-41fb-8316-ee35add78a14 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:46.803918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d5768-065c-486f-83fd-39d362709be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:46.804599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d5768-065c-486f-83fd-39d362709be3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:46.804863 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d5768-065c-486f-83fd-39d362709be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:46.805634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d5768-065c-486f-83fd-39d362709be3 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:46.806598 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d5768-065c-486f-83fd-39d362709be3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:46.807083 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d5768-065c-486f-83fd-39d362709be3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:46.808839 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d5768-065c-486f-83fd-39d362709be3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:46.834114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 267/529] 10.222.0.17 () {56 vars in 1139 bytes} [Fri Aug 19 20:53:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:46.835412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d5768-065c-486f-83fd-39d362709be3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:46.866966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e92d81-ef51-48ec-b8e4-3647042d766c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:46.918304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239911-e7e4-4101-8abe-366d0c96f7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:46.919296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239911-e7e4-4101-8abe-366d0c96f7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:46.919587 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239911-e7e4-4101-8abe-366d0c96f7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:46.919870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239911-e7e4-4101-8abe-366d0c96f7b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:46.920551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3239911-e7e4-4101-8abe-366d0c96f7b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:46.920845 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3239911-e7e4-4101-8abe-366d0c96f7b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:46.922537 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3239911-e7e4-4101-8abe-366d0c96f7b2 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:46.943014 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 263/530] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:46.946462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239911-e7e4-4101-8abe-366d0c96f7b2 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:46.990698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d5768-065c-486f-83fd-39d362709be3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:47.054659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:47.054880 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0f1c3-58a0-4858-87ea-3f1ffb4cbf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:47.056131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0f1c3-58a0-4858-87ea-3f1ffb4cbf10 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:47.057277 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0f1c3-58a0-4858-87ea-3f1ffb4cbf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:47.057822 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0f1c3-58a0-4858-87ea-3f1ffb4cbf10 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:47.060170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0f1c3-58a0-4858-87ea-3f1ffb4cbf10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:47.061902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0f1c3-58a0-4858-87ea-3f1ffb4cbf10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:47.065049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0f1c3-58a0-4858-87ea-3f1ffb4cbf10 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:47.085930 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239911-e7e4-4101-8abe-366d0c96f7b2 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:47.089912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 268/531] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:53:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:47.091757 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0f1c3-58a0-4858-87ea-3f1ffb4cbf10 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:47.097139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:47.128359 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d45ba-ec82-45c6-83bb-e1a3f637b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:47.129044 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d45ba-ec82-45c6-83bb-e1a3f637b6ee None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:47.129338 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d45ba-ec82-45c6-83bb-e1a3f637b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:47.129618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d45ba-ec82-45c6-83bb-e1a3f637b6ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:47.235445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d45ba-ec82-45c6-83bb-e1a3f637b6ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:47.237534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d45ba-ec82-45c6-83bb-e1a3f637b6ee None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:47.244283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0f1c3-58a0-4858-87ea-3f1ffb4cbf10 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:47.291231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10d8a1-4c1d-487e-b0d2-9ad066fd294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:47.291882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10d8a1-4c1d-487e-b0d2-9ad066fd294c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:47.292166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10d8a1-4c1d-487e-b0d2-9ad066fd294c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:47.292448 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10d8a1-4c1d-487e-b0d2-9ad066fd294c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:47.302774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10d8a1-4c1d-487e-b0d2-9ad066fd294c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:47.304728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10d8a1-4c1d-487e-b0d2-9ad066fd294c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-bd10d8a1-4c1d-487e-b0d2-9ad066fd294c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:53:47.321583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:47.322506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:47.323396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:53:47.323396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:53:47.323396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:53:47.323396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:53:47.323396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:53:47.323396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:53:47.323396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:47.323396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:47.323819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 269/532] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:47.325090 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10d8a1-4c1d-487e-b0d2-9ad066fd294c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:47.363238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:47.370406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 264/533] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:47.371539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d45ba-ec82-45c6-83bb-e1a3f637b6ee None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:47.426331 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:47.516502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d45ba-ec82-45c6-83bb-e1a3f637b6ee None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:47.523025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10d8a1-4c1d-487e-b0d2-9ad066fd294c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:47.559354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3720e4-13d2-4e8d-a54d-568adc8bbfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:47.561197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3720e4-13d2-4e8d-a54d-568adc8bbfd1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:47.561558 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3720e4-13d2-4e8d-a54d-568adc8bbfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:47.561913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3720e4-13d2-4e8d-a54d-568adc8bbfd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:47.562708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3720e4-13d2-4e8d-a54d-568adc8bbfd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:47.563254 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3720e4-13d2-4e8d-a54d-568adc8bbfd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:47.564834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3720e4-13d2-4e8d-a54d-568adc8bbfd1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:47.589080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ef2de-551e-4850-bbf4-43a33f7ac4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:47.589799 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ef2de-551e-4850-bbf4-43a33f7ac4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:47.590213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ef2de-551e-4850-bbf4-43a33f7ac4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:47.590642 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ef2de-551e-4850-bbf4-43a33f7ac4f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:47.592031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ef2de-551e-4850-bbf4-43a33f7ac4f2 None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=51e6b105e7094aea9dcc7423d6205c1c) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:47.592418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ef2de-551e-4850-bbf4-43a33f7ac4f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:47.594008 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ef2de-551e-4850-bbf4-43a33f7ac4f2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:47.594515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 265/534] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:53:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:47.595479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3720e4-13d2-4e8d-a54d-568adc8bbfd1 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:47.605748 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 270/535] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:53:47 2022] GET /identity/v3/role_assignments?user.id=51e6b105e7094aea9dcc7423d6205c1c&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:47.606838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ef2de-551e-4850-bbf4-43a33f7ac4f2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:47.715278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:47.804475 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ef2de-551e-4850-bbf4-43a33f7ac4f2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:47.842555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3720e4-13d2-4e8d-a54d-568adc8bbfd1 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:47.844711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:47.855420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb0f5c-8b48-445a-bec4-24f4baf34283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:47.857048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb0f5c-8b48-445a-bec4-24f4baf34283 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:47.857475 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb0f5c-8b48-445a-bec4-24f4baf34283 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:47.857836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb0f5c-8b48-445a-bec4-24f4baf34283 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:47.858880 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb0f5c-8b48-445a-bec4-24f4baf34283 None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=4c27e2db991245359bcceb62ff768b36) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:47.859302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb0f5c-8b48-445a-bec4-24f4baf34283 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:47.863597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb0f5c-8b48-445a-bec4-24f4baf34283 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:47.871665 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 271/536] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:53:47 2022] GET /identity/v3/role_assignments?user.id=4c27e2db991245359bcceb62ff768b36&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:47.881673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156350c-a4c6-4f4d-8731-4a51091cee25 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:47.882027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156350c-a4c6-4f4d-8731-4a51091cee25 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:47.882393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156350c-a4c6-4f4d-8731-4a51091cee25 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:47.884212 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 272/537] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:47.891328 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbbf6e-7583-4d95-980b-957e3c7ddb9e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:47.892037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbbf6e-7583-4d95-980b-957e3c7ddb9e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:47.892037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbbf6e-7583-4d95-980b-957e3c7ddb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:47.902440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cec04-983b-4c22-8edb-dfd7233a0fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:47.903899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cec04-983b-4c22-8edb-dfd7233a0fcc None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:47.904541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cec04-983b-4c22-8edb-dfd7233a0fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:47.905033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cec04-983b-4c22-8edb-dfd7233a0fcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:47.918356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cec04-983b-4c22-8edb-dfd7233a0fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:47.920857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cec04-983b-4c22-8edb-dfd7233a0fcc None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:47.925299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6abbbf6e-7583-4d95-980b-957e3c7ddb9e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:47.927022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6abbbf6e-7583-4d95-980b-957e3c7ddb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-7b4cec04-983b-4c22-8edb-dfd7233a0fcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:47.945843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:47.948008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:47.949662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:47.949662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:47.949662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:47.949662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 266/538] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:47.964438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cec04-983b-4c22-8edb-dfd7233a0fcc None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:48.023782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 273/539] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:48.160868 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:48.178542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cec04-983b-4c22-8edb-dfd7233a0fcc None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:48.241351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2778e21-75a4-4de3-8f73-540aabe55000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:48.241978 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2778e21-75a4-4de3-8f73-540aabe55000 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:48.242261 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2778e21-75a4-4de3-8f73-540aabe55000 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:48.242540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2778e21-75a4-4de3-8f73-540aabe55000 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:48.243230 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2778e21-75a4-4de3-8f73-540aabe55000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:48.243541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2778e21-75a4-4de3-8f73-540aabe55000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:48.244997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2778e21-75a4-4de3-8f73-540aabe55000 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:48.262519 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 267/540] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:48.268646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbbf6e-7583-4d95-980b-957e3c7ddb9e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:48.402181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbbf6e-7583-4d95-980b-957e3c7ddb9e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:48.419701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4183c4-1eed-4b58-ac75-c71227d78c37 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:48.420221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4183c4-1eed-4b58-ac75-c71227d78c37 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:48.420296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4183c4-1eed-4b58-ac75-c71227d78c37 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:48.421961 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 268/541] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:48.427442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257832a-1b10-43b4-b28d-bd737d662b99 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:48.427729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257832a-1b10-43b4-b28d-bd737d662b99 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:48.428012 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257832a-1b10-43b4-b28d-bd737d662b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:48.444304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:48.464704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-9257832a-1b10-43b4-b28d-bd737d662b99 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:48.466252 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9257832a-1b10-43b4-b28d-bd737d662b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:48.470346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991c2a2-7cb9-4bc9-9579-1ca815db54f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:48.471039 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991c2a2-7cb9-4bc9-9579-1ca815db54f4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:48.471326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991c2a2-7cb9-4bc9-9579-1ca815db54f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:48.471601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991c2a2-7cb9-4bc9-9579-1ca815db54f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:48.479298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991c2a2-7cb9-4bc9-9579-1ca815db54f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:48.480770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991c2a2-7cb9-4bc9-9579-1ca815db54f4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-e991c2a2-7cb9-4bc9-9579-1ca815db54f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:53:48.493453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:48.494368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:48.495275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:53:48.495275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:53:48.495275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:53:48.495275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:53:48.495275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:53:48.495275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:53:48.495275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:48.495275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:48.495275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 274/542] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:48.496200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991c2a2-7cb9-4bc9-9579-1ca815db54f4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:48.558762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 269/543] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:48.558762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257832a-1b10-43b4-b28d-bd737d662b99 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:48.680090 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991c2a2-7cb9-4bc9-9579-1ca815db54f4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:48.726430 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:48.752732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257832a-1b10-43b4-b28d-bd737d662b99 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:48.797863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92366403-5f6f-4aee-9a8a-83b331a612a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:48.798663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92366403-5f6f-4aee-9a8a-83b331a612a9 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:48.799074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92366403-5f6f-4aee-9a8a-83b331a612a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:48.799452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92366403-5f6f-4aee-9a8a-83b331a612a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:48.800287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92366403-5f6f-4aee-9a8a-83b331a612a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:48.800700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92366403-5f6f-4aee-9a8a-83b331a612a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:48.802446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92366403-5f6f-4aee-9a8a-83b331a612a9 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:48.812747 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06aa89-ab5e-4c04-a6a8-3198a058d8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:48.813407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06aa89-ab5e-4c04-a6a8-3198a058d8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:48.813697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06aa89-ab5e-4c04-a6a8-3198a058d8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:48.813971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06aa89-ab5e-4c04-a6a8-3198a058d8d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:48.817231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 270/544] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:53:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:48.827810 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92366403-5f6f-4aee-9a8a-83b331a612a9 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:48.834098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06aa89-ab5e-4c04-a6a8-3198a058d8d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-dc06aa89-ab5e-4c04-a6a8-3198a058d8d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:48.839020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:48.839948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:48.842305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:48.842305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:48.842305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:48.842305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:48.842305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:48.842305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:48.842305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:48.842305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:48.842305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:48.842305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:48.842305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:48.842305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:48.842305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 275/545] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:48.847858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06aa89-ab5e-4c04-a6a8-3198a058d8d5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:48.913504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:48.960310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92366403-5f6f-4aee-9a8a-83b331a612a9 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:48.994307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06aa89-ab5e-4c04-a6a8-3198a058d8d5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:48.998669 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b85696-a7e3-411a-b458-e2eab8810876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:48.999386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85696-a7e3-411a-b458-e2eab8810876 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:48.999960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85696-a7e3-411a-b458-e2eab8810876 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:49.000508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85696-a7e3-411a-b458-e2eab8810876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:49.001899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b85696-a7e3-411a-b458-e2eab8810876 None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=95b17424a40b475480403eb9f4f3f88f) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:49.002503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b85696-a7e3-411a-b458-e2eab8810876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:49.004168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b85696-a7e3-411a-b458-e2eab8810876 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:49.010719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 271/546] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:53:48 2022] GET /identity/v3/role_assignments?user.id=95b17424a40b475480403eb9f4f3f88f&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:49.011738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b85696-a7e3-411a-b458-e2eab8810876 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:49.023035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:49.041604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf507c4-7d75-4e14-96da-e2d028689045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:49.042401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf507c4-7d75-4e14-96da-e2d028689045 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:49.042690 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf507c4-7d75-4e14-96da-e2d028689045 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:49.043017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf507c4-7d75-4e14-96da-e2d028689045 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:49.044262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf507c4-7d75-4e14-96da-e2d028689045 None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:49.044577 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf507c4-7d75-4e14-96da-e2d028689045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:49.046006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf507c4-7d75-4e14-96da-e2d028689045 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:49.077007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 276/547] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:53:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:49.088428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf507c4-7d75-4e14-96da-e2d028689045 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:49.220819 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b85696-a7e3-411a-b458-e2eab8810876 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:49.262911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a17155-7000-4ee0-aa4e-e1bcf70f1fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:49.264191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a17155-7000-4ee0-aa4e-e1bcf70f1fbc None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:49.265240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a17155-7000-4ee0-aa4e-e1bcf70f1fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:49.265717 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a17155-7000-4ee0-aa4e-e1bcf70f1fbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:49.277937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a17155-7000-4ee0-aa4e-e1bcf70f1fbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-83a17155-7000-4ee0-aa4e-e1bcf70f1fbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:49.284566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:49.285529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:49.286337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:49.286337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:49.286337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:49.286337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:49.286337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:49.286337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:49.286337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:49.286337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:49.286337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:49.286337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:49.286337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:49.286337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:49.289295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 272/548] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:49.301030 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a17155-7000-4ee0-aa4e-e1bcf70f1fbc None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:49.303561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf507c4-7d75-4e14-96da-e2d028689045 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:49.305964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:49.350762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe8bc8-646c-469f-8e80-f6f1f16060e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:49.350762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe8bc8-646c-469f-8e80-f6f1f16060e3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:49.350762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe8bc8-646c-469f-8e80-f6f1f16060e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:49.350762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe8bc8-646c-469f-8e80-f6f1f16060e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:49.356217 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe8bc8-646c-469f-8e80-f6f1f16060e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:49.357680 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe8bc8-646c-469f-8e80-f6f1f16060e3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-8bfe8bc8-646c-469f-8e80-f6f1f16060e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:49.374288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:49.375782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:49.376801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:49.376801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:49.376801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:49.376801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 277/549] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:53:49.381650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe8bc8-646c-469f-8e80-f6f1f16060e3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:49.469077 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:49.497646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe8bc8-646c-469f-8e80-f6f1f16060e3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:49.536205 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213e2e3-5dd4-4104-a852-531a871a2b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:49.537003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213e2e3-5dd4-4104-a852-531a871a2b03 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:49.537292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213e2e3-5dd4-4104-a852-531a871a2b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:49.537573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213e2e3-5dd4-4104-a852-531a871a2b03 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:49.538555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213e2e3-5dd4-4104-a852-531a871a2b03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:49.538897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213e2e3-5dd4-4104-a852-531a871a2b03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:49.540291 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213e2e3-5dd4-4104-a852-531a871a2b03 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:49.559047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 278/550] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:49.561099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213e2e3-5dd4-4104-a852-531a871a2b03 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:49.587557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a17155-7000-4ee0-aa4e-e1bcf70f1fbc None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:49.593162 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:49.666550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920d72c-fd0d-4f0b-be0e-d19862852735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:49.667191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920d72c-fd0d-4f0b-be0e-d19862852735 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:49.667473 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920d72c-fd0d-4f0b-be0e-d19862852735 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:49.667746 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920d72c-fd0d-4f0b-be0e-d19862852735 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:49.668428 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920d72c-fd0d-4f0b-be0e-d19862852735 None admin] RBAC: Adding query filter params (name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:49.668884 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920d72c-fd0d-4f0b-be0e-d19862852735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:49.670399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920d72c-fd0d-4f0b-be0e-d19862852735 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:49.682488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 273/551] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:53:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:53:49.689018 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920d72c-fd0d-4f0b-be0e-d19862852735 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:49.753257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213e2e3-5dd4-4104-a852-531a871a2b03 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:49.831798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920d72c-fd0d-4f0b-be0e-d19862852735 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:49.843466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bf7aa-df91-4810-9c4c-8377c877a9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:49.844112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bf7aa-df91-4810-9c4c-8377c877a9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:49.844401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bf7aa-df91-4810-9c4c-8377c877a9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:49.844677 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bf7aa-df91-4810-9c4c-8377c877a9a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:49.852579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bf7aa-df91-4810-9c4c-8377c877a9a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:49.854027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bf7aa-df91-4810-9c4c-8377c877a9a3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ae4bf7aa-df91-4810-9c4c-8377c877a9a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:53:49.867259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:49.868411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:49.869352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:49.869352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:49.869352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:53:49.869352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:53:49.869352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:53:49.869352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:53:49.869352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:53:49.869352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:53:49.869352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 20:53:49.869352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:49.874102 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 279/552] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:53:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:49.875399 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bf7aa-df91-4810-9c4c-8377c877a9a3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:49.901205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:49.916535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7c3f8-4487-4b1e-b3a2-fffed1c08a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:49.917343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7c3f8-4487-4b1e-b3a2-fffed1c08a0f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:49.917628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7c3f8-4487-4b1e-b3a2-fffed1c08a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:49.917907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7c3f8-4487-4b1e-b3a2-fffed1c08a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:49.945148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7c3f8-4487-4b1e-b3a2-fffed1c08a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:49.946612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7c3f8-4487-4b1e-b3a2-fffed1c08a0f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:49.966686 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-67c7c3f8-4487-4b1e-b3a2-fffed1c08a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:49.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:49.978102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:49.979406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:49.979406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:49.979406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:49.979406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 274/553] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:53:49.984301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7c3f8-4487-4b1e-b3a2-fffed1c08a0f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:49.994525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bf7aa-df91-4810-9c4c-8377c877a9a3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:50.058651 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c84464-274a-4c65-9b87-35e2da379ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:50.060860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c84464-274a-4c65-9b87-35e2da379ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:50.061352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c84464-274a-4c65-9b87-35e2da379ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:50.061805 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c84464-274a-4c65-9b87-35e2da379ff0 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:50.062919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c84464-274a-4c65-9b87-35e2da379ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:50.063392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c84464-274a-4c65-9b87-35e2da379ff0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:50.065386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c84464-274a-4c65-9b87-35e2da379ff0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:50.101250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 280/554] 10.222.0.17 () {56 vars in 1135 bytes} [Fri Aug 19 20:53:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:50.107864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c84464-274a-4c65-9b87-35e2da379ff0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:50.115825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7c3f8-4487-4b1e-b3a2-fffed1c08a0f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:50.152927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a5b46-0703-4394-a0ae-7931458c820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:50.153847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a5b46-0703-4394-a0ae-7931458c820f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:50.154230 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a5b46-0703-4394-a0ae-7931458c820f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:50.154605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a5b46-0703-4394-a0ae-7931458c820f None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:50.155383 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a5b46-0703-4394-a0ae-7931458c820f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:50.155790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a5b46-0703-4394-a0ae-7931458c820f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:50.159625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a5b46-0703-4394-a0ae-7931458c820f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:50.174084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 275/555] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:50.174084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c622f-ec6d-40e4-a0c5-ad1640795a4e None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:50.174084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c622f-ec6d-40e4-a0c5-ad1640795a4e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:50.174084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c622f-ec6d-40e4-a0c5-ad1640795a4e None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:50.174084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 276/556] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:50.179095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc82f9-6d56-469d-8085-bc961d5c8938 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:50.179385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc82f9-6d56-469d-8085-bc961d5c8938 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:50.179666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc82f9-6d56-469d-8085-bc961d5c8938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:50.198859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-08dc82f9-6d56-469d-8085-bc961d5c8938 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:50.200801 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-08dc82f9-6d56-469d-8085-bc961d5c8938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:50.244206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:50.266010 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c84464-274a-4c65-9b87-35e2da379ff0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:50.287682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 277/557] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:53:50.289345 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc82f9-6d56-469d-8085-bc961d5c8938 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:50.304285 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48116b3-f3fc-433e-8221-b828c230199b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:50.304889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48116b3-f3fc-433e-8221-b828c230199b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:50.305168 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48116b3-f3fc-433e-8221-b828c230199b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:50.305437 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48116b3-f3fc-433e-8221-b828c230199b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:50.308370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:50.383878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48116b3-f3fc-433e-8221-b828c230199b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:50.385568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48116b3-f3fc-433e-8221-b828c230199b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:50.414229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc82f9-6d56-469d-8085-bc961d5c8938 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:50.465203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fe94f-800d-46aa-8b28-888977801fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:50.466467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fe94f-800d-46aa-8b28-888977801fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:50.467026 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fe94f-800d-46aa-8b28-888977801fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:50.467455 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fe94f-800d-46aa-8b28-888977801fc5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:50.477217 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913fe94f-800d-46aa-8b28-888977801fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:50.480048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913fe94f-800d-46aa-8b28-888977801fc5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-913fe94f-800d-46aa-8b28-888977801fc5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:53:50.498849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:50.500363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:50.501386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:50.501386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:50.501386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:53:50.501386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:53:50.501386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:53:50.501386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:53:50.501386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:53:50.501386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:53:50.501386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:53:50.501386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:50.504423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 278/558] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Aug 19 20:53:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:50.507917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac10bbb-8a61-4151-a68d-a89606494163 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:50.508410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac10bbb-8a61-4151-a68d-a89606494163 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:50.508918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac10bbb-8a61-4151-a68d-a89606494163 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:50.516227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 281/560] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:50.516227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48116b3-f3fc-433e-8221-b828c230199b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:50.516626 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 279/560] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:50.518057 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c9cbd-ff6b-4820-9f2d-0599f90dd0d2 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:50.518528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c9cbd-ff6b-4820-9f2d-0599f90dd0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:50.519283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c9cbd-ff6b-4820-9f2d-0599f90dd0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:50.544354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-cb6c9cbd-ff6b-4820-9f2d-0599f90dd0d2 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:50.546376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cb6c9cbd-ff6b-4820-9f2d-0599f90dd0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:50.554195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:50.580890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:50.643482 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48116b3-f3fc-433e-8221-b828c230199b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:50.648346 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 280/561] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:50.656739 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c9cbd-ff6b-4820-9f2d-0599f90dd0d2 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:50.700403 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa19f2-cb9c-4950-9b39-ce9b88bdb2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:50.701140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa19f2-cb9c-4950-9b39-ce9b88bdb2ff None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:50.701531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa19f2-cb9c-4950-9b39-ce9b88bdb2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:50.702008 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa19f2-cb9c-4950-9b39-ce9b88bdb2ff None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:50.703062 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa19f2-cb9c-4950-9b39-ce9b88bdb2ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:50.703618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa19f2-cb9c-4950-9b39-ce9b88bdb2ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:50.705817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa19f2-cb9c-4950-9b39-ce9b88bdb2ff None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:50.733518 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 282/562] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Aug 19 20:53:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:50.733518 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa19f2-cb9c-4950-9b39-ce9b88bdb2ff None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:50.824403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c9cbd-ff6b-4820-9f2d-0599f90dd0d2 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:50.856511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:50.870263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63d48f-f44c-4ee1-9a59-418f14a5ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:50.870969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63d48f-f44c-4ee1-9a59-418f14a5ca99 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:50.871254 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63d48f-f44c-4ee1-9a59-418f14a5ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:50.871532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63d48f-f44c-4ee1-9a59-418f14a5ca99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:50.873811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa19f2-cb9c-4950-9b39-ce9b88bdb2ff None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:50.886947 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63d48f-f44c-4ee1-9a59-418f14a5ca99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:50.889849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63d48f-f44c-4ee1-9a59-418f14a5ca99 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-fe63d48f-f44c-4ee1-9a59-418f14a5ca99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:50.907638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:50.909181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:50.911875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:50.911875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:50.911875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:50.911875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 281/563] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:50.911875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63d48f-f44c-4ee1-9a59-418f14a5ca99 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:50.926958 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f43d2-a1cf-4136-b9cb-c8b85f8e114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:50.927759 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f43d2-a1cf-4136-b9cb-c8b85f8e114e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:50.928037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f43d2-a1cf-4136-b9cb-c8b85f8e114e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:50.928281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f43d2-a1cf-4136-b9cb-c8b85f8e114e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:50.938922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:50.943433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f43d2-a1cf-4136-b9cb-c8b85f8e114e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-b83f43d2-a1cf-4136-b9cb-c8b85f8e114e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:50.951069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:50.952334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:50.954048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:50.954048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:50.954048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:50.954048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:50.954048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:50.954048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:50.954048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:50.954048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:50.954048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:50.954048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:50.954048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:50.954048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:50.957546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 283/564] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:50.958628 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f43d2-a1cf-4136-b9cb-c8b85f8e114e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:51.080802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63d48f-f44c-4ee1-9a59-418f14a5ca99 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:51.111039 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f43d2-a1cf-4136-b9cb-c8b85f8e114e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:51.130944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9004c-4a85-49f7-8ac2-de2e0ecf7783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:51.132144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9004c-4a85-49f7-8ac2-de2e0ecf7783 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:51.132690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9004c-4a85-49f7-8ac2-de2e0ecf7783 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:51.132895 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9004c-4a85-49f7-8ac2-de2e0ecf7783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:51.149780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9004c-4a85-49f7-8ac2-de2e0ecf7783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:51.151308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9004c-4a85-49f7-8ac2-de2e0ecf7783 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:51.162065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27ef2-0fe8-4925-898d-54c9211bac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:51.162607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27ef2-0fe8-4925-898d-54c9211bac41 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:51.163057 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27ef2-0fe8-4925-898d-54c9211bac41 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:51.163339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27ef2-0fe8-4925-898d-54c9211bac41 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:51.164000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e27ef2-0fe8-4925-898d-54c9211bac41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:51.164300 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e27ef2-0fe8-4925-898d-54c9211bac41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:51.165692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e27ef2-0fe8-4925-898d-54c9211bac41 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-c6e9004c-4a85-49f7-8ac2-de2e0ecf7783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:51.175103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:51.176117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:51.177033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:51.177033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:51.177033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:51.179060 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 282/565] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:51.180740 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9004c-4a85-49f7-8ac2-de2e0ecf7783 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:51.183914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 284/566] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:51.184805 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27ef2-0fe8-4925-898d-54c9211bac41 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:51.209087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:51.277554 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:51.336275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9004c-4a85-49f7-8ac2-de2e0ecf7783 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:51.349417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27ef2-0fe8-4925-898d-54c9211bac41 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:51.392767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202808c-7ff7-4ae2-b15e-74d5397c1713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:51.393677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202808c-7ff7-4ae2-b15e-74d5397c1713 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:51.394035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202808c-7ff7-4ae2-b15e-74d5397c1713 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:51.394459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202808c-7ff7-4ae2-b15e-74d5397c1713 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:51.395124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a092bd-0f4a-4e60-9899-6e3df28d1eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:51.395313 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202808c-7ff7-4ae2-b15e-74d5397c1713 None admin] RBAC: Adding query filter params (name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:51.395569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202808c-7ff7-4ae2-b15e-74d5397c1713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:51.395813 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a092bd-0f4a-4e60-9899-6e3df28d1eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:51.396058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a092bd-0f4a-4e60-9899-6e3df28d1eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:51.396333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a092bd-0f4a-4e60-9899-6e3df28d1eb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:51.397749 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202808c-7ff7-4ae2-b15e-74d5397c1713 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:51.413454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 283/567] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:53:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:51.413454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202808c-7ff7-4ae2-b15e-74d5397c1713 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:51.416404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a092bd-0f4a-4e60-9899-6e3df28d1eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f6a092bd-0f4a-4e60-9899-6e3df28d1eb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:51.425710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:51.426943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 285/568] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:51.429440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a092bd-0f4a-4e60-9899-6e3df28d1eb8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:51.522156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:51.546065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202808c-7ff7-4ae2-b15e-74d5397c1713 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:51.562881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a092bd-0f4a-4e60-9899-6e3df28d1eb8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:51.580660 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:51.590931 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df6f2b-ad27-421c-ada6-ff5fbf496e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:51.591557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df6f2b-ad27-421c-ada6-ff5fbf496e5f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:51.591847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df6f2b-ad27-421c-ada6-ff5fbf496e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:51.592120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df6f2b-ad27-421c-ada6-ff5fbf496e5f None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:51.592771 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df6f2b-ad27-421c-ada6-ff5fbf496e5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:51.593073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df6f2b-ad27-421c-ada6-ff5fbf496e5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:51.594437 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df6f2b-ad27-421c-ada6-ff5fbf496e5f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:51.609049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660310b-2807-438f-9d1a-bd29ff048f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:51.609675 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 284/569] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:51.609794 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660310b-2807-438f-9d1a-bd29ff048f7f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:51.609962 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660310b-2807-438f-9d1a-bd29ff048f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:51.610235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660310b-2807-438f-9d1a-bd29ff048f7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:51.610584 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df6f2b-ad27-421c-ada6-ff5fbf496e5f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:51.620532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660310b-2807-438f-9d1a-bd29ff048f7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:51.623844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660310b-2807-438f-9d1a-bd29ff048f7f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-c660310b-2807-438f-9d1a-bd29ff048f7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:53:51.641779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:51.642838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:51.643736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:53:51.643736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:53:51.643736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:53:51.643736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:53:51.643736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:53:51.643736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:53:51.643736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:51.643736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:51.643736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 286/570] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:51.644277 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b9619-2e29-4162-b169-fe3ebe921407 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:51.644594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b9619-2e29-4162-b169-fe3ebe921407 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:51.644833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b9619-2e29-4162-b169-fe3ebe921407 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:51.646073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 287/571] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:51.646800 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b9619-2e29-4162-b169-fe3ebe921407 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:51.741079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df6f2b-ad27-421c-ada6-ff5fbf496e5f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:51.768152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b9619-2e29-4162-b169-fe3ebe921407 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:51.776309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c1aed-d59b-411f-9f06-40251fff41c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:51.776949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c1aed-d59b-411f-9f06-40251fff41c2 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:51.777234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c1aed-d59b-411f-9f06-40251fff41c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:51.777518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c1aed-d59b-411f-9f06-40251fff41c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:51.788441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c1aed-d59b-411f-9f06-40251fff41c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:51.789909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c1aed-d59b-411f-9f06-40251fff41c2 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:51.800943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-179c1aed-d59b-411f-9f06-40251fff41c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:51.807850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:51.809068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:51.810017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:51.810017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:51.810017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:51.810017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 285/572] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:51.810560 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c1aed-d59b-411f-9f06-40251fff41c2 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:51.814717 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2c824-535c-42a2-a2c0-858d40be60be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:51.814969 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2c824-535c-42a2-a2c0-858d40be60be None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:51.815319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2c824-535c-42a2-a2c0-858d40be60be None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:51.815667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2c824-535c-42a2-a2c0-858d40be60be None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:51.816354 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2c824-535c-42a2-a2c0-858d40be60be None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:51.816651 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2c824-535c-42a2-a2c0-858d40be60be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:51.818046 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2c824-535c-42a2-a2c0-858d40be60be None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:51.828182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 288/573] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:53:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:51.829426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2c824-535c-42a2-a2c0-858d40be60be None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:51.862302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:51.931485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c1aed-d59b-411f-9f06-40251fff41c2 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:51.958071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2c824-535c-42a2-a2c0-858d40be60be None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:51.975209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4687c8-5183-4eb6-b068-7f00ea765410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:51.975846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4687c8-5183-4eb6-b068-7f00ea765410 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:51.976128 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4687c8-5183-4eb6-b068-7f00ea765410 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:51.976405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4687c8-5183-4eb6-b068-7f00ea765410 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:51.983803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4687c8-5183-4eb6-b068-7f00ea765410 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:51.985250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4687c8-5183-4eb6-b068-7f00ea765410 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:51.993199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957b19-43c1-4d68-9c05-16d2e6b39af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:51.993741 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957b19-43c1-4d68-9c05-16d2e6b39af4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:51.994026 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957b19-43c1-4d68-9c05-16d2e6b39af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:51.994299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957b19-43c1-4d68-9c05-16d2e6b39af4 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:51.995032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5957b19-43c1-4d68-9c05-16d2e6b39af4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:51.995342 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5957b19-43c1-4d68-9c05-16d2e6b39af4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:51.997329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5957b19-43c1-4d68-9c05-16d2e6b39af4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-3a4687c8-5183-4eb6-b068-7f00ea765410 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:53:51.999350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:52.000304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:52.001563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:53:52.001563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:53:52.001563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:53:52.001563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:53:52.001563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:53:52.001563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:53:52.001563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:52.001563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:52.001563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 286/574] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:52.002081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8b458-3783-4b24-a4c9-c1563b1c8a41 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:52.002237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8b458-3783-4b24-a4c9-c1563b1c8a41 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:52.002518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8b458-3783-4b24-a4c9-c1563b1c8a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:52.010826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 289/575] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:53:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:52.011674 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957b19-43c1-4d68-9c05-16d2e6b39af4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:52.025719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-d9f8b458-3783-4b24-a4c9-c1563b1c8a41 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:52.026968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d9f8b458-3783-4b24-a4c9-c1563b1c8a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:52.077712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:52.103001 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 287/576] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:52.103873 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8b458-3783-4b24-a4c9-c1563b1c8a41 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:52.138249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:52.150701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957b19-43c1-4d68-9c05-16d2e6b39af4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:52.193629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f04427-25cd-4e6a-b520-f35ce0f87199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:52.194251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f04427-25cd-4e6a-b520-f35ce0f87199 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:52.194648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f04427-25cd-4e6a-b520-f35ce0f87199 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:52.194941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f04427-25cd-4e6a-b520-f35ce0f87199 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:52.195604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f04427-25cd-4e6a-b520-f35ce0f87199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:52.195911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f04427-25cd-4e6a-b520-f35ce0f87199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:52.197343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f04427-25cd-4e6a-b520-f35ce0f87199 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:52.213319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 290/577] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:52.214227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f04427-25cd-4e6a-b520-f35ce0f87199 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:52.254257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8b458-3783-4b24-a4c9-c1563b1c8a41 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:52.312018 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6aff5-c2bb-4d7b-bd73-f7fa2db04cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:52.313055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6aff5-c2bb-4d7b-bd73-f7fa2db04cca None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:52.313507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6aff5-c2bb-4d7b-bd73-f7fa2db04cca None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:52.313923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6aff5-c2bb-4d7b-bd73-f7fa2db04cca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:52.330753 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6aff5-c2bb-4d7b-bd73-f7fa2db04cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:52.332243 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6aff5-c2bb-4d7b-bd73-f7fa2db04cca None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-50c6aff5-c2bb-4d7b-bd73-f7fa2db04cca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:52.355340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:52.356589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:52.357637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:52.357637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:52.357637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:52.357637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 288/578] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:52.358199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6aff5-c2bb-4d7b-bd73-f7fa2db04cca None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:52.381756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f04427-25cd-4e6a-b520-f35ce0f87199 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:52.408546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:52.442847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcae31-930d-4010-b586-fa3f313efb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:52.443823 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcae31-930d-4010-b586-fa3f313efb73 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:52.444269 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcae31-930d-4010-b586-fa3f313efb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:52.444700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcae31-930d-4010-b586-fa3f313efb73 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:52.445880 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcae31-930d-4010-b586-fa3f313efb73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:52.446370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcae31-930d-4010-b586-fa3f313efb73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:52.449019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcae31-930d-4010-b586-fa3f313efb73 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:52.467849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 291/579] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:53:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:52.468711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcae31-930d-4010-b586-fa3f313efb73 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:52.469332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:52.495094 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6aff5-c2bb-4d7b-bd73-f7fa2db04cca None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:52.534725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ff056-dbfa-4790-92ab-37213ce4e7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:52.535426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ff056-dbfa-4790-92ab-37213ce4e7fc None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:52.535793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ff056-dbfa-4790-92ab-37213ce4e7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:52.536153 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ff056-dbfa-4790-92ab-37213ce4e7fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:52.536990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ff056-dbfa-4790-92ab-37213ce4e7fc None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=6fbfc93e45704b3ba2e5a4bcf7568a14) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:52.537395 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ff056-dbfa-4790-92ab-37213ce4e7fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:52.538949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ff056-dbfa-4790-92ab-37213ce4e7fc None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:52.545197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 289/580] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:53:52 2022] GET /identity/v3/role_assignments?user.id=6fbfc93e45704b3ba2e5a4bcf7568a14&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:52.546323 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ff056-dbfa-4790-92ab-37213ce4e7fc None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:52.629128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcae31-930d-4010-b586-fa3f313efb73 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:52.689261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b8854-ac7d-4d9e-84a4-8c0e5fcd95f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:52.690105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b8854-ac7d-4d9e-84a4-8c0e5fcd95f3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:52.690526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b8854-ac7d-4d9e-84a4-8c0e5fcd95f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:52.690987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b8854-ac7d-4d9e-84a4-8c0e5fcd95f3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:52.702168 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b8854-ac7d-4d9e-84a4-8c0e5fcd95f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:52.703969 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b8854-ac7d-4d9e-84a4-8c0e5fcd95f3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ec9b8854-ac7d-4d9e-84a4-8c0e5fcd95f3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:53:52.719943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:52.721779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:52.724571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:52.724571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:52.724571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:53:52.724571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:53:52.724571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:53:52.724571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:53:52.724571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:53:52.724571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:53:52.724571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 20:53:52.724571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:52.724571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 292/581] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:52.724571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b8854-ac7d-4d9e-84a4-8c0e5fcd95f3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:52.750283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ff056-dbfa-4790-92ab-37213ce4e7fc None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:52.780573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:52.791463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045c7c0-e5c0-4c38-b300-e90d155aea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:52.791984 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045c7c0-e5c0-4c38-b300-e90d155aea99 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:52.792265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045c7c0-e5c0-4c38-b300-e90d155aea99 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:52.792529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045c7c0-e5c0-4c38-b300-e90d155aea99 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:52.793188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045c7c0-e5c0-4c38-b300-e90d155aea99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:52.793485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045c7c0-e5c0-4c38-b300-e90d155aea99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:52.795452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045c7c0-e5c0-4c38-b300-e90d155aea99 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:52.814020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 290/582] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:52.814020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045c7c0-e5c0-4c38-b300-e90d155aea99 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:52.817853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:52.893362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b8854-ac7d-4d9e-84a4-8c0e5fcd95f3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:52.948193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584582c-8a2a-400b-b899-d5bc7a5e8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:52.949034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584582c-8a2a-400b-b899-d5bc7a5e8ffd None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:52.949493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584582c-8a2a-400b-b899-d5bc7a5e8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:52.951068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584582c-8a2a-400b-b899-d5bc7a5e8ffd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:52.967520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584582c-8a2a-400b-b899-d5bc7a5e8ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:52.968134 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045c7c0-e5c0-4c38-b300-e90d155aea99 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-4584582c-8a2a-400b-b899-d5bc7a5e8ffd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:52.976309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:52.977281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:52.978128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:52.978128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:52.978128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:52.978128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:52.978128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:52.978128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:52.978128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:52.978128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:52.978128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:52.978128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:52.978128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:52.978128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:52.978797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 293/583] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:52.979908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584582c-8a2a-400b-b899-d5bc7a5e8ffd None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:53.025548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8059e2-cd4a-4378-9b68-52091fc1b9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:53.026500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8059e2-cd4a-4378-9b68-52091fc1b9f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:53.026996 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8059e2-cd4a-4378-9b68-52091fc1b9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:53.027452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8059e2-cd4a-4378-9b68-52091fc1b9f5 None admin] PATH_INFO: `/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/83e51beb8d0e4219af906860ce906500/roles/7ba43d9ef6cf4709ae99d7e4c68ce879` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:53.052330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8059e2-cd4a-4378-9b68-52091fc1b9f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1defe14eddd4b28ac969adb3d504c7a, user_id=83e51beb8d0e4219af906860ce906500, role_id=7ba43d9ef6cf4709ae99d7e4c68ce879)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:53.053672 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8059e2-cd4a-4378-9b68-52091fc1b9f5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:53.070308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 291/584] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:53:52 2022] PUT /identity/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/83e51beb8d0e4219af906860ce906500/roles/7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:53:53.072222 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8059e2-cd4a-4378-9b68-52091fc1b9f5 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:53.128707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:53.146599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584582c-8a2a-400b-b899-d5bc7a5e8ffd None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:53.186275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:53.201999 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd2295-dcdb-4486-a81c-8e3d0ccbf3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:53.203424 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd2295-dcdb-4486-a81c-8e3d0ccbf3fa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:53.203974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd2295-dcdb-4486-a81c-8e3d0ccbf3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:53.204459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd2295-dcdb-4486-a81c-8e3d0ccbf3fa None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:53.206068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd2295-dcdb-4486-a81c-8e3d0ccbf3fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:53.206814 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd2295-dcdb-4486-a81c-8e3d0ccbf3fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:53.208624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd2295-dcdb-4486-a81c-8e3d0ccbf3fa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:53.234707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 294/585] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Aug 19 20:53:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:53.236049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd2295-dcdb-4486-a81c-8e3d0ccbf3fa None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:53.285631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8059e2-cd4a-4378-9b68-52091fc1b9f5 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:53.335244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016ca05-a46f-4e33-a538-2f4e6a3445da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:53.336273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016ca05-a46f-4e33-a538-2f4e6a3445da None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:53.336760 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016ca05-a46f-4e33-a538-2f4e6a3445da None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:53.337248 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016ca05-a46f-4e33-a538-2f4e6a3445da None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:53.350205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016ca05-a46f-4e33-a538-2f4e6a3445da None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:53.352712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016ca05-a46f-4e33-a538-2f4e6a3445da None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-9016ca05-a46f-4e33-a538-2f4e6a3445da None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:53:53.380862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:53.382578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:53.384194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:53.384194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:53.384194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:53:53.384194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:53:53.384194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:53:53.384194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:53:53.384194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:53:53.384194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:53:53.384194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 20:53:53.384194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:53.388694 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 292/586] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:53:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:53.390657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016ca05-a46f-4e33-a538-2f4e6a3445da None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:53.449723 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd2295-dcdb-4486-a81c-8e3d0ccbf3fa None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:53.523993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abb1f3-ad19-4a2c-9a65-7c288f91fbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:53.526298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abb1f3-ad19-4a2c-9a65-7c288f91fbde None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:53.526858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abb1f3-ad19-4a2c-9a65-7c288f91fbde None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:53.527365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abb1f3-ad19-4a2c-9a65-7c288f91fbde None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:53.528684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abb1f3-ad19-4a2c-9a65-7c288f91fbde None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:53.529245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abb1f3-ad19-4a2c-9a65-7c288f91fbde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:53.531896 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abb1f3-ad19-4a2c-9a65-7c288f91fbde None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:53.548622 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 295/587] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:53:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:53.549896 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abb1f3-ad19-4a2c-9a65-7c288f91fbde None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:53.574519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:53.586901 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016ca05-a46f-4e33-a538-2f4e6a3445da None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:53.613731 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:53.650037 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fbff1-4395-495a-9dbf-774c859584e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:53.651597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fbff1-4395-495a-9dbf-774c859584e5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:53.652351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fbff1-4395-495a-9dbf-774c859584e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:53.654002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fbff1-4395-495a-9dbf-774c859584e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:53.674619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abb1f3-ad19-4a2c-9a65-7c288f91fbde None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:53.675900 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fbff1-4395-495a-9dbf-774c859584e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:53.679007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fbff1-4395-495a-9dbf-774c859584e5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-d65fbff1-4395-495a-9dbf-774c859584e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:53.707738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:53.709480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:53.711235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:53.711235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:53.711235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:53.721980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 293/588] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:53.722221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5eeeca-4a79-4bd1-a627-84f3b6a1f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:53.722221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eeeca-4a79-4bd1-a627-84f3b6a1f5ae None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:53.722221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eeeca-4a79-4bd1-a627-84f3b6a1f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:53.722221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eeeca-4a79-4bd1-a627-84f3b6a1f5ae None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:53.722780 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5eeeca-4a79-4bd1-a627-84f3b6a1f5ae None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:53.722780 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5eeeca-4a79-4bd1-a627-84f3b6a1f5ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:53.722780 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5eeeca-4a79-4bd1-a627-84f3b6a1f5ae None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:53.725077 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fbff1-4395-495a-9dbf-774c859584e5 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:53.741618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 296/589] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Aug 19 20:53:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:53.742621 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5eeeca-4a79-4bd1-a627-84f3b6a1f5ae None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:53.824684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:53.861549 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5eeeca-4a79-4bd1-a627-84f3b6a1f5ae None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:53.903705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b9c4-0458-49e1-9ed9-e4b7b6dbf548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:53.904724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b9c4-0458-49e1-9ed9-e4b7b6dbf548 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:53.905208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b9c4-0458-49e1-9ed9-e4b7b6dbf548 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:53.905842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b9c4-0458-49e1-9ed9-e4b7b6dbf548 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:53.906707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b9c4-0458-49e1-9ed9-e4b7b6dbf548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:53.907333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b9c4-0458-49e1-9ed9-e4b7b6dbf548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:53.908931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b9c4-0458-49e1-9ed9-e4b7b6dbf548 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:53.916961 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fbff1-4395-495a-9dbf-774c859584e5 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:53.923493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 297/590] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:53.924619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b9c4-0458-49e1-9ed9-e4b7b6dbf548 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:53.991770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470778f-89dd-4f3e-9834-1f21eeac009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:53.992767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470778f-89dd-4f3e-9834-1f21eeac009a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:53.993219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470778f-89dd-4f3e-9834-1f21eeac009a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:53.993668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470778f-89dd-4f3e-9834-1f21eeac009a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:54.014506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470778f-89dd-4f3e-9834-1f21eeac009a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:54.017228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470778f-89dd-4f3e-9834-1f21eeac009a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-5470778f-89dd-4f3e-9834-1f21eeac009a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:54.045013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:54.046831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:54.049431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:54.049431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:54.049431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:54.049431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 294/591] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:54.049431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470778f-89dd-4f3e-9834-1f21eeac009a None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:54.081200 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:54.126992 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b9c4-0458-49e1-9ed9-e4b7b6dbf548 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:54.193287 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:54.204097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f1f7e-5a31-46e2-a2a1-ffe44b569e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:54.205092 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f1f7e-5a31-46e2-a2a1-ffe44b569e05 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:54.205561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f1f7e-5a31-46e2-a2a1-ffe44b569e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:54.206080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f1f7e-5a31-46e2-a2a1-ffe44b569e05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:54.229204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f1f7e-5a31-46e2-a2a1-ffe44b569e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:54.230504 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470778f-89dd-4f3e-9834-1f21eeac009a None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:54.232348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f1f7e-5a31-46e2-a2a1-ffe44b569e05 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-9d7f1f7e-5a31-46e2-a2a1-ffe44b569e05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:54.265418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:54.267498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:54.269284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:54.269284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:54.269284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:54.269284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 298/592] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:54.269284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f1f7e-5a31-46e2-a2a1-ffe44b569e05 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:54.306591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439347fa-2265-478c-a3e5-91ae45c58bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:54.308125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439347fa-2265-478c-a3e5-91ae45c58bef None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:54.308828 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439347fa-2265-478c-a3e5-91ae45c58bef None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:54.310080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439347fa-2265-478c-a3e5-91ae45c58bef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:54.322886 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439347fa-2265-478c-a3e5-91ae45c58bef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:54.326246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439347fa-2265-478c-a3e5-91ae45c58bef None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-439347fa-2265-478c-a3e5-91ae45c58bef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:53:54.347767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:54.349512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:54.351326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:53:54.351326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:53:54.351326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:53:54.351326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:53:54.351326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:53:54.351326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:53:54.351326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:54.351326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:54.355107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 295/593] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:54.357293 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439347fa-2265-478c-a3e5-91ae45c58bef None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:54.489817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f1f7e-5a31-46e2-a2a1-ffe44b569e05 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:54.503861 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:54.543827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439347fa-2265-478c-a3e5-91ae45c58bef None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:54.567228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963be29-5580-4935-acd9-f0675c9184fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:54.568537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963be29-5580-4935-acd9-f0675c9184fa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:54.569003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963be29-5580-4935-acd9-f0675c9184fa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:54.569464 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963be29-5580-4935-acd9-f0675c9184fa None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:54.571143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963be29-5580-4935-acd9-f0675c9184fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:54.571604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963be29-5580-4935-acd9-f0675c9184fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:54.574195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963be29-5580-4935-acd9-f0675c9184fa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:54.596356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 299/594] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:54.597381 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963be29-5580-4935-acd9-f0675c9184fa None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:54.613130 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85395b-fec2-457f-8bff-a4f49ceb9592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:54.614175 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85395b-fec2-457f-8bff-a4f49ceb9592 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:54.614621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85395b-fec2-457f-8bff-a4f49ceb9592 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:54.615147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85395b-fec2-457f-8bff-a4f49ceb9592 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:54.616245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85395b-fec2-457f-8bff-a4f49ceb9592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:54.616765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85395b-fec2-457f-8bff-a4f49ceb9592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:54.619187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85395b-fec2-457f-8bff-a4f49ceb9592 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:54.647065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 296/595] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:54.648946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85395b-fec2-457f-8bff-a4f49ceb9592 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:54.699388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:54.821889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963be29-5580-4935-acd9-f0675c9184fa None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:54.858296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85395b-fec2-457f-8bff-a4f49ceb9592 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:54.887070 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465da0ae-0e4d-490b-8b64-41f48e051c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:54.889146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465da0ae-0e4d-490b-8b64-41f48e051c0e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:54.889794 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465da0ae-0e4d-490b-8b64-41f48e051c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:54.890634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465da0ae-0e4d-490b-8b64-41f48e051c0e None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:54.892207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465da0ae-0e4d-490b-8b64-41f48e051c0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:54.893049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465da0ae-0e4d-490b-8b64-41f48e051c0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:54.896024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465da0ae-0e4d-490b-8b64-41f48e051c0e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:54.923256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 300/596] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:53:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:54.925430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465da0ae-0e4d-490b-8b64-41f48e051c0e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:54.931866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310dde6-12c0-4e66-8010-4e05ab4bb00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:54.933382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310dde6-12c0-4e66-8010-4e05ab4bb00c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:54.934093 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310dde6-12c0-4e66-8010-4e05ab4bb00c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:54.935608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310dde6-12c0-4e66-8010-4e05ab4bb00c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:54.949325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310dde6-12c0-4e66-8010-4e05ab4bb00c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:54.952536 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310dde6-12c0-4e66-8010-4e05ab4bb00c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:54.956186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-d310dde6-12c0-4e66-8010-4e05ab4bb00c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:53:54.978520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:54.980390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:54.982795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:54.982795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:54.982795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:53:54.982795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:53:54.982795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:53:54.982795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:53:54.982795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:53:54.982795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:53:54.982795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 20:53:54.982795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:54.987633 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 297/597] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:54.989428 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310dde6-12c0-4e66-8010-4e05ab4bb00c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:55.129782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465da0ae-0e4d-490b-8b64-41f48e051c0e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:55.136151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:55.189001 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310dde6-12c0-4e66-8010-4e05ab4bb00c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:55.198164 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0199d-8e9c-4c20-a8a2-cacc766489b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:55.199349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0199d-8e9c-4c20-a8a2-cacc766489b6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:55.200488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0199d-8e9c-4c20-a8a2-cacc766489b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:55.201288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0199d-8e9c-4c20-a8a2-cacc766489b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:55.214464 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0199d-8e9c-4c20-a8a2-cacc766489b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:55.217561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0199d-8e9c-4c20-a8a2-cacc766489b6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-c3f0199d-8e9c-4c20-a8a2-cacc766489b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:53:55.240559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:55.242850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:55.244905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:53:55.244905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:53:55.244905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:53:55.244905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:53:55.244905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:53:55.244905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:53:55.244905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:55.244905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:55.254537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 301/598] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:55.257119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0199d-8e9c-4c20-a8a2-cacc766489b6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:55.267096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46e133-5ecf-4d4e-a7df-849d8b6f6d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:55.268432 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46e133-5ecf-4d4e-a7df-849d8b6f6d9a None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:55.269077 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46e133-5ecf-4d4e-a7df-849d8b6f6d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:55.269741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46e133-5ecf-4d4e-a7df-849d8b6f6d9a None admin] PATH_INFO: `/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/51e6b105e7094aea9dcc7423d6205c1c/roles/7ba43d9ef6cf4709ae99d7e4c68ce879` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:55.301246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46e133-5ecf-4d4e-a7df-849d8b6f6d9a None admin] RBAC: Authorizing `identity:create_grant(project_id=d1defe14eddd4b28ac969adb3d504c7a, user_id=51e6b105e7094aea9dcc7423d6205c1c, role_id=7ba43d9ef6cf4709ae99d7e4c68ce879)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:55.304029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46e133-5ecf-4d4e-a7df-849d8b6f6d9a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:55.325351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 298/599] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:53:54 2022] PUT /identity/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/51e6b105e7094aea9dcc7423d6205c1c/roles/7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:53:55.326246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46e133-5ecf-4d4e-a7df-849d8b6f6d9a None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:55.409055 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0199d-8e9c-4c20-a8a2-cacc766489b6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:55.418277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:55.453669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f66949-0ffc-4030-ae03-ce0282d709d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:55.454333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f66949-0ffc-4030-ae03-ce0282d709d2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:55.454725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f66949-0ffc-4030-ae03-ce0282d709d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:55.455042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f66949-0ffc-4030-ae03-ce0282d709d2 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:55.455798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f66949-0ffc-4030-ae03-ce0282d709d2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:55.456226 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f66949-0ffc-4030-ae03-ce0282d709d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:55.457863 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f66949-0ffc-4030-ae03-ce0282d709d2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:55.479729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 302/600] 10.222.0.17 () {56 vars in 1139 bytes} [Fri Aug 19 20:53:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:55.481521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4f85b-338c-43e5-a2a1-0d02c6554a09 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:55.482025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4f85b-338c-43e5-a2a1-0d02c6554a09 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:55.482519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4f85b-338c-43e5-a2a1-0d02c6554a09 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:55.489681 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 303/601] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:55.490846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4f85b-338c-43e5-a2a1-0d02c6554a09 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:55.521389 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:55.527698 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46e133-5ecf-4d4e-a7df-849d8b6f6d9a None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:55.600524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d31ef-dcc4-4833-8e8f-d7815b9f5d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:55.601509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d31ef-dcc4-4833-8e8f-d7815b9f5d05 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:55.602276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d31ef-dcc4-4833-8e8f-d7815b9f5d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:55.602716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d31ef-dcc4-4833-8e8f-d7815b9f5d05 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:55.604178 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d31ef-dcc4-4833-8e8f-d7815b9f5d05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:55.604671 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d31ef-dcc4-4833-8e8f-d7815b9f5d05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:55.606503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d31ef-dcc4-4833-8e8f-d7815b9f5d05 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:55.624711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 299/602] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:53:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:55.625365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4f85b-338c-43e5-a2a1-0d02c6554a09 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:55.626910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5b5b4-b6d4-4d49-ba2c-798e7627c96e None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:55.627366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5b5b4-b6d4-4d49-ba2c-798e7627c96e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:55.627786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5b5b4-b6d4-4d49-ba2c-798e7627c96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:55.649299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-cad5b5b4-b6d4-4d49-ba2c-798e7627c96e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:55.650510 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cad5b5b4-b6d4-4d49-ba2c-798e7627c96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:55.686973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9303f5-162a-4573-9cc8-34026187c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:55.686973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9303f5-162a-4573-9cc8-34026187c31f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:55.686973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9303f5-162a-4573-9cc8-34026187c31f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:55.686973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9303f5-162a-4573-9cc8-34026187c31f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:55.701617 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9303f5-162a-4573-9cc8-34026187c31f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:55.703143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9303f5-162a-4573-9cc8-34026187c31f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-0f9303f5-162a-4573-9cc8-34026187c31f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:55.721012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:55.725067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:55.728597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:55.728597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:55.728597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:55.728597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 304/603] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:55.728597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9303f5-162a-4573-9cc8-34026187c31f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:55.773538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 300/604] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:55.781838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5b5b4-b6d4-4d49-ba2c-798e7627c96e None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:55.871105 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:55.878854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:55.925963 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9303f5-162a-4573-9cc8-34026187c31f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:55.974225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58955df1-ef4f-417a-afd8-a08524e06396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:55.975119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58955df1-ef4f-417a-afd8-a08524e06396 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:55.975394 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58955df1-ef4f-417a-afd8-a08524e06396 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:55.975678 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58955df1-ef4f-417a-afd8-a08524e06396 None admin] PATH_INFO: `/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/4c27e2db991245359bcceb62ff768b36/roles/7ba43d9ef6cf4709ae99d7e4c68ce879` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:56.014152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58955df1-ef4f-417a-afd8-a08524e06396 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1defe14eddd4b28ac969adb3d504c7a, user_id=4c27e2db991245359bcceb62ff768b36, role_id=7ba43d9ef6cf4709ae99d7e4c68ce879)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:56.015996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58955df1-ef4f-417a-afd8-a08524e06396 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:56.031109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5b5b4-b6d4-4d49-ba2c-798e7627c96e None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:56.037143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 305/605] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:53:55 2022] PUT /identity/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/4c27e2db991245359bcceb62ff768b36/roles/7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:53:56.038989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a41b21-1087-4f9d-b535-773b31ac3bb6 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:56.039571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a41b21-1087-4f9d-b535-773b31ac3bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:56.040073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a41b21-1087-4f9d-b535-773b31ac3bb6 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:56.042126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 306/606] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:56.052516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faa6b9-7e61-4c6d-8af7-9cd65f36409f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:56.052899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faa6b9-7e61-4c6d-8af7-9cd65f36409f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:56.053100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faa6b9-7e61-4c6d-8af7-9cd65f36409f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:56.079642 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-78faa6b9-7e61-4c6d-8af7-9cd65f36409f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:56.080916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-78faa6b9-7e61-4c6d-8af7-9cd65f36409f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:56.124955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ffe8b-63a4-46e9-949e-9026c4710943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:56.125854 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ffe8b-63a4-46e9-949e-9026c4710943 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:56.126644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ffe8b-63a4-46e9-949e-9026c4710943 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:56.126977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ffe8b-63a4-46e9-949e-9026c4710943 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:56.127999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ffe8b-63a4-46e9-949e-9026c4710943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:56.128309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ffe8b-63a4-46e9-949e-9026c4710943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:56.130021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ffe8b-63a4-46e9-949e-9026c4710943 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:56.155859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 301/607] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:56.156766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ffe8b-63a4-46e9-949e-9026c4710943 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:56.198132 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 307/608] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:56.199254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78faa6b9-7e61-4c6d-8af7-9cd65f36409f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:56.305903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:56.326994 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:56.336888 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ffe8b-63a4-46e9-949e-9026c4710943 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:56.372897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78faa6b9-7e61-4c6d-8af7-9cd65f36409f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:56.398867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdce851-70b5-4877-80e6-0ad05bf4f292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:56.399614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdce851-70b5-4877-80e6-0ad05bf4f292 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:56.399977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdce851-70b5-4877-80e6-0ad05bf4f292 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:56.400311 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdce851-70b5-4877-80e6-0ad05bf4f292 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:56.417740 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdce851-70b5-4877-80e6-0ad05bf4f292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:56.419961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb45da-aa66-404c-a496-16384b7fa094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:56.420786 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb45da-aa66-404c-a496-16384b7fa094 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:56.421240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb45da-aa66-404c-a496-16384b7fa094 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:56.421660 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb45da-aa66-404c-a496-16384b7fa094 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-acdce851-70b5-4877-80e6-0ad05bf4f292 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:56.423628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:56.424779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:56.425840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:56.425840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:56.425840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:56.425840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:56.425840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:56.425840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:56.425840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:56.425840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:56.425840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:56.425840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:56.425840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:56.425840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:56.425840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 302/609] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:56.432695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb45da-aa66-404c-a496-16384b7fa094 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:56.435088 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb45da-aa66-404c-a496-16384b7fa094 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:56.435435 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdce851-70b5-4877-80e6-0ad05bf4f292 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-6cfb45da-aa66-404c-a496-16384b7fa094 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:53:56.449474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:56.450726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:56.451672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:53:56.451672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:53:56.451672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:53:56.451672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:53:56.451672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:53:56.451672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:53:56.451672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:56.451672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:56.455076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 308/610] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:56.464607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb45da-aa66-404c-a496-16384b7fa094 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:56.612076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdce851-70b5-4877-80e6-0ad05bf4f292 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:56.652283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f505360-1d7b-4322-b3c6-df7d3f609a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:56.653654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f505360-1d7b-4322-b3c6-df7d3f609a02 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:56.653851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f505360-1d7b-4322-b3c6-df7d3f609a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:56.654133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f505360-1d7b-4322-b3c6-df7d3f609a02 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:56.654875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f505360-1d7b-4322-b3c6-df7d3f609a02 None admin] RBAC: Adding query filter params (name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:56.655189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f505360-1d7b-4322-b3c6-df7d3f609a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:56.656585 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f505360-1d7b-4322-b3c6-df7d3f609a02 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:56.666433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 303/611] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:53:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:56.671188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f505360-1d7b-4322-b3c6-df7d3f609a02 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:56.686947 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb45da-aa66-404c-a496-16384b7fa094 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:56.706815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:56.710388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:56.744202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfad85-2ad0-460a-956f-503279c96319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:56.745084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfad85-2ad0-460a-956f-503279c96319 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:56.745546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfad85-2ad0-460a-956f-503279c96319 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:56.745991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfad85-2ad0-460a-956f-503279c96319 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:56.746929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfad85-2ad0-460a-956f-503279c96319 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:56.747397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfad85-2ad0-460a-956f-503279c96319 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:56.749023 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfad85-2ad0-460a-956f-503279c96319 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:56.774221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 309/612] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:56.775442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfad85-2ad0-460a-956f-503279c96319 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:56.819310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f505360-1d7b-4322-b3c6-df7d3f609a02 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:56.883125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0b242-cc59-4ad2-9e5b-a086423a4fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:56.883943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0b242-cc59-4ad2-9e5b-a086423a4fda None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:56.884324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0b242-cc59-4ad2-9e5b-a086423a4fda None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:56.884701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0b242-cc59-4ad2-9e5b-a086423a4fda None admin] PATH_INFO: `/v3/roles/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:56.900196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0b242-cc59-4ad2-9e5b-a086423a4fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:56.900609 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfad85-2ad0-460a-956f-503279c96319 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-31b0b242-cc59-4ad2-9e5b-a086423a4fda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:56.907761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:56.909516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:56.911567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:56.911567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:56.911567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:56.911567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:56.911567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:56.911567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:56.911567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:56.911567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:56.911567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:56.911567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:56.911567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:56.911567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:56.916099 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 304/613] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:56.917055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0b242-cc59-4ad2-9e5b-a086423a4fda None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:56.960897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf7db1-6247-456e-a6c6-a263c790cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:56.962383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7db1-6247-456e-a6c6-a263c790cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:56.963272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7db1-6247-456e-a6c6-a263c790cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:56.963973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7db1-6247-456e-a6c6-a263c790cfd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:56.984949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf7db1-6247-456e-a6c6-a263c790cfd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:56.988060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf7db1-6247-456e-a6c6-a263c790cfd6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ffaf7db1-6247-456e-a6c6-a263c790cfd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:57.007922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:57.008967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:57.009858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:57.009858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:57.009858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:57.017458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 310/614] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:57.018712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf7db1-6247-456e-a6c6-a263c790cfd6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:57.024657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:57.052692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0b242-cc59-4ad2-9e5b-a086423a4fda None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:57.054795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:57.111106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4f99d-62ca-4340-8f42-b52df553885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:57.112786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4f99d-62ca-4340-8f42-b52df553885e None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:57.113592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4f99d-62ca-4340-8f42-b52df553885e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:57.114389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4f99d-62ca-4340-8f42-b52df553885e None admin] PATH_INFO: `/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/95b17424a40b475480403eb9f4f3f88f/roles/7ba43d9ef6cf4709ae99d7e4c68ce879` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:57.142037 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4f99d-62ca-4340-8f42-b52df553885e None admin] RBAC: Authorizing `identity:create_grant(project_id=d1defe14eddd4b28ac969adb3d504c7a, user_id=95b17424a40b475480403eb9f4f3f88f, role_id=7ba43d9ef6cf4709ae99d7e4c68ce879)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:57.145562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4f99d-62ca-4340-8f42-b52df553885e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:57.152081 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf7db1-6247-456e-a6c6-a263c790cfd6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:57.178949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 305/615] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:53:56 2022] PUT /identity/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/95b17424a40b475480403eb9f4f3f88f/roles/7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:53:57.181535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4f99d-62ca-4340-8f42-b52df553885e None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:57.239641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f5157-9c71-43fd-a5de-8381e476afbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:57.240454 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f5157-9c71-43fd-a5de-8381e476afbe None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:57.240558 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f5157-9c71-43fd-a5de-8381e476afbe None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:57.240825 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f5157-9c71-43fd-a5de-8381e476afbe None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:57.242137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f5157-9c71-43fd-a5de-8381e476afbe None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:57.242137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f5157-9c71-43fd-a5de-8381e476afbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:57.243343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f5157-9c71-43fd-a5de-8381e476afbe None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:57.257932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 311/616] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:53:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:57.264099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f5157-9c71-43fd-a5de-8381e476afbe None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:57.325506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4f99d-62ca-4340-8f42-b52df553885e None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:57.367842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:57.379218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d398-3f55-473b-8c72-26a08f5b0ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:57.380597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d398-3f55-473b-8c72-26a08f5b0ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:57.381117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d398-3f55-473b-8c72-26a08f5b0ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:57.381668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d398-3f55-473b-8c72-26a08f5b0ac2 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:57.382601 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9d398-3f55-473b-8c72-26a08f5b0ac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:57.383310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9d398-3f55-473b-8c72-26a08f5b0ac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:57.385373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9d398-3f55-473b-8c72-26a08f5b0ac2 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:57.401948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 306/617] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:57.409377 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d398-3f55-473b-8c72-26a08f5b0ac2 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:57.459425 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:57.475319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f5157-9c71-43fd-a5de-8381e476afbe None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:57.527428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26010e7-ca66-4e00-97a5-5409be655706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:57.528686 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26010e7-ca66-4e00-97a5-5409be655706 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:57.528971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26010e7-ca66-4e00-97a5-5409be655706 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:57.529239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26010e7-ca66-4e00-97a5-5409be655706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:57.544464 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26010e7-ca66-4e00-97a5-5409be655706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:57.545997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26010e7-ca66-4e00-97a5-5409be655706 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:57.553233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d398-3f55-473b-8c72-26a08f5b0ac2 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f26010e7-ca66-4e00-97a5-5409be655706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:57.571355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:57.572395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:57.573286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:57.573286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:57.573286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:57.573963 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 312/618] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:57.580165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26010e7-ca66-4e00-97a5-5409be655706 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:57.600188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920cfcd-03ae-4e2a-8c7a-70b572f4801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:57.601118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920cfcd-03ae-4e2a-8c7a-70b572f4801c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:57.601551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920cfcd-03ae-4e2a-8c7a-70b572f4801c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:57.601974 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920cfcd-03ae-4e2a-8c7a-70b572f4801c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:57.624584 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920cfcd-03ae-4e2a-8c7a-70b572f4801c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:57.627418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920cfcd-03ae-4e2a-8c7a-70b572f4801c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-0920cfcd-03ae-4e2a-8c7a-70b572f4801c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:53:57.657590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:57.659303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:57.660654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:57.660654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:57.660654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:53:57.660654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:53:57.660654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:53:57.660654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:53:57.660654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:53:57.660654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:53:57.660654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:53:57.660654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:57.664438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 307/619] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Aug 19 20:53:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:53:57.673593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920cfcd-03ae-4e2a-8c7a-70b572f4801c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:57.787444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26010e7-ca66-4e00-97a5-5409be655706 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:57.791516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:57.846268 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6adccb-71b9-4b8f-9f24-e2ef7f6f564d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:57.846977 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6adccb-71b9-4b8f-9f24-e2ef7f6f564d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:57.847298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6adccb-71b9-4b8f-9f24-e2ef7f6f564d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:57.847555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6adccb-71b9-4b8f-9f24-e2ef7f6f564d None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:57.848204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6adccb-71b9-4b8f-9f24-e2ef7f6f564d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:57.848525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6adccb-71b9-4b8f-9f24-e2ef7f6f564d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:57.849919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6adccb-71b9-4b8f-9f24-e2ef7f6f564d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:57.883228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:57.889052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 313/620] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:57.894768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec803cf8-cd88-48a7-b419-9352659d1476 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:57.894768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec803cf8-cd88-48a7-b419-9352659d1476 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:57.894768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec803cf8-cd88-48a7-b419-9352659d1476 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:57.898906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 314/621] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:57.900477 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d887-8459-4c47-98bd-b15e765efb98 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:57.900762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d887-8459-4c47-98bd-b15e765efb98 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:57.901038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d887-8459-4c47-98bd-b15e765efb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:57.922599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2297d887-8459-4c47-98bd-b15e765efb98 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:57.923782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2297d887-8459-4c47-98bd-b15e765efb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:57.937539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920cfcd-03ae-4e2a-8c7a-70b572f4801c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:57.990874 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be818e8-84db-4a5c-a1e5-35629fd35da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:57.991667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be818e8-84db-4a5c-a1e5-35629fd35da2 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:57.992078 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be818e8-84db-4a5c-a1e5-35629fd35da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:57.992450 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be818e8-84db-4a5c-a1e5-35629fd35da2 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:57.993925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be818e8-84db-4a5c-a1e5-35629fd35da2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:57.994361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be818e8-84db-4a5c-a1e5-35629fd35da2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:57.996122 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be818e8-84db-4a5c-a1e5-35629fd35da2 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:58.026774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 315/622] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:58.026774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297d887-8459-4c47-98bd-b15e765efb98 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:58.038637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 308/623] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Aug 19 20:53:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:58.052598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be818e8-84db-4a5c-a1e5-35629fd35da2 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:58.170139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297d887-8459-4c47-98bd-b15e765efb98 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:58.228096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:58.242020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114e685-8f18-4e8b-a1ae-a3447c956e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:58.243756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114e685-8f18-4e8b-a1ae-a3447c956e14 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:58.244214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114e685-8f18-4e8b-a1ae-a3447c956e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:58.244650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114e685-8f18-4e8b-a1ae-a3447c956e14 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:58.275877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114e685-8f18-4e8b-a1ae-a3447c956e14 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:58.279616 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114e685-8f18-4e8b-a1ae-a3447c956e14 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f114e685-8f18-4e8b-a1ae-a3447c956e14 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:53:58.298256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:58.299358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:58.300341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:58.300341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:58.300341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:53:58.300341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:53:58.300341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:53:58.300341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:53:58.300341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:53:58.300341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:53:58.300341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 20:53:58.300341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:58.300891 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 316/624] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:53:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:58.302532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773c99b-a980-4ce0-a948-85f866dee0bf None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:58.302877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773c99b-a980-4ce0-a948-85f866dee0bf None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:58.305034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773c99b-a980-4ce0-a948-85f866dee0bf None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:58.306856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 317/625] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:53:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:53:58.308271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773c99b-a980-4ce0-a948-85f866dee0bf None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:58.329435 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be818e8-84db-4a5c-a1e5-35629fd35da2 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:58.353887 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:58.416279 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3ba5c-627b-49ba-a29c-0b46820d822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:58.417639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3ba5c-627b-49ba-a29c-0b46820d822e None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:58.418126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3ba5c-627b-49ba-a29c-0b46820d822e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:58.419260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3ba5c-627b-49ba-a29c-0b46820d822e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:58.453080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773c99b-a980-4ce0-a948-85f866dee0bf None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:58.503974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007a060-7ce7-4d81-90c8-f62d3b17962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:58.504515 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a060-7ce7-4d81-90c8-f62d3b17962c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:58.504800 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a060-7ce7-4d81-90c8-f62d3b17962c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:58.505079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a060-7ce7-4d81-90c8-f62d3b17962c None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:58.506771 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007a060-7ce7-4d81-90c8-f62d3b17962c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:58.507111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007a060-7ce7-4d81-90c8-f62d3b17962c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:58.508958 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007a060-7ce7-4d81-90c8-f62d3b17962c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:58.528499 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3ba5c-627b-49ba-a29c-0b46820d822e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:58.530148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3ba5c-627b-49ba-a29c-0b46820d822e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:58.545197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 318/626] 10.222.0.17 () {56 vars in 1135 bytes} [Fri Aug 19 20:53:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:58.545197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5e5fb-060e-4257-a24d-5840c603af61 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:58.545197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5e5fb-060e-4257-a24d-5840c603af61 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:58.545197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5e5fb-060e-4257-a24d-5840c603af61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:58.575053 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-00d5e5fb-060e-4257-a24d-5840c603af61 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:53:58.577358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-00d5e5fb-060e-4257-a24d-5840c603af61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:53:58.644548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:58.675509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 309/627] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:53:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:53:58.677861 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3ba5c-627b-49ba-a29c-0b46820d822e None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:58.682290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 319/628] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:53:58.683519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5e5fb-060e-4257-a24d-5840c603af61 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:58.699084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:58.850518 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5e5fb-060e-4257-a24d-5840c603af61 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:58.889275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3ba5c-627b-49ba-a29c-0b46820d822e None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:58.893471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02d86c-a74d-450f-a9cc-3f8d186aff55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:58.894134 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d86c-a74d-450f-a9cc-3f8d186aff55 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:58.894420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d86c-a74d-450f-a9cc-3f8d186aff55 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:58.894699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d86c-a74d-450f-a9cc-3f8d186aff55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:58.907356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02d86c-a74d-450f-a9cc-3f8d186aff55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:58.908842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02d86c-a74d-450f-a9cc-3f8d186aff55 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-3b02d86c-a74d-450f-a9cc-3f8d186aff55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:58.925682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:58.926697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:58.927640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:58.927640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:58.927640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:58.927640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 320/629] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:58.928303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02d86c-a74d-450f-a9cc-3f8d186aff55 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:58.955252 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a922bb-f4fe-488b-a39b-c722ef2221ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:58.956322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a922bb-f4fe-488b-a39b-c722ef2221ed None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:58.956872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a922bb-f4fe-488b-a39b-c722ef2221ed None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:58.957371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a922bb-f4fe-488b-a39b-c722ef2221ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:58.963495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:58.978342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a922bb-f4fe-488b-a39b-c722ef2221ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-53a922bb-f4fe-488b-a39b-c722ef2221ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:58.988033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:58.989325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:58.990284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:58.990284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:58.990284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:58.990284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:58.990284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:58.990284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:58.990284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:58.990284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:58.990284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:58.990284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:58.990284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:58.990284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:58.998590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 310/630] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:59.000260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a922bb-f4fe-488b-a39b-c722ef2221ed None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:59.053758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02d86c-a74d-450f-a9cc-3f8d186aff55 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:59.093599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:59.105030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b54274-45a2-41be-9428-61b29ea76f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:59.106486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b54274-45a2-41be-9428-61b29ea76f88 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:59.106956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b54274-45a2-41be-9428-61b29ea76f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:59.107599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b54274-45a2-41be-9428-61b29ea76f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:59.127405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b54274-45a2-41be-9428-61b29ea76f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:59.129961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b54274-45a2-41be-9428-61b29ea76f88 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-53b54274-45a2-41be-9428-61b29ea76f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:59.155297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:59.157230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:59.159065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:59.159065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:59.159065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:59.159065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 321/631] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:59.159065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b54274-45a2-41be-9428-61b29ea76f88 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:59.159622 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a922bb-f4fe-488b-a39b-c722ef2221ed None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:59.198003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d179a27-ae56-4957-bb94-2e4595a7c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:59.198621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179a27-ae56-4957-bb94-2e4595a7c711 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:59.198938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179a27-ae56-4957-bb94-2e4595a7c711 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:59.199214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179a27-ae56-4957-bb94-2e4595a7c711 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:59.200215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d179a27-ae56-4957-bb94-2e4595a7c711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:59.200215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d179a27-ae56-4957-bb94-2e4595a7c711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:59.201705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d179a27-ae56-4957-bb94-2e4595a7c711 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:59.214795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 311/632] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:59.223156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d179a27-ae56-4957-bb94-2e4595a7c711 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:59.289972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:59.323122 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b54274-45a2-41be-9428-61b29ea76f88 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:59.368425 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d179a27-ae56-4957-bb94-2e4595a7c711 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:59.373936 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331eab8-8e19-48a0-8de8-57e68a4a6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:59.374565 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331eab8-8e19-48a0-8de8-57e68a4a6076 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:59.374880 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331eab8-8e19-48a0-8de8-57e68a4a6076 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:59.375158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331eab8-8e19-48a0-8de8-57e68a4a6076 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:59.375846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331eab8-8e19-48a0-8de8-57e68a4a6076 None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:59.376154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331eab8-8e19-48a0-8de8-57e68a4a6076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:59.377583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331eab8-8e19-48a0-8de8-57e68a4a6076 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:59.391526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 322/633] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:53:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:59.392485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331eab8-8e19-48a0-8de8-57e68a4a6076 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:59.413937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:59.426763 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2470ca2-d165-4fa1-8e35-b491a168cf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:59.427587 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470ca2-d165-4fa1-8e35-b491a168cf13 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:59.428071 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470ca2-d165-4fa1-8e35-b491a168cf13 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:59.428490 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470ca2-d165-4fa1-8e35-b491a168cf13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:59.442989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2470ca2-d165-4fa1-8e35-b491a168cf13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-b2470ca2-d165-4fa1-8e35-b491a168cf13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:53:59.450417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:59.460376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 312/634] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:53:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:59.462658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2470ca2-d165-4fa1-8e35-b491a168cf13 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:59.534716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331eab8-8e19-48a0-8de8-57e68a4a6076 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:59.581369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a44db5-c3d5-4baa-808f-84638000344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:59.582244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a44db5-c3d5-4baa-808f-84638000344a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:59.582728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a44db5-c3d5-4baa-808f-84638000344a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:59.583189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a44db5-c3d5-4baa-808f-84638000344a None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:59.585698 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2470ca2-d165-4fa1-8e35-b491a168cf13 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:59.586489 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a44db5-c3d5-4baa-808f-84638000344a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:59.586969 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a44db5-c3d5-4baa-808f-84638000344a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:59.589063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a44db5-c3d5-4baa-808f-84638000344a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:59.612232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 323/635] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:59.612232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a44db5-c3d5-4baa-808f-84638000344a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:59.614401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:59.643549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038cc9b-2d00-4864-888b-ae73f9bead72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:59.644405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038cc9b-2d00-4864-888b-ae73f9bead72 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:59.644864 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038cc9b-2d00-4864-888b-ae73f9bead72 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:59.645254 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038cc9b-2d00-4864-888b-ae73f9bead72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:59.654992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038cc9b-2d00-4864-888b-ae73f9bead72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:59.656594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038cc9b-2d00-4864-888b-ae73f9bead72 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-7038cc9b-2d00-4864-888b-ae73f9bead72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:53:59.669512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:59.671539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:59.673159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:53:59.673159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:53:59.673159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:53:59.673159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:53:59.673159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:53:59.673159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:53:59.673159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:53:59.673159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:53:59.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 313/636] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:59.676692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038cc9b-2d00-4864-888b-ae73f9bead72 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:59.735591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:59.743392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a44db5-c3d5-4baa-808f-84638000344a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:59.796016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9f9d3-89b7-4d47-b2da-f8390a029537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:59.796772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f9d3-89b7-4d47-b2da-f8390a029537 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:59.797055 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f9d3-89b7-4d47-b2da-f8390a029537 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:59.797335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f9d3-89b7-4d47-b2da-f8390a029537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:59.800324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038cc9b-2d00-4864-888b-ae73f9bead72 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:59.810139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9f9d3-89b7-4d47-b2da-f8390a029537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:59.811814 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9f9d3-89b7-4d47-b2da-f8390a029537 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-31d9f9d3-89b7-4d47-b2da-f8390a029537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:53:59.829240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:53:59.831197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:53:59.833416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:53:59.833416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:53:59.833416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:53:59.833416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 324/637] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:53:59.833416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9f9d3-89b7-4d47-b2da-f8390a029537 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:59.846966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d353df-d39c-45b0-91af-874c54bb5512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:59.847793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d353df-d39c-45b0-91af-874c54bb5512 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:59.848128 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d353df-d39c-45b0-91af-874c54bb5512 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:59.848410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d353df-d39c-45b0-91af-874c54bb5512 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:59.849098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d353df-d39c-45b0-91af-874c54bb5512 None admin] RBAC: Adding query filter params (name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:53:59.849408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d353df-d39c-45b0-91af-874c54bb5512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:53:59.850931 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d353df-d39c-45b0-91af-874c54bb5512 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:53:59.860399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 314/638] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:53:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:53:59.861255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d353df-d39c-45b0-91af-874c54bb5512 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:53:59.906855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:53:59.957338 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9f9d3-89b7-4d47-b2da-f8390a029537 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:59.985807 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d353df-d39c-45b0-91af-874c54bb5512 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:53:59.993013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25c35e-c560-4fdf-84ff-659b0aae4b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:53:59.993741 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25c35e-c560-4fdf-84ff-659b0aae4b9f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:53:59.994031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25c35e-c560-4fdf-84ff-659b0aae4b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:53:59.994312 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25c35e-c560-4fdf-84ff-659b0aae4b9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:53:59.997202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:00.002222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25c35e-c560-4fdf-84ff-659b0aae4b9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:00.003728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25c35e-c560-4fdf-84ff-659b0aae4b9f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-2a25c35e-c560-4fdf-84ff-659b0aae4b9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:00.017151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:00.019174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:00.021038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:00.021038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:00.021038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:00.021038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:00.021038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:00.021038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:00.021038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:00.021038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:00.021038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 325/639] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:53:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:00.021038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25c35e-c560-4fdf-84ff-659b0aae4b9f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:00.031693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a5733-684f-43ac-bc8f-c5120cde339c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:00.032531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a5733-684f-43ac-bc8f-c5120cde339c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:00.032931 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a5733-684f-43ac-bc8f-c5120cde339c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:00.033323 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a5733-684f-43ac-bc8f-c5120cde339c None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:00.034219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a5733-684f-43ac-bc8f-c5120cde339c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:00.034654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a5733-684f-43ac-bc8f-c5120cde339c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:00.036241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a5733-684f-43ac-bc8f-c5120cde339c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:00.050228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 315/640] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:53:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:00.051135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a5733-684f-43ac-bc8f-c5120cde339c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:00.133855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25c35e-c560-4fdf-84ff-659b0aae4b9f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:00.154938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:00.162930 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a5733-684f-43ac-bc8f-c5120cde339c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:00.175298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef579684-b997-4408-afb5-7708a4af05f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:00.175918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef579684-b997-4408-afb5-7708a4af05f8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:00.176205 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef579684-b997-4408-afb5-7708a4af05f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:00.176485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef579684-b997-4408-afb5-7708a4af05f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:00.177146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef579684-b997-4408-afb5-7708a4af05f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:00.177453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef579684-b997-4408-afb5-7708a4af05f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:00.178876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef579684-b997-4408-afb5-7708a4af05f8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:00.192802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 326/641] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:00.193850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc06943-bd5f-4f95-908d-43afae1c8eaf None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:00.194140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc06943-bd5f-4f95-908d-43afae1c8eaf None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:00.194416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc06943-bd5f-4f95-908d-43afae1c8eaf None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:00.195677 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 327/642] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:00.196402 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc06943-bd5f-4f95-908d-43afae1c8eaf None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:00.206965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8365346-87ea-4205-b631-5e7afe62eaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:00.207986 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8365346-87ea-4205-b631-5e7afe62eaea None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:00.208278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8365346-87ea-4205-b631-5e7afe62eaea None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:00.208560 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8365346-87ea-4205-b631-5e7afe62eaea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:00.220009 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8365346-87ea-4205-b631-5e7afe62eaea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:00.221476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8365346-87ea-4205-b631-5e7afe62eaea None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-e8365346-87ea-4205-b631-5e7afe62eaea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:00.237167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:00.239237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:00.241190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:00.241190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:00.241190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:00.241190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 316/643] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:00.241190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8365346-87ea-4205-b631-5e7afe62eaea None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:00.269777 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:00.309534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc06943-bd5f-4f95-908d-43afae1c8eaf None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:00.348615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b8515-f065-4292-8e08-aee78070c0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:00.349227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b8515-f065-4292-8e08-aee78070c0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:00.349504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b8515-f065-4292-8e08-aee78070c0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:00.349776 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b8515-f065-4292-8e08-aee78070c0e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:00.349922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8365346-87ea-4205-b631-5e7afe62eaea None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:00.350466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b8515-f065-4292-8e08-aee78070c0e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:00.350805 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b8515-f065-4292-8e08-aee78070c0e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:00.352253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b8515-f065-4292-8e08-aee78070c0e2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:00.364864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 328/644] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:00.366117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ff4de-0b25-4e2d-9997-565abce2c3c5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:00.366467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ff4de-0b25-4e2d-9997-565abce2c3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:00.366679 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ff4de-0b25-4e2d-9997-565abce2c3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:00.386951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-432ff4de-0b25-4e2d-9997-565abce2c3c5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:00.388623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-432ff4de-0b25-4e2d-9997-565abce2c3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:00.390332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba46b88-ab7a-4005-889e-6f692fdc649e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:00.391039 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba46b88-ab7a-4005-889e-6f692fdc649e None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:00.391324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba46b88-ab7a-4005-889e-6f692fdc649e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:00.391613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba46b88-ab7a-4005-889e-6f692fdc649e None admin] PATH_INFO: `/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/6fbfc93e45704b3ba2e5a4bcf7568a14/roles/7ba43d9ef6cf4709ae99d7e4c68ce879` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:00.408301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba46b88-ab7a-4005-889e-6f692fdc649e None admin] RBAC: Authorizing `identity:create_grant(project_id=d1defe14eddd4b28ac969adb3d504c7a, user_id=6fbfc93e45704b3ba2e5a4bcf7568a14, role_id=7ba43d9ef6cf4709ae99d7e4c68ce879)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:00.409747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba46b88-ab7a-4005-889e-6f692fdc649e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:00.424306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:00.424723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 317/645] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:54:00 2022] PUT /identity/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/6fbfc93e45704b3ba2e5a4bcf7568a14/roles/7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:54:00.425590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba46b88-ab7a-4005-889e-6f692fdc649e None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:00.490790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 329/646] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:54:00.490790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ff4de-0b25-4e2d-9997-565abce2c3c5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:00.541783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:00.600796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba46b88-ab7a-4005-889e-6f692fdc649e None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:00.659800 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce640c-45fa-465c-a5f1-04e2e95f48fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:00.661395 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce640c-45fa-465c-a5f1-04e2e95f48fb None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:00.662121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce640c-45fa-465c-a5f1-04e2e95f48fb None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:00.663202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce640c-45fa-465c-a5f1-04e2e95f48fb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:00.676669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ff4de-0b25-4e2d-9997-565abce2c3c5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:00.681035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce640c-45fa-465c-a5f1-04e2e95f48fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:00.685157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce640c-45fa-465c-a5f1-04e2e95f48fb None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-cbce640c-45fa-465c-a5f1-04e2e95f48fb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:00.706765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:00.708863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:00.710629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:00.710629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:00.710629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:00.710629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:00.710629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:00.710629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:00.710629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:00.710629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:00.710629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 20:54:00.710629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:00.713350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 318/647] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:54:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:00.718708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce640c-45fa-465c-a5f1-04e2e95f48fb None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:00.745221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c5d6b-1adb-4fe6-9204-0a933b25fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:00.746414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c5d6b-1adb-4fe6-9204-0a933b25fdaa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:00.747595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c5d6b-1adb-4fe6-9204-0a933b25fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:00.748108 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c5d6b-1adb-4fe6-9204-0a933b25fdaa None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:00.749587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c5d6b-1adb-4fe6-9204-0a933b25fdaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:00.750771 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c5d6b-1adb-4fe6-9204-0a933b25fdaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:00.753619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c5d6b-1adb-4fe6-9204-0a933b25fdaa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:00.778910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 330/648] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:00.780616 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c5d6b-1adb-4fe6-9204-0a933b25fdaa None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:00.820351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:00.894143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce640c-45fa-465c-a5f1-04e2e95f48fb None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:00.919246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c5d6b-1adb-4fe6-9204-0a933b25fdaa None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:00.939343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:00.949009 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae0f8c-e71c-4dcb-ae48-56c437905da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:00.950314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae0f8c-e71c-4dcb-ae48-56c437905da9 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:00.950607 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae0f8c-e71c-4dcb-ae48-56c437905da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:00.951082 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae0f8c-e71c-4dcb-ae48-56c437905da9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:00.952333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae0f8c-e71c-4dcb-ae48-56c437905da9 None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=83e51beb8d0e4219af906860ce906500) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:00.952838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae0f8c-e71c-4dcb-ae48-56c437905da9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:00.954369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae0f8c-e71c-4dcb-ae48-56c437905da9 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:00.971282 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 319/649] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:54:00 2022] GET /identity/v3/role_assignments?user.id=83e51beb8d0e4219af906860ce906500&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:00.972737 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae0f8c-e71c-4dcb-ae48-56c437905da9 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:00.978599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceff423-0767-47ed-8067-326fc0c052bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:00.979267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceff423-0767-47ed-8067-326fc0c052bf None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:00.979551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceff423-0767-47ed-8067-326fc0c052bf None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:00.979824 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceff423-0767-47ed-8067-326fc0c052bf None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:00.980581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceff423-0767-47ed-8067-326fc0c052bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:00.981420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceff423-0767-47ed-8067-326fc0c052bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:00.983325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceff423-0767-47ed-8067-326fc0c052bf None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:01.028861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 331/650] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Aug 19 20:54:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:01.030515 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceff423-0767-47ed-8067-326fc0c052bf None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:01.147114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae0f8c-e71c-4dcb-ae48-56c437905da9 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:01.161336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:01.182150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceff423-0767-47ed-8067-326fc0c052bf None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:01.218338 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1df4fa-c745-4282-8ded-15b8150f40f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:01.219926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1df4fa-c745-4282-8ded-15b8150f40f8 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:01.220713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1df4fa-c745-4282-8ded-15b8150f40f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:01.221395 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1df4fa-c745-4282-8ded-15b8150f40f8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:01.225573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0641608-8fc6-41cb-8d61-74402ffe462f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:01.226416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0641608-8fc6-41cb-8d61-74402ffe462f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:01.226876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0641608-8fc6-41cb-8d61-74402ffe462f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:01.227313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0641608-8fc6-41cb-8d61-74402ffe462f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:01.235418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1df4fa-c745-4282-8ded-15b8150f40f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:01.238258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1df4fa-c745-4282-8ded-15b8150f40f8 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:01.240920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0641608-8fc6-41cb-8d61-74402ffe462f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-e0641608-8fc6-41cb-8d61-74402ffe462f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:01.246844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:01.248675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:01.250430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:01.250430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:01.250430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:01.250430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:01.250430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:01.250430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:01.250430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:01.250430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:01.250430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:01.250430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:01.250430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:54:01.250430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:01.253773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 332/651] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:54:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:01.253773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0641608-8fc6-41cb-8d61-74402ffe462f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-cb1df4fa-c745-4282-8ded-15b8150f40f8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:01.256917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:01.260644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:01.269912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:01.269912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:01.269912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:01.269912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:01.269912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:01.269912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:01.269912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:01.269912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:01.269912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 20:54:01.269912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:01.269912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 320/652] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:54:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:01.269912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1df4fa-c745-4282-8ded-15b8150f40f8 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:01.380792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:01.410319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0641608-8fc6-41cb-8d61-74402ffe462f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:01.462813 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f7844-7517-41b5-850c-9464164d272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:01.463514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f7844-7517-41b5-850c-9464164d272f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:01.463801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f7844-7517-41b5-850c-9464164d272f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:01.464076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f7844-7517-41b5-850c-9464164d272f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:01.475635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1df4fa-c745-4282-8ded-15b8150f40f8 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:01.495606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:01.545318 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef40094-f722-47dd-9f42-c8a1b713316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:01.546839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef40094-f722-47dd-9f42-c8a1b713316a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:01.551448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef40094-f722-47dd-9f42-c8a1b713316a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:01.551916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef40094-f722-47dd-9f42-c8a1b713316a None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:01.554700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef40094-f722-47dd-9f42-c8a1b713316a None admin] RBAC: Adding query filter params (name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:01.556414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef40094-f722-47dd-9f42-c8a1b713316a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:01.558811 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef40094-f722-47dd-9f42-c8a1b713316a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:01.588890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 321/653] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:54:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:01.595292 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef40094-f722-47dd-9f42-c8a1b713316a None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:01.652202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f7844-7517-41b5-850c-9464164d272f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:01.659369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f7844-7517-41b5-850c-9464164d272f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:01.922796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 333/654] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:54:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:54:01.925907 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f7844-7517-41b5-850c-9464164d272f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:01.998897 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef40094-f722-47dd-9f42-c8a1b713316a None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:02.060113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:02.072829 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:02.096963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0c94b-2953-4ecf-953f-5f825e1941ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:02.097937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0c94b-2953-4ecf-953f-5f825e1941ea None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:02.098457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0c94b-2953-4ecf-953f-5f825e1941ea None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:02.099040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0c94b-2953-4ecf-953f-5f825e1941ea None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:02.100700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0c94b-2953-4ecf-953f-5f825e1941ea None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:02.101702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0c94b-2953-4ecf-953f-5f825e1941ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:02.103956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0c94b-2953-4ecf-953f-5f825e1941ea None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:02.138938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 322/655] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Aug 19 20:54:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 544 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:02.140537 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0c94b-2953-4ecf-953f-5f825e1941ea None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:02.175281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f7844-7517-41b5-850c-9464164d272f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:02.242531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d4e3e-6c0f-448d-af3d-8eff8c3ae548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:02.244065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d4e3e-6c0f-448d-af3d-8eff8c3ae548 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:02.244800 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d4e3e-6c0f-448d-af3d-8eff8c3ae548 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:02.245529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d4e3e-6c0f-448d-af3d-8eff8c3ae548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:02.265889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d4e3e-6c0f-448d-af3d-8eff8c3ae548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:02.269107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d4e3e-6c0f-448d-af3d-8eff8c3ae548 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-d72d4e3e-6c0f-448d-af3d-8eff8c3ae548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:02.298428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:02.300569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:02.302430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:02.302430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:02.302430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:02.306858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 334/656] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:02.308563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d4e3e-6c0f-448d-af3d-8eff8c3ae548 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:02.337258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0c94b-2953-4ecf-953f-5f825e1941ea None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:02.405496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f19e4-d524-4c10-8947-43163497f97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:02.406508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f19e4-d524-4c10-8947-43163497f97d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:02.407088 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f19e4-d524-4c10-8947-43163497f97d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:02.407562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f19e4-d524-4c10-8947-43163497f97d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:02.428181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f19e4-d524-4c10-8947-43163497f97d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:02.431067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f19e4-d524-4c10-8947-43163497f97d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-147f19e4-d524-4c10-8947-43163497f97d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:02.463667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:02.465556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:02.468317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:02.468317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:02.468317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:02.468317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 323/657] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:02.468317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f19e4-d524-4c10-8947-43163497f97d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:02.504122 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d4e3e-6c0f-448d-af3d-8eff8c3ae548 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:02.523275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:02.529555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:02.562410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f18cc-b495-401d-b5e5-ac9b98944823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:02.563391 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f18cc-b495-401d-b5e5-ac9b98944823 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:02.563834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f18cc-b495-401d-b5e5-ac9b98944823 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:02.564264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f18cc-b495-401d-b5e5-ac9b98944823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:02.628399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f19e4-d524-4c10-8947-43163497f97d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:02.653314 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f18cc-b495-401d-b5e5-ac9b98944823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:02.655140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f18cc-b495-401d-b5e5-ac9b98944823 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:02.679760 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb042c-0bde-4893-a4d1-932065536525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:02.680633 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb042c-0bde-4893-a4d1-932065536525 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:02.681250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb042c-0bde-4893-a4d1-932065536525 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:02.681783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb042c-0bde-4893-a4d1-932065536525 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:02.682697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb042c-0bde-4893-a4d1-932065536525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:02.683270 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb042c-0bde-4893-a4d1-932065536525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:02.685660 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb042c-0bde-4893-a4d1-932065536525 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:02.709128 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 324/658] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:02.709128 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb042c-0bde-4893-a4d1-932065536525 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:02.787831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:02.802317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 335/659] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:54:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:54:02.804166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051163e-9861-42da-97a3-7b12820f029a None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:02.804761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051163e-9861-42da-97a3-7b12820f029a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:02.805207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051163e-9861-42da-97a3-7b12820f029a None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:02.807549 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 336/660] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:02.808538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051163e-9861-42da-97a3-7b12820f029a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:02.838883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:02.854360 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb042c-0bde-4893-a4d1-932065536525 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:02.896601 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b558b15-e2e4-42f4-bc11-1d5096994353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:02.897256 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b558b15-e2e4-42f4-bc11-1d5096994353 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:02.897544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b558b15-e2e4-42f4-bc11-1d5096994353 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:02.897826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b558b15-e2e4-42f4-bc11-1d5096994353 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:02.898486 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b558b15-e2e4-42f4-bc11-1d5096994353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:02.898826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b558b15-e2e4-42f4-bc11-1d5096994353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:02.900200 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b558b15-e2e4-42f4-bc11-1d5096994353 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:02.915572 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 325/661] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:02.916880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b558b15-e2e4-42f4-bc11-1d5096994353 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:02.949940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051163e-9861-42da-97a3-7b12820f029a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:02.993318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec5b1a-ba5f-4e67-a61a-5b42d656579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:02.994142 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec5b1a-ba5f-4e67-a61a-5b42d656579a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:02.994430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec5b1a-ba5f-4e67-a61a-5b42d656579a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:02.995058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec5b1a-ba5f-4e67-a61a-5b42d656579a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:03.003602 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec5b1a-ba5f-4e67-a61a-5b42d656579a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:03.005097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec5b1a-ba5f-4e67-a61a-5b42d656579a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-7fec5b1a-ba5f-4e67-a61a-5b42d656579a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:03.018406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:03.019685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:03.022286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:03.022286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:03.022286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:03.022286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:03.022286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:03.022286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:03.022286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:03.022286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:03.022286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 20:54:03.022286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:03.022286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 337/662] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:54:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:03.022286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4024bc-de24-4795-b26a-3736eea58e4d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:03.022286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4024bc-de24-4795-b26a-3736eea58e4d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:03.024946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4024bc-de24-4795-b26a-3736eea58e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:03.042517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6d4024bc-de24-4795-b26a-3736eea58e4d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:03.043920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6d4024bc-de24-4795-b26a-3736eea58e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:03.069553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b558b15-e2e4-42f4-bc11-1d5096994353 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:03.113446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d9d48-5cf6-4c1d-93ad-49fc65644ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:03.114198 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d9d48-5cf6-4c1d-93ad-49fc65644ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:03.114485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d9d48-5cf6-4c1d-93ad-49fc65644ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:03.114788 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d9d48-5cf6-4c1d-93ad-49fc65644ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:03.120819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:03.128009 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d9d48-5cf6-4c1d-93ad-49fc65644ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:03.129981 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d9d48-5cf6-4c1d-93ad-49fc65644ab7 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:03.140459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-b01d9d48-5cf6-4c1d-93ad-49fc65644ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:03.148681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:03.150684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:03.152663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:03.152663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:03.152663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:03.154350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 338/663] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:54:03.154350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4024bc-de24-4795-b26a-3736eea58e4d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:03.167742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 326/664] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:03.167742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d9d48-5cf6-4c1d-93ad-49fc65644ab7 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:03.294250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d9d48-5cf6-4c1d-93ad-49fc65644ab7 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:03.326701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4024bc-de24-4795-b26a-3736eea58e4d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:03.333739 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b235fbe-bfdc-4ade-8c2f-357bcf402326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:03.334531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b235fbe-bfdc-4ade-8c2f-357bcf402326 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:03.334944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b235fbe-bfdc-4ade-8c2f-357bcf402326 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:03.335347 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b235fbe-bfdc-4ade-8c2f-357bcf402326 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:03.336196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b235fbe-bfdc-4ade-8c2f-357bcf402326 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:03.336607 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b235fbe-bfdc-4ade-8c2f-357bcf402326 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:03.338245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b235fbe-bfdc-4ade-8c2f-357bcf402326 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:03.361392 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 327/665] 10.222.0.17 () {56 vars in 1139 bytes} [Fri Aug 19 20:54:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:03.362467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b235fbe-bfdc-4ade-8c2f-357bcf402326 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:03.413437 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bea83-9327-4ee0-9a35-40aa7fc9660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:03.414482 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bea83-9327-4ee0-9a35-40aa7fc9660e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:03.415063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bea83-9327-4ee0-9a35-40aa7fc9660e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:03.416420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bea83-9327-4ee0-9a35-40aa7fc9660e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:03.433207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bea83-9327-4ee0-9a35-40aa7fc9660e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:03.436667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bea83-9327-4ee0-9a35-40aa7fc9660e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:03.447415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-492bea83-9327-4ee0-9a35-40aa7fc9660e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:03.471363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:03.472353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:03.473336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:03.473336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:03.473336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:03.473336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:03.473336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:03.473336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:03.473336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:03.473336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:03.478779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 339/666] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:03.478779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bea83-9327-4ee0-9a35-40aa7fc9660e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:03.514613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b235fbe-bfdc-4ade-8c2f-357bcf402326 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:03.557625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:03.581076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882713fa-eff5-412e-b842-da518f2c55ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:03.582118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882713fa-eff5-412e-b842-da518f2c55ab None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:03.582611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882713fa-eff5-412e-b842-da518f2c55ab None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:03.583148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882713fa-eff5-412e-b842-da518f2c55ab None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:03.584138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882713fa-eff5-412e-b842-da518f2c55ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:03.584688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882713fa-eff5-412e-b842-da518f2c55ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:03.587157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882713fa-eff5-412e-b842-da518f2c55ab None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:03.609911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 328/667] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:03.611566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882713fa-eff5-412e-b842-da518f2c55ab None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:03.630279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bea83-9327-4ee0-9a35-40aa7fc9660e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:03.670833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d02e4-309f-4c52-ab3a-9723b9967c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:03.671393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d02e4-309f-4c52-ab3a-9723b9967c83 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:03.671676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d02e4-309f-4c52-ab3a-9723b9967c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:03.671942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d02e4-309f-4c52-ab3a-9723b9967c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:03.749610 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882713fa-eff5-412e-b842-da518f2c55ab None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:03.761611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d02e4-309f-4c52-ab3a-9723b9967c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:03.763980 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d02e4-309f-4c52-ab3a-9723b9967c83 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:03.774293 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:03.805211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee8d15-d02a-4ac5-961d-82d9b4922c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:03.806258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee8d15-d02a-4ac5-961d-82d9b4922c86 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:03.806826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee8d15-d02a-4ac5-961d-82d9b4922c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:03.807330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee8d15-d02a-4ac5-961d-82d9b4922c86 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:03.808692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee8d15-d02a-4ac5-961d-82d9b4922c86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:03.809722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee8d15-d02a-4ac5-961d-82d9b4922c86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:03.812302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee8d15-d02a-4ac5-961d-82d9b4922c86 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:03.822717 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:03.838785 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 329/668] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:03.838785 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee8d15-d02a-4ac5-961d-82d9b4922c86 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:03.898206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 340/669] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:54:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:54:03.899881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d02e4-309f-4c52-ab3a-9723b9967c83 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:03.966093 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee8d15-d02a-4ac5-961d-82d9b4922c86 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:04.004728 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43be48-84ee-42d5-aae8-1f512a069131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:04.005627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43be48-84ee-42d5-aae8-1f512a069131 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:04.005910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43be48-84ee-42d5-aae8-1f512a069131 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:04.006182 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43be48-84ee-42d5-aae8-1f512a069131 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:04.018524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43be48-84ee-42d5-aae8-1f512a069131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-cf43be48-84ee-42d5-aae8-1f512a069131 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:04.023335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:04.025108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:04.026726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:04.026726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:04.026726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:04.026726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:04.026726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:04.026726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:04.026726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:04.026726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:04.026726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:04.026726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:04.026726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:54:04.026726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:04.028808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 330/670] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:54:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:04.030041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8531f25-4799-4c5f-9595-516310f2ed40 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:04.030458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8531f25-4799-4c5f-9595-516310f2ed40 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:04.030872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8531f25-4799-4c5f-9595-516310f2ed40 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:04.032506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 331/671] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:04.033351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8531f25-4799-4c5f-9595-516310f2ed40 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:04.062682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d02e4-309f-4c52-ab3a-9723b9967c83 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:04.082496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:04.124747 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0991794-8ca1-4ac2-bd1c-299385c2397b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:04.125547 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0991794-8ca1-4ac2-bd1c-299385c2397b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:04.125922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0991794-8ca1-4ac2-bd1c-299385c2397b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:04.126295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0991794-8ca1-4ac2-bd1c-299385c2397b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:04.134313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0991794-8ca1-4ac2-bd1c-299385c2397b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:04.135811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0991794-8ca1-4ac2-bd1c-299385c2397b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-b0991794-8ca1-4ac2-bd1c-299385c2397b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:04.149187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:04.150359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:04.151601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:04.151601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:04.151601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:04.151601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:04.151601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:04.151601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:04.151601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:04.151601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:04.155226 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 341/672] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:04.156273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0991794-8ca1-4ac2-bd1c-299385c2397b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:04.166391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8531f25-4799-4c5f-9595-516310f2ed40 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:04.166589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:04.204201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c09b3a-0bd2-4b7b-9a5f-a0ffbefde488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:04.204805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c09b3a-0bd2-4b7b-9a5f-a0ffbefde488 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:04.205083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c09b3a-0bd2-4b7b-9a5f-a0ffbefde488 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:04.205353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c09b3a-0bd2-4b7b-9a5f-a0ffbefde488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:04.206093 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c09b3a-0bd2-4b7b-9a5f-a0ffbefde488 None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=51e6b105e7094aea9dcc7423d6205c1c) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:04.206396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c09b3a-0bd2-4b7b-9a5f-a0ffbefde488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:04.207888 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c09b3a-0bd2-4b7b-9a5f-a0ffbefde488 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:04.214149 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 332/673] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:54:04 2022] GET /identity/v3/role_assignments?user.id=51e6b105e7094aea9dcc7423d6205c1c&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:04.215028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c09b3a-0bd2-4b7b-9a5f-a0ffbefde488 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:04.302695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0991794-8ca1-4ac2-bd1c-299385c2397b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:04.350598 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740e3c4-9906-4eb6-a336-d6c2cd81008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:04.351310 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740e3c4-9906-4eb6-a336-d6c2cd81008a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:04.351600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740e3c4-9906-4eb6-a336-d6c2cd81008a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:04.352171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740e3c4-9906-4eb6-a336-d6c2cd81008a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:04.366771 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740e3c4-9906-4eb6-a336-d6c2cd81008a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:04.368330 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740e3c4-9906-4eb6-a336-d6c2cd81008a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:04.382316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c09b3a-0bd2-4b7b-9a5f-a0ffbefde488 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:04.384370 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-e740e3c4-9906-4eb6-a336-d6c2cd81008a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:04.389661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:04.390797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:04.391836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:04.391836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:04.391836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:04.391836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 342/674] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:04.392627 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee5cd4-3f12-47b2-bf0f-e854f061deb8 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:04.393763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee5cd4-3f12-47b2-bf0f-e854f061deb8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:04.393763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee5cd4-3f12-47b2-bf0f-e854f061deb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:04.415860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-44ee5cd4-3f12-47b2-bf0f-e854f061deb8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:04.417749 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-44ee5cd4-3f12-47b2-bf0f-e854f061deb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:04.443313 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82284f0-08f7-47f3-a0a2-695b975f72e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:04.444914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82284f0-08f7-47f3-a0a2-695b975f72e5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:04.444914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82284f0-08f7-47f3-a0a2-695b975f72e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:04.445327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82284f0-08f7-47f3-a0a2-695b975f72e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:04.446591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82284f0-08f7-47f3-a0a2-695b975f72e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:04.447220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82284f0-08f7-47f3-a0a2-695b975f72e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:04.450922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82284f0-08f7-47f3-a0a2-695b975f72e5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:04.467087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 333/675] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:54:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:04.468749 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82284f0-08f7-47f3-a0a2-695b975f72e5 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:04.492970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:04.515724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 343/676] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:54:04.516735 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee5cd4-3f12-47b2-bf0f-e854f061deb8 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:04.635184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82284f0-08f7-47f3-a0a2-695b975f72e5 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:04.639276 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee5cd4-3f12-47b2-bf0f-e854f061deb8 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:04.681649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fa8df-ec5c-49d1-b61f-a44104fd8d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:04.682449 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fa8df-ec5c-49d1-b61f-a44104fd8d5e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:04.682872 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fa8df-ec5c-49d1-b61f-a44104fd8d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:04.683249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fa8df-ec5c-49d1-b61f-a44104fd8d5e None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:04.684683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fa8df-ec5c-49d1-b61f-a44104fd8d5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:04.685098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fa8df-ec5c-49d1-b61f-a44104fd8d5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:04.685620 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39177e-128b-423c-98f0-0dac8c3b7a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:04.686355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39177e-128b-423c-98f0-0dac8c3b7a0c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:04.686642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39177e-128b-423c-98f0-0dac8c3b7a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:04.686954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39177e-128b-423c-98f0-0dac8c3b7a0c None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:04.687061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fa8df-ec5c-49d1-b61f-a44104fd8d5e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:04.687674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39177e-128b-423c-98f0-0dac8c3b7a0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:04.687988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39177e-128b-423c-98f0-0dac8c3b7a0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:04.689825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39177e-128b-423c-98f0-0dac8c3b7a0c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:04.701647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 344/677] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:04.702774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fa8df-ec5c-49d1-b61f-a44104fd8d5e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:04.707699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 334/678] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:04.709624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39177e-128b-423c-98f0-0dac8c3b7a0c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:04.747391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:04.784525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:04.845462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39177e-128b-423c-98f0-0dac8c3b7a0c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:04.847368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fa8df-ec5c-49d1-b61f-a44104fd8d5e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:04.884711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e2547-0ab4-4a95-b1b2-08e085b727f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:04.885644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2547-0ab4-4a95-b1b2-08e085b727f4 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:04.885994 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2547-0ab4-4a95-b1b2-08e085b727f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:04.886358 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2547-0ab4-4a95-b1b2-08e085b727f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:04.889532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ffe54-e6a7-46db-833a-226bce4de06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:04.890509 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ffe54-e6a7-46db-833a-226bce4de06b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:04.891034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ffe54-e6a7-46db-833a-226bce4de06b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:04.891494 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ffe54-e6a7-46db-833a-226bce4de06b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:04.895275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e2547-0ab4-4a95-b1b2-08e085b727f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:04.896896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e2547-0ab4-4a95-b1b2-08e085b727f4 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:04.904862 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ffe54-e6a7-46db-833a-226bce4de06b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:04.906640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ffe54-e6a7-46db-833a-226bce4de06b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-3d0e2547-0ab4-4a95-b1b2-08e085b727f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:04.911418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:04.912593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:04.913567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:04.913567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:04.913567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:04.913567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:04.913567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:04.913567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:04.913567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:04.913567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:04.914385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 335/679] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:04.915533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e2547-0ab4-4a95-b1b2-08e085b727f4 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-fd9ffe54-e6a7-46db-833a-226bce4de06b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:04.927751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:04.928801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:04.929744 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:04.929744 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:04.929744 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:04.931839 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 345/680] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:04.932952 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ffe54-e6a7-46db-833a-226bce4de06b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:05.022240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:05.042303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e2547-0ab4-4a95-b1b2-08e085b727f4 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:05.061740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:05.065091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ffe54-e6a7-46db-833a-226bce4de06b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:05.100247 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11c1f6-f933-4d36-8f37-e0a4a2b58ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:05.101429 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11c1f6-f933-4d36-8f37-e0a4a2b58ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:05.101954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11c1f6-f933-4d36-8f37-e0a4a2b58ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:05.102425 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11c1f6-f933-4d36-8f37-e0a4a2b58ec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:05.103843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11c1f6-f933-4d36-8f37-e0a4a2b58ec4 None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=4c27e2db991245359bcceb62ff768b36) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:05.104413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11c1f6-f933-4d36-8f37-e0a4a2b58ec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:05.105323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddf1b4-5b02-4206-95c9-213486f1b0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:05.105997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf1b4-5b02-4206-95c9-213486f1b0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:05.106284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf1b4-5b02-4206-95c9-213486f1b0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:05.106564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf1b4-5b02-4206-95c9-213486f1b0b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:05.107221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11c1f6-f933-4d36-8f37-e0a4a2b58ec4 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:05.107327 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddf1b4-5b02-4206-95c9-213486f1b0b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:05.107632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddf1b4-5b02-4206-95c9-213486f1b0b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:05.109119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddf1b4-5b02-4206-95c9-213486f1b0b1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:05.123114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 336/681] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:54:04 2022] GET /identity/v3/role_assignments?user.id=4c27e2db991245359bcceb62ff768b36&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:05.123114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11c1f6-f933-4d36-8f37-e0a4a2b58ec4 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:05.143523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 346/682] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:05.145410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddf1b4-5b02-4206-95c9-213486f1b0b1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:05.332613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11c1f6-f933-4d36-8f37-e0a4a2b58ec4 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:05.346605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddf1b4-5b02-4206-95c9-213486f1b0b1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:05.401755 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87ccce-f9ce-4472-af6c-4075abea38c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:05.402656 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87ccce-f9ce-4472-af6c-4075abea38c1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:05.403731 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87ccce-f9ce-4472-af6c-4075abea38c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:05.404134 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87ccce-f9ce-4472-af6c-4075abea38c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:05.405339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87ccce-f9ce-4472-af6c-4075abea38c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:05.406072 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87ccce-f9ce-4472-af6c-4075abea38c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:05.408615 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87ccce-f9ce-4472-af6c-4075abea38c1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:05.413768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eaea4-0718-43f1-90eb-7ffc19d4a03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:05.414446 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eaea4-0718-43f1-90eb-7ffc19d4a03a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:05.414755 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eaea4-0718-43f1-90eb-7ffc19d4a03a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:05.415040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eaea4-0718-43f1-90eb-7ffc19d4a03a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:05.433286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 337/683] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:05.433286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87ccce-f9ce-4472-af6c-4075abea38c1 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:05.450360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2eaea4-0718-43f1-90eb-7ffc19d4a03a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:05.455169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-6b2eaea4-0718-43f1-90eb-7ffc19d4a03a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:05.463004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:05.464264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:05.465388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:05.465388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:05.465388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:05.465388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:05.465388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:05.465388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:05.465388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:05.465388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:05.465388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:05.465388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:05.465388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:54:05.465388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:05.465388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 347/684] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:54:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:05.471011 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eaea4-0718-43f1-90eb-7ffc19d4a03a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:05.528650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:05.649423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87ccce-f9ce-4472-af6c-4075abea38c1 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:05.700624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eaea4-0718-43f1-90eb-7ffc19d4a03a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:05.724090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be362c54-3795-4e9b-a84c-09bf6a273922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:05.725399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be362c54-3795-4e9b-a84c-09bf6a273922 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:05.725911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be362c54-3795-4e9b-a84c-09bf6a273922 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:05.726401 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be362c54-3795-4e9b-a84c-09bf6a273922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:05.727935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be362c54-3795-4e9b-a84c-09bf6a273922 None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=95b17424a40b475480403eb9f4f3f88f) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:05.728480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be362c54-3795-4e9b-a84c-09bf6a273922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:05.731311 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be362c54-3795-4e9b-a84c-09bf6a273922 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:05.751389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 338/685] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:54:05 2022] GET /identity/v3/role_assignments?user.id=95b17424a40b475480403eb9f4f3f88f&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:05.753084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be362c54-3795-4e9b-a84c-09bf6a273922 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:05.780737 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2741f0a-c5e2-49f8-9319-f711f116b018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:05.782342 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2741f0a-c5e2-49f8-9319-f711f116b018 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:05.783243 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2741f0a-c5e2-49f8-9319-f711f116b018 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:05.784032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2741f0a-c5e2-49f8-9319-f711f116b018 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:05.799777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2741f0a-c5e2-49f8-9319-f711f116b018 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:05.803060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2741f0a-c5e2-49f8-9319-f711f116b018 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-c2741f0a-c5e2-49f8-9319-f711f116b018 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:05.831060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:05.832930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:05.835798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:05.835798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:05.835798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:05.835798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:05.835798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:05.835798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:05.835798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:05.835798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:05.835798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 20:54:05.835798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:05.841538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 348/686] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:54:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:05.852299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2741f0a-c5e2-49f8-9319-f711f116b018 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:05.961414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:06.025864 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be362c54-3795-4e9b-a84c-09bf6a273922 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:06.052807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:06.102558 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2741f0a-c5e2-49f8-9319-f711f116b018 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:06.107211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01128a-771f-48c2-b32b-55c8153cc7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:06.109336 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01128a-771f-48c2-b32b-55c8153cc7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:06.110133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01128a-771f-48c2-b32b-55c8153cc7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:06.111025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01128a-771f-48c2-b32b-55c8153cc7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:06.112631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01128a-771f-48c2-b32b-55c8153cc7f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:06.113604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01128a-771f-48c2-b32b-55c8153cc7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:06.116720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01128a-771f-48c2-b32b-55c8153cc7f3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:06.135322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 339/687] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:54:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:06.145402 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01128a-771f-48c2-b32b-55c8153cc7f3 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:06.188077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81707b4-acb6-4211-9748-51847f58ef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:06.188714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81707b4-acb6-4211-9748-51847f58ef66 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:06.189003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81707b4-acb6-4211-9748-51847f58ef66 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:06.189337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81707b4-acb6-4211-9748-51847f58ef66 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:06.190096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81707b4-acb6-4211-9748-51847f58ef66 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:06.190405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81707b4-acb6-4211-9748-51847f58ef66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:06.193257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81707b4-acb6-4211-9748-51847f58ef66 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:06.218440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 349/688] 10.222.0.17 () {56 vars in 1135 bytes} [Fri Aug 19 20:54:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:06.224267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81707b4-acb6-4211-9748-51847f58ef66 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:06.363598 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81707b4-acb6-4211-9748-51847f58ef66 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:06.366832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01128a-771f-48c2-b32b-55c8153cc7f3 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:06.414164 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc389e8f-6eb9-4970-9edc-edd281c9e926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:06.415094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc389e8f-6eb9-4970-9edc-edd281c9e926 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:06.415379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc389e8f-6eb9-4970-9edc-edd281c9e926 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:06.415650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc389e8f-6eb9-4970-9edc-edd281c9e926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:06.423563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42315321-eaae-4abe-b67b-6588ad814815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:06.424604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42315321-eaae-4abe-b67b-6588ad814815 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:06.425080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42315321-eaae-4abe-b67b-6588ad814815 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:06.425547 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42315321-eaae-4abe-b67b-6588ad814815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:06.427416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:06.428846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:06.443907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42315321-eaae-4abe-b67b-6588ad814815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:06.445522 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42315321-eaae-4abe-b67b-6588ad814815 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-42315321-eaae-4abe-b67b-6588ad814815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:06.464231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:06.467393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:06.469913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:06.469913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:06.469913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:06.469913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 340/689] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:06.469913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf452e6d-65eb-4cee-8ea4-fe695e883d7d None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:06.469913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf452e6d-65eb-4cee-8ea4-fe695e883d7d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:06.469913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf452e6d-65eb-4cee-8ea4-fe695e883d7d None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:06.475819 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 341/690] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:06.475819 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf452e6d-65eb-4cee-8ea4-fe695e883d7d None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:06.577724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc389e8f-6eb9-4970-9edc-edd281c9e926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:06.581317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc389e8f-6eb9-4970-9edc-edd281c9e926 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:06.588197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf452e6d-65eb-4cee-8ea4-fe695e883d7d None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:06.626527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab2879-7083-4d3a-a185-6cddbedf81c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:06.626527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab2879-7083-4d3a-a185-6cddbedf81c0 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:06.626989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab2879-7083-4d3a-a185-6cddbedf81c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:06.626989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab2879-7083-4d3a-a185-6cddbedf81c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:06.627632 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab2879-7083-4d3a-a185-6cddbedf81c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:06.627937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab2879-7083-4d3a-a185-6cddbedf81c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:06.629329 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab2879-7083-4d3a-a185-6cddbedf81c0 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:06.644639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 342/691] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:06.646011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2efc0c-59b5-4f76-bc86-506e5d5c0b0a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:06.646302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2efc0c-59b5-4f76-bc86-506e5d5c0b0a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:06.646578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2efc0c-59b5-4f76-bc86-506e5d5c0b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:06.666017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-9c2efc0c-59b5-4f76-bc86-506e5d5c0b0a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:06.667298 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9c2efc0c-59b5-4f76-bc86-506e5d5c0b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:06.716007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:06.750873 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 343/692] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:54:06.750873 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2efc0c-59b5-4f76-bc86-506e5d5c0b0a None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:06.857914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 350/693] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:54:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:54:06.868037 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2efc0c-59b5-4f76-bc86-506e5d5c0b0a None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:06.871845 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc389e8f-6eb9-4970-9edc-edd281c9e926 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:06.907400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a7b4a-550f-4b67-bf9d-d6b43e05341c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:06.908055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a7b4a-550f-4b67-bf9d-d6b43e05341c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:06.908335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a7b4a-550f-4b67-bf9d-d6b43e05341c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:06.908624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a7b4a-550f-4b67-bf9d-d6b43e05341c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:06.916480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a7b4a-550f-4b67-bf9d-d6b43e05341c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:06.918139 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a7b4a-550f-4b67-bf9d-d6b43e05341c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-771a7b4a-550f-4b67-bf9d-d6b43e05341c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:06.933561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:06.936406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:06.942684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:06.942684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:06.942684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:06.942684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:06.942684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:06.942684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:06.942684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:06.942684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:06.942684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:54:06.942684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:06.942684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 344/694] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Aug 19 20:54:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:06.942684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a7b4a-550f-4b67-bf9d-d6b43e05341c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:06.980217 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:07.021825 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:07.071777 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a7b4a-550f-4b67-bf9d-d6b43e05341c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:07.115390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bb196-3de9-4acd-9e9d-5cca02de0312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:07.116072 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bb196-3de9-4acd-9e9d-5cca02de0312 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:07.116400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bb196-3de9-4acd-9e9d-5cca02de0312 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:07.116750 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bb196-3de9-4acd-9e9d-5cca02de0312 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:07.117588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bb196-3de9-4acd-9e9d-5cca02de0312 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:07.117968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bb196-3de9-4acd-9e9d-5cca02de0312 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:07.119580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bb196-3de9-4acd-9e9d-5cca02de0312 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:07.142378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 345/695] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Aug 19 20:54:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:07.151717 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bb196-3de9-4acd-9e9d-5cca02de0312 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:07.198835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc389e8f-6eb9-4970-9edc-edd281c9e926 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:07.274928 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16f4d4-eebe-4a05-8f0a-58ab0c31c9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:07.276553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16f4d4-eebe-4a05-8f0a-58ab0c31c9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:07.276828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16f4d4-eebe-4a05-8f0a-58ab0c31c9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:07.277100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16f4d4-eebe-4a05-8f0a-58ab0c31c9c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:07.299299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16f4d4-eebe-4a05-8f0a-58ab0c31c9c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:07.304426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16f4d4-eebe-4a05-8f0a-58ab0c31c9c8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-db16f4d4-eebe-4a05-8f0a-58ab0c31c9c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:07.342054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:07.344017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:07.346289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:07.346289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:07.346289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:07.349942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 351/696] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 479 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:07.350974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16f4d4-eebe-4a05-8f0a-58ab0c31c9c8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:07.371300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:07.402305 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bb196-3de9-4acd-9e9d-5cca02de0312 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:07.520003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad41b4-c534-44b0-90ef-dde891dfe72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:07.521017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad41b4-c534-44b0-90ef-dde891dfe72f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:07.521515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad41b4-c534-44b0-90ef-dde891dfe72f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:07.521995 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad41b4-c534-44b0-90ef-dde891dfe72f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:07.530577 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:07.540757 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16f4d4-eebe-4a05-8f0a-58ab0c31c9c8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:07.578944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d8111-5199-472a-becd-260b41d94e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:07.579667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d8111-5199-472a-becd-260b41d94e0a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:07.579948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d8111-5199-472a-becd-260b41d94e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:07.580239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d8111-5199-472a-becd-260b41d94e0a None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:07.580916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d8111-5199-472a-becd-260b41d94e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:07.581220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d8111-5199-472a-becd-260b41d94e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:07.582608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d8111-5199-472a-becd-260b41d94e0a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:07.596929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 352/697] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:07.597796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d8111-5199-472a-becd-260b41d94e0a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:07.651956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad41b4-c534-44b0-90ef-dde891dfe72f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:07.655113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad41b4-c534-44b0-90ef-dde891dfe72f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:07.716799 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d8111-5199-472a-becd-260b41d94e0a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:07.758313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f005b-d2ce-41e4-bc70-8427f3b1de77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:07.759006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f005b-d2ce-41e4-bc70-8427f3b1de77 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:07.759287 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f005b-d2ce-41e4-bc70-8427f3b1de77 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:07.759553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f005b-d2ce-41e4-bc70-8427f3b1de77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:07.772234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f005b-d2ce-41e4-bc70-8427f3b1de77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:07.773697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f005b-d2ce-41e4-bc70-8427f3b1de77 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-811f005b-d2ce-41e4-bc70-8427f3b1de77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:07.790583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:07.792798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:07.796288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:07.796288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:07.796288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:07.796288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 353/698] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:07.796288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f005b-d2ce-41e4-bc70-8427f3b1de77 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:07.797341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:07.853784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:07.871036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 346/699] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:54:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 720 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:54:07.874272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad41b4-c534-44b0-90ef-dde891dfe72f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:07.915393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f005b-d2ce-41e4-bc70-8427f3b1de77 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:07.956973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012c7d4-8c56-4bcf-804e-b23540a0a741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:07.957922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012c7d4-8c56-4bcf-804e-b23540a0a741 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:07.958217 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012c7d4-8c56-4bcf-804e-b23540a0a741 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:07.958493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012c7d4-8c56-4bcf-804e-b23540a0a741 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:07.967895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012c7d4-8c56-4bcf-804e-b23540a0a741 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:07.969371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012c7d4-8c56-4bcf-804e-b23540a0a741 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-4012c7d4-8c56-4bcf-804e-b23540a0a741 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:07.985240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:07.987093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:07.988659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:07.988659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:07.988659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:07.988659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:07.988659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:07.988659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:07.988659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:07.988659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:07.990562 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 354/700] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:07.992188 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012c7d4-8c56-4bcf-804e-b23540a0a741 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:08.052038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad41b4-c534-44b0-90ef-dde891dfe72f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:08.097636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba9da2-b3a1-49ae-b308-63a72dd77eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:08.098308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9da2-b3a1-49ae-b308-63a72dd77eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:08.098597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9da2-b3a1-49ae-b308-63a72dd77eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:08.098922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9da2-b3a1-49ae-b308-63a72dd77eb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:08.099641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba9da2-b3a1-49ae-b308-63a72dd77eb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:08.099945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba9da2-b3a1-49ae-b308-63a72dd77eb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:08.101359 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba9da2-b3a1-49ae-b308-63a72dd77eb0 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:08.116687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:08.117334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 347/701] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:08.118473 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff0a1f-2838-476b-86d6-3ed0fab1152e None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:08.118866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff0a1f-2838-476b-86d6-3ed0fab1152e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:08.119143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff0a1f-2838-476b-86d6-3ed0fab1152e None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:08.126513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 348/702] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:08.126513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff0a1f-2838-476b-86d6-3ed0fab1152e None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:08.192797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012c7d4-8c56-4bcf-804e-b23540a0a741 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:08.225169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:08.250251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5fbb6-ad9b-4bc8-90af-9ab75b86c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:08.251363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5fbb6-ad9b-4bc8-90af-9ab75b86c184 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:08.251855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5fbb6-ad9b-4bc8-90af-9ab75b86c184 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:08.252357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5fbb6-ad9b-4bc8-90af-9ab75b86c184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:08.273674 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5fbb6-ad9b-4bc8-90af-9ab75b86c184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:08.276403 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5fbb6-ad9b-4bc8-90af-9ab75b86c184 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-a4a5fbb6-ad9b-4bc8-90af-9ab75b86c184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:08.305120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:08.315373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:08.317271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:08.317271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:08.317271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:08.317271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 355/703] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:08.317271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5fbb6-ad9b-4bc8-90af-9ab75b86c184 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:08.317855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff0a1f-2838-476b-86d6-3ed0fab1152e None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:08.362154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733b859-a9ed-491d-9d1a-8dbd37d6b327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:08.363368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b859-a9ed-491d-9d1a-8dbd37d6b327 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:08.364330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b859-a9ed-491d-9d1a-8dbd37d6b327 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:08.364330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b859-a9ed-491d-9d1a-8dbd37d6b327 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:08.365635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733b859-a9ed-491d-9d1a-8dbd37d6b327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:08.366144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733b859-a9ed-491d-9d1a-8dbd37d6b327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:08.368972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733b859-a9ed-491d-9d1a-8dbd37d6b327 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:08.393510 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 349/704] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:08.395831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea802ca6-083c-4dcf-9260-72e25c244f6e None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:08.396338 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea802ca6-083c-4dcf-9260-72e25c244f6e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:08.396819 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea802ca6-083c-4dcf-9260-72e25c244f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:08.429396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ea802ca6-083c-4dcf-9260-72e25c244f6e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:08.431475 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ea802ca6-083c-4dcf-9260-72e25c244f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:08.481377 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5fbb6-ad9b-4bc8-90af-9ab75b86c184 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:08.505960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:08.537102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 350/705] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:54:08.538934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea802ca6-083c-4dcf-9260-72e25c244f6e None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:08.549931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f84348-abf1-478d-95d8-d83053299020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:08.551047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f84348-abf1-478d-95d8-d83053299020 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:08.551549 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f84348-abf1-478d-95d8-d83053299020 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:08.552029 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f84348-abf1-478d-95d8-d83053299020 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:08.553327 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f84348-abf1-478d-95d8-d83053299020 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:08.556221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f84348-abf1-478d-95d8-d83053299020 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:08.612109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 356/706] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:54:08 2022] POST /identity/v3/users => generated 254 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:54:08.616681 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f84348-abf1-478d-95d8-d83053299020 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:08.683194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:08.853849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea802ca6-083c-4dcf-9260-72e25c244f6e None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:08.912685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f84348-abf1-478d-95d8-d83053299020 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:08.915899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4230b20-2788-4579-9a0a-f37fddaa633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:08.916877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4230b20-2788-4579-9a0a-f37fddaa633e None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:08.917348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4230b20-2788-4579-9a0a-f37fddaa633e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:08.917825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4230b20-2788-4579-9a0a-f37fddaa633e None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:08.919050 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4230b20-2788-4579-9a0a-f37fddaa633e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:08.919537 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4230b20-2788-4579-9a0a-f37fddaa633e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:08.921385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4230b20-2788-4579-9a0a-f37fddaa633e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:08.938354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 351/707] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:08.940244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cd5a4-fcb3-4dee-81f9-d2c1ac430154 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:08.940682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cd5a4-fcb3-4dee-81f9-d2c1ac430154 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:08.941110 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cd5a4-fcb3-4dee-81f9-d2c1ac430154 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:08.943356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 352/708] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:08.944429 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cd5a4-fcb3-4dee-81f9-d2c1ac430154 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:08.985154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae72d1d-55b9-49b0-b990-27a4f455ac2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:08.986114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae72d1d-55b9-49b0-b990-27a4f455ac2d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:08.986590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae72d1d-55b9-49b0-b990-27a4f455ac2d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:08.987138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae72d1d-55b9-49b0-b990-27a4f455ac2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:08.988005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae72d1d-55b9-49b0-b990-27a4f455ac2d None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=6fbfc93e45704b3ba2e5a4bcf7568a14) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:08.988518 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae72d1d-55b9-49b0-b990-27a4f455ac2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:08.991032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae72d1d-55b9-49b0-b990-27a4f455ac2d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:09.007028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 357/709] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:54:08 2022] GET /identity/v3/role_assignments?user.id=6fbfc93e45704b3ba2e5a4bcf7568a14&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 608 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:09.007028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae72d1d-55b9-49b0-b990-27a4f455ac2d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:09.081937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:09.166723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cd5a4-fcb3-4dee-81f9-d2c1ac430154 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:09.172084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:09.234025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7ce59-8cf3-4c52-b43d-25250ddb5ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:09.235215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7ce59-8cf3-4c52-b43d-25250ddb5ded None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:09.235690 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae72d1d-55b9-49b0-b990-27a4f455ac2d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:09.235858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7ce59-8cf3-4c52-b43d-25250ddb5ded None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:09.236292 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7ce59-8cf3-4c52-b43d-25250ddb5ded None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:09.237370 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7ce59-8cf3-4c52-b43d-25250ddb5ded None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:09.239842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7ce59-8cf3-4c52-b43d-25250ddb5ded None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-87c7ce59-8cf3-4c52-b43d-25250ddb5ded None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:09.260233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:09.263244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:09.266704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 353/710] 10.222.0.17 () {56 vars in 1129 bytes} [Fri Aug 19 20:54:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:09.271438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa053f6-b4d0-4b48-8771-6de744fbe03d None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:09.271438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa053f6-b4d0-4b48-8771-6de744fbe03d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:09.271438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa053f6-b4d0-4b48-8771-6de744fbe03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:09.279696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f53a3b-e7ae-4aab-9eea-0971a6fc1953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:09.280359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f53a3b-e7ae-4aab-9eea-0971a6fc1953 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:09.280642 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f53a3b-e7ae-4aab-9eea-0971a6fc1953 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:09.281035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f53a3b-e7ae-4aab-9eea-0971a6fc1953 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:09.289186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f53a3b-e7ae-4aab-9eea-0971a6fc1953 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:09.290665 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f53a3b-e7ae-4aab-9eea-0971a6fc1953 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:09.301409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-baa053f6-b4d0-4b48-8771-6de744fbe03d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:09.303460 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-baa053f6-b4d0-4b48-8771-6de744fbe03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f3f53a3b-e7ae-4aab-9eea-0971a6fc1953 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:09.304336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:09.307581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:09.310878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:09.310878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:09.310878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:09.310878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:09.310878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:09.310878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:09.310878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:09.310878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:09.310878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 358/711] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:09.310878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f53a3b-e7ae-4aab-9eea-0971a6fc1953 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:09.437541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 354/712] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:54:09.443104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa053f6-b4d0-4b48-8771-6de744fbe03d None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:09.447227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:09.457561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f53a3b-e7ae-4aab-9eea-0971a6fc1953 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:09.503753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d1d0f-9068-43cf-9563-f2e7d4d24c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:09.504385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d1d0f-9068-43cf-9563-f2e7d4d24c25 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:09.504669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d1d0f-9068-43cf-9563-f2e7d4d24c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:09.504943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d1d0f-9068-43cf-9563-f2e7d4d24c25 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:09.505861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d1d0f-9068-43cf-9563-f2e7d4d24c25 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:09.506142 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d1d0f-9068-43cf-9563-f2e7d4d24c25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:09.510773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d1d0f-9068-43cf-9563-f2e7d4d24c25 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:09.514751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 359/713] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Aug 19 20:54:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:09.524087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d1d0f-9068-43cf-9563-f2e7d4d24c25 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:09.677456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:09.687255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa053f6-b4d0-4b48-8771-6de744fbe03d None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:09.765316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d1d0f-9068-43cf-9563-f2e7d4d24c25 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:09.797016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414f3ea-5957-453b-9abc-bef3d245b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:09.797997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f3ea-5957-453b-9abc-bef3d245b398 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:09.798467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f3ea-5957-453b-9abc-bef3d245b398 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:09.799004 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f3ea-5957-453b-9abc-bef3d245b398 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:09.800174 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414f3ea-5957-453b-9abc-bef3d245b398 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:09.800712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414f3ea-5957-453b-9abc-bef3d245b398 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:09.803472 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414f3ea-5957-453b-9abc-bef3d245b398 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:09.830917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 355/714] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:09.836556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414f3ea-5957-453b-9abc-bef3d245b398 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:09.841844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ce1ee-13a4-4f07-bcbc-6b1e8ab255e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:09.843520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ce1ee-13a4-4f07-bcbc-6b1e8ab255e4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:09.844280 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ce1ee-13a4-4f07-bcbc-6b1e8ab255e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:09.845019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ce1ee-13a4-4f07-bcbc-6b1e8ab255e4 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:09.846428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ce1ee-13a4-4f07-bcbc-6b1e8ab255e4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:09.847357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ce1ee-13a4-4f07-bcbc-6b1e8ab255e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:09.850167 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ce1ee-13a4-4f07-bcbc-6b1e8ab255e4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:09.862253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 360/715] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Aug 19 20:54:09 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:10.014467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ce1ee-13a4-4f07-bcbc-6b1e8ab255e4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:10.093712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:10.103179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414f3ea-5957-453b-9abc-bef3d245b398 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:10.181603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6704044-78d8-42be-8bb6-3a74ac55d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:10.182257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6704044-78d8-42be-8bb6-3a74ac55d9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:10.182492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6704044-78d8-42be-8bb6-3a74ac55d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:10.182782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6704044-78d8-42be-8bb6-3a74ac55d9a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:10.191393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6704044-78d8-42be-8bb6-3a74ac55d9a9 None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=83e51beb8d0e4219af906860ce906500) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:10.191822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6704044-78d8-42be-8bb6-3a74ac55d9a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:10.193319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6704044-78d8-42be-8bb6-3a74ac55d9a9 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:10.203076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 356/716] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:54:09 2022] GET /identity/v3/role_assignments?user.id=83e51beb8d0e4219af906860ce906500&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 259 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:10.268406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ce1ee-13a4-4f07-bcbc-6b1e8ab255e4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:10.350109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fe1d6-f62e-4790-a5cd-7ad25a8aa164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:10.351151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fe1d6-f62e-4790-a5cd-7ad25a8aa164 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:10.351633 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fe1d6-f62e-4790-a5cd-7ad25a8aa164 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:10.352129 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fe1d6-f62e-4790-a5cd-7ad25a8aa164 None admin] PATH_INFO: `/v3/services/network` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:10.353286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fe1d6-f62e-4790-a5cd-7ad25a8aa164 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:10.356268 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fe1d6-f62e-4790-a5cd-7ad25a8aa164 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-1b8fe1d6-f62e-4790-a5cd-7ad25a8aa164 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:10.380976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:10.382061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 20:54:10.383020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:10.384118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 361/717] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:10 2022] GET /identity/v3/services/network => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:10.390091 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6704044-78d8-42be-8bb6-3a74ac55d9a9 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:10.447090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:10.558127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6704044-78d8-42be-8bb6-3a74ac55d9a9 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:10.617281 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50a174-3469-4dde-83d1-bcbf1a569d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:10.617850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50a174-3469-4dde-83d1-bcbf1a569d6e None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:10.618139 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50a174-3469-4dde-83d1-bcbf1a569d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:10.618416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50a174-3469-4dde-83d1-bcbf1a569d6e None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:10.619124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50a174-3469-4dde-83d1-bcbf1a569d6e None admin] RBAC: Adding query filter params (name=network) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:10.619428 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50a174-3469-4dde-83d1-bcbf1a569d6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:10.620855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50a174-3469-4dde-83d1-bcbf1a569d6e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:10.631821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 357/718] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Aug 19 20:54:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:10.638364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fe1d6-f62e-4790-a5cd-7ad25a8aa164 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:10.839447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:10.863763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fe1d6-f62e-4790-a5cd-7ad25a8aa164 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:10.926178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea81864-6476-4a63-8cbf-a3eb50e47c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:10.926840 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81864-6476-4a63-8cbf-a3eb50e47c84 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:10.927130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81864-6476-4a63-8cbf-a3eb50e47c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:10.927407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81864-6476-4a63-8cbf-a3eb50e47c84 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:10.928063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea81864-6476-4a63-8cbf-a3eb50e47c84 None admin] RBAC: Adding query filter params (type=network) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:10.928370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea81864-6476-4a63-8cbf-a3eb50e47c84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:10.929764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea81864-6476-4a63-8cbf-a3eb50e47c84 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:10.940877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 362/719] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Aug 19 20:54:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:12.096879 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968dfa6-f5d2-486f-9f67-260220359e56 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:12.097674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968dfa6-f5d2-486f-9f67-260220359e56 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:12.097674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968dfa6-f5d2-486f-9f67-260220359e56 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:12.099169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 358/720] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:12.105100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cc9f3-e72f-41ce-9485-423858f96679 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:12.105924 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cc9f3-e72f-41ce-9485-423858f96679 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:12.105924 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cc9f3-e72f-41ce-9485-423858f96679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:12.126588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-322cc9f3-e72f-41ce-9485-423858f96679 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:12.127869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-322cc9f3-e72f-41ce-9485-423858f96679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:12.236904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 363/721] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 20:54:12.323683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd362fb-c83d-4112-a4d2-b088e7bc36d9 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:12.324329 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd362fb-c83d-4112-a4d2-b088e7bc36d9 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:12.325371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd362fb-c83d-4112-a4d2-b088e7bc36d9 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:12.327291 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 359/722] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:54:12.333279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820d928-a7f4-48a1-b362-28182af82628 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:12.333878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820d928-a7f4-48a1-b362-28182af82628 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:12.334386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820d928-a7f4-48a1-b362-28182af82628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:12.358902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1820d928-a7f4-48a1-b362-28182af82628 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:12.360508 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1820d928-a7f4-48a1-b362-28182af82628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:12.466313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 364/723] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:54:12.654795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd362fb-c83d-4112-a4d2-b088e7bc36d9 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:12.895669 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:12.943273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd362fb-c83d-4112-a4d2-b088e7bc36d9 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:13.039846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5480efc-43a0-4a04-81c4-3dd2e08a02fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:13.040953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5480efc-43a0-4a04-81c4-3dd2e08a02fe None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:13.041453 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5480efc-43a0-4a04-81c4-3dd2e08a02fe None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:13.041937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5480efc-43a0-4a04-81c4-3dd2e08a02fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:13.076626 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5480efc-43a0-4a04-81c4-3dd2e08a02fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-a5480efc-43a0-4a04-81c4-3dd2e08a02fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:13.088214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:13.090168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:13.091923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:13.091923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:13.091923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:13.091923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:13.091923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:13.091923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:13.091923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:13.091923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:13.091923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:13.091923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:13.091923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:54:13.091923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:13.095981 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 360/724] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:54:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:13.104145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820d928-a7f4-48a1-b362-28182af82628 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:13.112489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5480efc-43a0-4a04-81c4-3dd2e08a02fe None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:13.143292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:13.228112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5480efc-43a0-4a04-81c4-3dd2e08a02fe None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:13.267679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc7669-c105-4f00-a761-63aace8e59d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:13.268716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc7669-c105-4f00-a761-63aace8e59d1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:13.269211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc7669-c105-4f00-a761-63aace8e59d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:13.269694 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc7669-c105-4f00-a761-63aace8e59d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:13.281748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc7669-c105-4f00-a761-63aace8e59d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:13.284102 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820d928-a7f4-48a1-b362-28182af82628 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-91dc7669-c105-4f00-a761-63aace8e59d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:13.287308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:13.288290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:13.289235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:13.289235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:13.289235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:13.289235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:13.289235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:13.289235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:13.289235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:13.289235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:13.289235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:13.289235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:13.289235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:54:13.289235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:13.296987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 361/725] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:54:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:13.298804 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f364a-e9a2-4a06-9fd9-227d5ef9793f None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:13.299339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f364a-e9a2-4a06-9fd9-227d5ef9793f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:13.299847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f364a-e9a2-4a06-9fd9-227d5ef9793f None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:13.301770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 362/726] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:13.304683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f364a-e9a2-4a06-9fd9-227d5ef9793f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:13.318957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:13.330510 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7489d32-4e4a-499f-938a-10555d7471fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:13.333523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7489d32-4e4a-499f-938a-10555d7471fb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:13.334114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7489d32-4e4a-499f-938a-10555d7471fb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:13.334604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7489d32-4e4a-499f-938a-10555d7471fb None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:13.335595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7489d32-4e4a-499f-938a-10555d7471fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:13.336255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7489d32-4e4a-499f-938a-10555d7471fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:13.338024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7489d32-4e4a-499f-938a-10555d7471fb None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:13.353479 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 365/727] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:54:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:13.355471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df490f1-fb05-4361-bb11-94e29bd2a379 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:13.356567 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df490f1-fb05-4361-bb11-94e29bd2a379 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:13.357069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df490f1-fb05-4361-bb11-94e29bd2a379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:13.378317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1df490f1-fb05-4361-bb11-94e29bd2a379 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:13.380058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1df490f1-fb05-4361-bb11-94e29bd2a379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:13.439530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f364a-e9a2-4a06-9fd9-227d5ef9793f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:13.469997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 366/728] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:54:13.471485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df490f1-fb05-4361-bb11-94e29bd2a379 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:13.475677 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:13.501678 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b976d84-5696-49c2-9019-72e186a09584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:13.502434 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b976d84-5696-49c2-9019-72e186a09584 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:13.503082 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b976d84-5696-49c2-9019-72e186a09584 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:13.503653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b976d84-5696-49c2-9019-72e186a09584 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:13.504932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b976d84-5696-49c2-9019-72e186a09584 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:13.505819 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b976d84-5696-49c2-9019-72e186a09584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:13.508502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b976d84-5696-49c2-9019-72e186a09584 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:13.531016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 363/729] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:54:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:13.531016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b9768-6c16-47a8-9cbd-7bb3a5cb16c2 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:13.531016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b9768-6c16-47a8-9cbd-7bb3a5cb16c2 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:13.531016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b9768-6c16-47a8-9cbd-7bb3a5cb16c2 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:13.534431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 364/730] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:13.535982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b9768-6c16-47a8-9cbd-7bb3a5cb16c2 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:13.644055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:13.651586 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df490f1-fb05-4361-bb11-94e29bd2a379 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:13.704488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b9768-6c16-47a8-9cbd-7bb3a5cb16c2 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:13.706001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eb430-7a87-4811-a8eb-88fc068b9f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:13.707526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eb430-7a87-4811-a8eb-88fc068b9f77 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:13.708229 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eb430-7a87-4811-a8eb-88fc068b9f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:13.708847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eb430-7a87-4811-a8eb-88fc068b9f77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:13.725142 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eb430-7a87-4811-a8eb-88fc068b9f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:13.727892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eb430-7a87-4811-a8eb-88fc068b9f77 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:13.751025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f4abe-210b-4738-b572-0ca25c15ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:13.751603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f4abe-210b-4738-b572-0ca25c15ced2 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:13.751934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f4abe-210b-4738-b572-0ca25c15ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:13.752151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f4abe-210b-4738-b572-0ca25c15ced2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-5e0eb430-7a87-4811-a8eb-88fc068b9f77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:13.759417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:13.760694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:13.762305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:13.762305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:13.762305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:13.764630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f4abe-210b-4738-b572-0ca25c15ced2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:13.768696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f4abe-210b-4738-b572-0ca25c15ced2 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:13.772189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 367/731] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:13.774063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447a57-1233-4f01-9a68-5e49e4046103 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:13.774395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447a57-1233-4f01-9a68-5e49e4046103 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:13.774677 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447a57-1233-4f01-9a68-5e49e4046103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-094f4abe-210b-4738-b572-0ca25c15ced2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:13.788229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:13.789713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:13.790775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:13.790775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:13.790775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:13.791446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 365/732] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:13.792303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f4abe-210b-4738-b572-0ca25c15ced2 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:13.797545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-62447a57-1233-4f01-9a68-5e49e4046103 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:13.799857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-62447a57-1233-4f01-9a68-5e49e4046103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:13.888014 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:13.915629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 368/733] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:54:13.917364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62447a57-1233-4f01-9a68-5e49e4046103 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:13.978688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f4abe-210b-4738-b572-0ca25c15ced2 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:14.017976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:14.039827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761cdf7-8c86-4a9b-bd06-383f74e9cac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:14.040547 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761cdf7-8c86-4a9b-bd06-383f74e9cac1 None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:14.040836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761cdf7-8c86-4a9b-bd06-383f74e9cac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:14.041296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761cdf7-8c86-4a9b-bd06-383f74e9cac1 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:14.042353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761cdf7-8c86-4a9b-bd06-383f74e9cac1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:14.046184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761cdf7-8c86-4a9b-bd06-383f74e9cac1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:14.079167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 366/734] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:54:13 2022] POST /identity/v3/services => generated 251 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:54:14.084442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761cdf7-8c86-4a9b-bd06-383f74e9cac1 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:14.184570 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62447a57-1233-4f01-9a68-5e49e4046103 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:14.254070 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258f45a-ef9c-4ff4-a018-7981600cc82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:14.255411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258f45a-ef9c-4ff4-a018-7981600cc82c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:14.256274 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258f45a-ef9c-4ff4-a018-7981600cc82c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:14.256781 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258f45a-ef9c-4ff4-a018-7981600cc82c None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:14.257758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258f45a-ef9c-4ff4-a018-7981600cc82c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:14.258321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258f45a-ef9c-4ff4-a018-7981600cc82c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:14.260971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258f45a-ef9c-4ff4-a018-7981600cc82c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:14.288333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 369/735] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:14.288333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258f45a-ef9c-4ff4-a018-7981600cc82c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:14.321704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761cdf7-8c86-4a9b-bd06-383f74e9cac1 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:14.352495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:14.395211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a658-7833-4323-929d-c0ef71efeab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:14.395853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a658-7833-4323-929d-c0ef71efeab6 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:14.396149 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a658-7833-4323-929d-c0ef71efeab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:14.396427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a658-7833-4323-929d-c0ef71efeab6 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:14.397109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a658-7833-4323-929d-c0ef71efeab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:14.397417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a658-7833-4323-929d-c0ef71efeab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:14.399274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a658-7833-4323-929d-c0ef71efeab6 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:14.413951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 367/736] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:14.419448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3053d8-e68b-45da-89c6-5a06e382e48a None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:14.419448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3053d8-e68b-45da-89c6-5a06e382e48a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:14.419448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3053d8-e68b-45da-89c6-5a06e382e48a None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:14.419448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 368/737] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:14.419448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3053d8-e68b-45da-89c6-5a06e382e48a None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:14.468426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258f45a-ef9c-4ff4-a018-7981600cc82c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:14.471960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:14.535196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b09b5b-e353-489d-a1da-067e3e5265ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:14.536324 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b09b5b-e353-489d-a1da-067e3e5265ce None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:14.536837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b09b5b-e353-489d-a1da-067e3e5265ce None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:14.537331 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b09b5b-e353-489d-a1da-067e3e5265ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:14.549957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3053d8-e68b-45da-89c6-5a06e382e48a None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:14.558569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b09b5b-e353-489d-a1da-067e3e5265ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-62b09b5b-e353-489d-a1da-067e3e5265ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:14.568986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:14.571020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 370/738] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:54:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:14.573361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b09b5b-e353-489d-a1da-067e3e5265ce None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:14.602109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a09e66-d50f-4863-89f3-a2347d7381be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:14.602797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09e66-d50f-4863-89f3-a2347d7381be None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:14.603086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09e66-d50f-4863-89f3-a2347d7381be None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:14.603362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09e66-d50f-4863-89f3-a2347d7381be None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:14.614072 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a09e66-d50f-4863-89f3-a2347d7381be None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:14.615630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a09e66-d50f-4863-89f3-a2347d7381be None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-37a09e66-d50f-4863-89f3-a2347d7381be None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:14.630069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:14.632652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:14.634618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:14.634618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:14.634618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:14.634618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:14.634618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:14.634618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:14.634618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:14.634618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:14.634618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 20:54:14.634618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:14.634618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 369/739] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Aug 19 20:54:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:14.634618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84511d-dc9f-464f-8fc2-46fea75a9ce5 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:14.634618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84511d-dc9f-464f-8fc2-46fea75a9ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:14.638710 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84511d-dc9f-464f-8fc2-46fea75a9ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:14.655673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7c84511d-dc9f-464f-8fc2-46fea75a9ce5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:14.657681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7c84511d-dc9f-464f-8fc2-46fea75a9ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:14.763330 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:14.768889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b09b5b-e353-489d-a1da-067e3e5265ce None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:14.783589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 370/740] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 20:54:14.785478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84511d-dc9f-464f-8fc2-46fea75a9ce5 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:14.833597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f6a3a-2127-46b9-bdd0-44d7e84717c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:14.835131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f6a3a-2127-46b9-bdd0-44d7e84717c2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:14.835933 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f6a3a-2127-46b9-bdd0-44d7e84717c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:14.836522 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f6a3a-2127-46b9-bdd0-44d7e84717c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:14.851622 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f6a3a-2127-46b9-bdd0-44d7e84717c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:14.853353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:14.853469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f6a3a-2127-46b9-bdd0-44d7e84717c2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-6c8f6a3a-2127-46b9-bdd0-44d7e84717c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:14.875950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:14.877753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:14.880772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:14.880772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:14.880772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:14.880772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:14.880772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:14.880772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:14.880772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:14.880772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:14.880772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 20:54:14.880772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:14.885715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 371/741] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:54:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:14.887513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f6a3a-2127-46b9-bdd0-44d7e84717c2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:15.023292 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84511d-dc9f-464f-8fc2-46fea75a9ce5 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:15.078376 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f6a3a-2127-46b9-bdd0-44d7e84717c2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:15.080020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db19a47-ce5a-41b1-b592-c94780193c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:15.081069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db19a47-ce5a-41b1-b592-c94780193c8a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:15.082199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db19a47-ce5a-41b1-b592-c94780193c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:15.084146 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db19a47-ce5a-41b1-b592-c94780193c8a None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:15.085204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db19a47-ce5a-41b1-b592-c94780193c8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:15.085721 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db19a47-ce5a-41b1-b592-c94780193c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:15.087695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db19a47-ce5a-41b1-b592-c94780193c8a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:15.101507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 371/742] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:54:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:15.102934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db19a47-ce5a-41b1-b592-c94780193c8a None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:15.145585 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f7cc0-ffbf-4c32-8e1e-34496fef7912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:15.146785 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f7cc0-ffbf-4c32-8e1e-34496fef7912 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:15.147414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f7cc0-ffbf-4c32-8e1e-34496fef7912 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:15.147795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f7cc0-ffbf-4c32-8e1e-34496fef7912 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:15.148660 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f7cc0-ffbf-4c32-8e1e-34496fef7912 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:15.149059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f7cc0-ffbf-4c32-8e1e-34496fef7912 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:15.150948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f7cc0-ffbf-4c32-8e1e-34496fef7912 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:15.173148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 372/743] 10.222.0.17 () {56 vars in 1149 bytes} [Fri Aug 19 20:54:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:15.174257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f7cc0-ffbf-4c32-8e1e-34496fef7912 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:15.196875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:15.254683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:15.273376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db19a47-ce5a-41b1-b592-c94780193c8a None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:15.335903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8fb02-7e06-4b20-b969-b726671cc571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:15.336871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8fb02-7e06-4b20-b969-b726671cc571 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:15.336871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8fb02-7e06-4b20-b969-b726671cc571 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:15.337163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8fb02-7e06-4b20-b969-b726671cc571 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:15.337793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8fb02-7e06-4b20-b969-b726671cc571 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:15.338101 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8fb02-7e06-4b20-b969-b726671cc571 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:15.339604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8fb02-7e06-4b20-b969-b726671cc571 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:15.348150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f7cc0-ffbf-4c32-8e1e-34496fef7912 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:15.368964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 372/744] 10.222.0.17 () {56 vars in 1135 bytes} [Fri Aug 19 20:54:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:15.368964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8fb02-7e06-4b20-b969-b726671cc571 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:15.404113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed139cf-a605-4aca-b506-a300380b3f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:15.404949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed139cf-a605-4aca-b506-a300380b3f47 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:15.405312 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed139cf-a605-4aca-b506-a300380b3f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:15.405586 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed139cf-a605-4aca-b506-a300380b3f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:15.419013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed139cf-a605-4aca-b506-a300380b3f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:15.420502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed139cf-a605-4aca-b506-a300380b3f47 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-5ed139cf-a605-4aca-b506-a300380b3f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:15.438625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:15.440676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:15.443022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:15.443022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:15.443022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:15.443022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 373/745] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:15.443022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed139cf-a605-4aca-b506-a300380b3f47 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:15.531878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:15.573449 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed139cf-a605-4aca-b506-a300380b3f47 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:15.575665 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8fb02-7e06-4b20-b969-b726671cc571 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:15.616887 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7657c6f-2e71-4d1c-bb8c-d86dbcbf95a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:15.617421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7657c6f-2e71-4d1c-bb8c-d86dbcbf95a5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:15.617701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7657c6f-2e71-4d1c-bb8c-d86dbcbf95a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:15.617972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7657c6f-2e71-4d1c-bb8c-d86dbcbf95a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:15.708260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7657c6f-2e71-4d1c-bb8c-d86dbcbf95a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:15.709773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7657c6f-2e71-4d1c-bb8c-d86dbcbf95a5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:15.811125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32787c86-4762-4e41-b2df-e75de4ee655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:15.812649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787c86-4762-4e41-b2df-e75de4ee655f None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:15.813156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787c86-4762-4e41-b2df-e75de4ee655f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:15.813654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787c86-4762-4e41-b2df-e75de4ee655f None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:15.814918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32787c86-4762-4e41-b2df-e75de4ee655f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:15.816997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:15.817576 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32787c86-4762-4e41-b2df-e75de4ee655f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:15.846944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 373/746] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:54:15 2022] POST /identity/v3/services => generated 240 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:54:15.846944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32787c86-4762-4e41-b2df-e75de4ee655f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:15.891158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:15.901686 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 374/747] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:54:15 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 20:54:15.904113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7657c6f-2e71-4d1c-bb8c-d86dbcbf95a5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:16.077234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7657c6f-2e71-4d1c-bb8c-d86dbcbf95a5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:16.083315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32787c86-4762-4e41-b2df-e75de4ee655f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:16.122073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4168e5-0112-4004-8ff2-671c3dd7a64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:16.122706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4168e5-0112-4004-8ff2-671c3dd7a64b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:16.123033 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4168e5-0112-4004-8ff2-671c3dd7a64b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:16.123311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4168e5-0112-4004-8ff2-671c3dd7a64b None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:16.124095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4168e5-0112-4004-8ff2-671c3dd7a64b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:16.124406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4168e5-0112-4004-8ff2-671c3dd7a64b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:16.125927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4168e5-0112-4004-8ff2-671c3dd7a64b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:16.130979 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae09fe-74a5-42f0-af23-7004c767ce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:16.131617 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae09fe-74a5-42f0-af23-7004c767ce49 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:16.131900 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae09fe-74a5-42f0-af23-7004c767ce49 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:16.132247 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae09fe-74a5-42f0-af23-7004c767ce49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:16.144826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 375/748] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:16.145598 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4168e5-0112-4004-8ff2-671c3dd7a64b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:16.191121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:16.223797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae09fe-74a5-42f0-af23-7004c767ce49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:16.225256 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae09fe-74a5-42f0-af23-7004c767ce49 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:16.234358 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:16.295118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4168e5-0112-4004-8ff2-671c3dd7a64b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:16.341766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad948f-f95f-415a-82a7-c1630cc7e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:16.342692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad948f-f95f-415a-82a7-c1630cc7e76d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:16.343168 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad948f-f95f-415a-82a7-c1630cc7e76d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:16.343731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad948f-f95f-415a-82a7-c1630cc7e76d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:16.356993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad948f-f95f-415a-82a7-c1630cc7e76d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:16.358726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad948f-f95f-415a-82a7-c1630cc7e76d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:16.360450 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 374/749] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:54:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:54:16.361726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae09fe-74a5-42f0-af23-7004c767ce49 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-90ad948f-f95f-415a-82a7-c1630cc7e76d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:16.378468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:16.379635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:16.380826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:16.380826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:16.380826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:16.382696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 376/750] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:16.383953 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad948f-f95f-415a-82a7-c1630cc7e76d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:16.488764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:16.507206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae09fe-74a5-42f0-af23-7004c767ce49 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:16.511528 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad948f-f95f-415a-82a7-c1630cc7e76d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:16.518797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:16.551299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc937420-e5a4-4bde-9323-7d5027abfa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:16.551972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc937420-e5a4-4bde-9323-7d5027abfa3c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:16.552226 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc937420-e5a4-4bde-9323-7d5027abfa3c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:16.552503 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc937420-e5a4-4bde-9323-7d5027abfa3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:16.565578 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc937420-e5a4-4bde-9323-7d5027abfa3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:16.567082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc937420-e5a4-4bde-9323-7d5027abfa3c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:16.568420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfef895-c7e2-499b-a235-cf0594512c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:16.569461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfef895-c7e2-499b-a235-cf0594512c66 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:16.569957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfef895-c7e2-499b-a235-cf0594512c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:16.570414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfef895-c7e2-499b-a235-cf0594512c66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-dc937420-e5a4-4bde-9323-7d5027abfa3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:16.583714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:16.584774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:16.585667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:16.585667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:16.585667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:16.585836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfef895-c7e2-499b-a235-cf0594512c66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:16.587178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 377/751] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:16.587849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfef895-c7e2-499b-a235-cf0594512c66 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:16.588291 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc937420-e5a4-4bde-9323-7d5027abfa3c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-ccfef895-c7e2-499b-a235-cf0594512c66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:16.605993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:16.607955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:16.609814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:16.609814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:16.609814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:16.609814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:16.609814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:16.609814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:16.609814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:16.609814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:16.609814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:54:16.609814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:16.614941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 375/752] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Aug 19 20:54:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:16.616618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df894e4a-c106-4aea-9cc1-c01e4bfe42c2 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:16.616982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df894e4a-c106-4aea-9cc1-c01e4bfe42c2 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:16.617322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df894e4a-c106-4aea-9cc1-c01e4bfe42c2 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:16.621846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 376/753] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:16.621846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df894e4a-c106-4aea-9cc1-c01e4bfe42c2 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:16.761266 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc937420-e5a4-4bde-9323-7d5027abfa3c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:16.798676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df894e4a-c106-4aea-9cc1-c01e4bfe42c2 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:16.812914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36411afc-6c1b-4a57-b976-3caddeb85262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:16.813629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36411afc-6c1b-4a57-b976-3caddeb85262 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:16.813941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36411afc-6c1b-4a57-b976-3caddeb85262 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:16.814218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36411afc-6c1b-4a57-b976-3caddeb85262 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:16.814918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36411afc-6c1b-4a57-b976-3caddeb85262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:16.815222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36411afc-6c1b-4a57-b976-3caddeb85262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:16.816787 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36411afc-6c1b-4a57-b976-3caddeb85262 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:16.818627 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:16.838656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 378/754] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:16.839874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36411afc-6c1b-4a57-b976-3caddeb85262 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:16.862640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4ae02-bfad-43ff-95da-53fd439ed2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:16.863852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4ae02-bfad-43ff-95da-53fd439ed2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:16.864427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4ae02-bfad-43ff-95da-53fd439ed2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:16.864969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4ae02-bfad-43ff-95da-53fd439ed2e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:16.866445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4ae02-bfad-43ff-95da-53fd439ed2e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:16.866826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4ae02-bfad-43ff-95da-53fd439ed2e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:16.869159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4ae02-bfad-43ff-95da-53fd439ed2e6 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:16.889147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 377/755] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:16.891379 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a3314-73c0-40f3-9df2-ea965f4d07d4 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:16.891876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a3314-73c0-40f3-9df2-ea965f4d07d4 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:16.892369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a3314-73c0-40f3-9df2-ea965f4d07d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:16.917133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-691a3314-73c0-40f3-9df2-ea965f4d07d4 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:16.918605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-691a3314-73c0-40f3-9df2-ea965f4d07d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:16.953699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:17.009224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36411afc-6c1b-4a57-b976-3caddeb85262 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:17.042927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 378/756] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:17.044137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a3314-73c0-40f3-9df2-ea965f4d07d4 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:17.078392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e543f4-e9d6-4f6d-b641-e71747c8064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:17.080001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e543f4-e9d6-4f6d-b641-e71747c8064c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:17.080713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e543f4-e9d6-4f6d-b641-e71747c8064c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:17.081497 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e543f4-e9d6-4f6d-b641-e71747c8064c None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:17.083117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e543f4-e9d6-4f6d-b641-e71747c8064c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:17.083942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e543f4-e9d6-4f6d-b641-e71747c8064c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:17.087100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e543f4-e9d6-4f6d-b641-e71747c8064c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:17.125381 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 379/757] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Aug 19 20:54:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:17.127626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e543f4-e9d6-4f6d-b641-e71747c8064c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:17.234042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:17.249564 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a3314-73c0-40f3-9df2-ea965f4d07d4 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:17.302470 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e543f4-e9d6-4f6d-b641-e71747c8064c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:17.319121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb228d2-bea6-4325-a65c-386b752ee0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:17.320952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb228d2-bea6-4325-a65c-386b752ee0aa None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:17.321720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb228d2-bea6-4325-a65c-386b752ee0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:17.322433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb228d2-bea6-4325-a65c-386b752ee0aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:17.335734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb228d2-bea6-4325-a65c-386b752ee0aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:17.339168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb228d2-bea6-4325-a65c-386b752ee0aa None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:17.345251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f6190-818c-44b4-bb02-34f29b21957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:17.345914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f6190-818c-44b4-bb02-34f29b21957d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:17.346199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f6190-818c-44b4-bb02-34f29b21957d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:17.346472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f6190-818c-44b4-bb02-34f29b21957d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:17.354573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f6190-818c-44b4-bb02-34f29b21957d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:17.356150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f6190-818c-44b4-bb02-34f29b21957d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-1bb228d2-bea6-4325-a65c-386b752ee0aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:17.363436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:17.365337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:17.366904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:17.366904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:17.366904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:17.366904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:17.366904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:17.366904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:17.366904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:17.366904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f80f6190-818c-44b4-bb02-34f29b21957d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:17.368655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:17.376844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:17.380007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:17.380007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:17.380007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:17.380007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:17.380007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:17.380007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:17.380007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:17.380007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:17.380007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 380/758] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:17.380007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f6190-818c-44b4-bb02-34f29b21957d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:17.388405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 379/759] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:17.390506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb228d2-bea6-4325-a65c-386b752ee0aa None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:17.427260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:17.503111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f6190-818c-44b4-bb02-34f29b21957d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:17.520386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:17.550825 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ecea7-e39f-4a25-8ac5-a492f3c07186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:17.551581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ecea7-e39f-4a25-8ac5-a492f3c07186 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:17.551927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ecea7-e39f-4a25-8ac5-a492f3c07186 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:17.552286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ecea7-e39f-4a25-8ac5-a492f3c07186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:17.555045 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb228d2-bea6-4325-a65c-386b752ee0aa None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:17.566286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ecea7-e39f-4a25-8ac5-a492f3c07186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:17.567797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ecea7-e39f-4a25-8ac5-a492f3c07186 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f55ecea7-e39f-4a25-8ac5-a492f3c07186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:17.592864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:17.593913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:17.594899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:17.594899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:17.594899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:17.597182 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e944a00-642c-4ac2-b30c-c5b49098f425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:17.597808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e944a00-642c-4ac2-b30c-c5b49098f425 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:17.598091 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e944a00-642c-4ac2-b30c-c5b49098f425 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:17.598423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e944a00-642c-4ac2-b30c-c5b49098f425 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:17.599178 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e944a00-642c-4ac2-b30c-c5b49098f425 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:17.599487 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e944a00-642c-4ac2-b30c-c5b49098f425 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:17.600927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e944a00-642c-4ac2-b30c-c5b49098f425 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:17.602925 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 381/760] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:17.604261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ecea7-e39f-4a25-8ac5-a492f3c07186 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:17.620940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 380/761] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:17.620940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e944a00-642c-4ac2-b30c-c5b49098f425 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:17.722420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:17.758556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e944a00-642c-4ac2-b30c-c5b49098f425 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:17.768978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ecea7-e39f-4a25-8ac5-a492f3c07186 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:17.799208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef6555-9567-431d-a9d1-27d9c6e603e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:17.800136 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef6555-9567-431d-a9d1-27d9c6e603e4 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:17.800793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef6555-9567-431d-a9d1-27d9c6e603e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:17.801080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef6555-9567-431d-a9d1-27d9c6e603e4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:17.801843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef6555-9567-431d-a9d1-27d9c6e603e4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:17.803262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef6555-9567-431d-a9d1-27d9c6e603e4 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-e8ef6555-9567-431d-a9d1-27d9c6e603e4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:17.813860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:17.814954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:17.815790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 381/762] 10.222.0.17 () {56 vars in 1129 bytes} [Fri Aug 19 20:54:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:17.816615 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef6555-9567-431d-a9d1-27d9c6e603e4 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:17.819688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f18411-f19c-4d81-b01d-0da2256e4fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:17.820426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18411-f19c-4d81-b01d-0da2256e4fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:17.820807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18411-f19c-4d81-b01d-0da2256e4fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:17.821160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18411-f19c-4d81-b01d-0da2256e4fc7 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:17.821950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f18411-f19c-4d81-b01d-0da2256e4fc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:17.822330 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f18411-f19c-4d81-b01d-0da2256e4fc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:17.824260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f18411-f19c-4d81-b01d-0da2256e4fc7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:17.838801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 382/763] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:17.839215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f18411-f19c-4d81-b01d-0da2256e4fc7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:17.871897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:17.960395 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef6555-9567-431d-a9d1-27d9c6e603e4 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:17.962578 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f18411-f19c-4d81-b01d-0da2256e4fc7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:18.001457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d5df2-cce4-4c5f-832e-dc5576b1c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:18.002123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d5df2-cce4-4c5f-832e-dc5576b1c08e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:18.002406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d5df2-cce4-4c5f-832e-dc5576b1c08e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:18.002759 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d5df2-cce4-4c5f-832e-dc5576b1c08e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:18.003618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d5df2-cce4-4c5f-832e-dc5576b1c08e None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=6fbfc93e45704b3ba2e5a4bcf7568a14) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:18.003932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d5df2-cce4-4c5f-832e-dc5576b1c08e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:18.005393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d5df2-cce4-4c5f-832e-dc5576b1c08e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:18.022832 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 383/764] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:54:17 2022] GET /identity/v3/role_assignments?user.id=6fbfc93e45704b3ba2e5a4bcf7568a14&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:18.022832 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d5df2-cce4-4c5f-832e-dc5576b1c08e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:18.031635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf55034-aa41-49f4-9f63-e628d3c707af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:18.032747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf55034-aa41-49f4-9f63-e628d3c707af None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:18.033278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf55034-aa41-49f4-9f63-e628d3c707af None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:18.033809 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf55034-aa41-49f4-9f63-e628d3c707af None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:18.035052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf55034-aa41-49f4-9f63-e628d3c707af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:18.035633 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf55034-aa41-49f4-9f63-e628d3c707af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:18.037791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf55034-aa41-49f4-9f63-e628d3c707af None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:18.056223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:18.069478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 382/765] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:18.071049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf55034-aa41-49f4-9f63-e628d3c707af None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:18.221177 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:18.247840 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d5df2-cce4-4c5f-832e-dc5576b1c08e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:18.279170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf55034-aa41-49f4-9f63-e628d3c707af None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:18.308911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5046b3-2f02-4900-a835-badf5c7a5461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:18.310566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5046b3-2f02-4900-a835-badf5c7a5461 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:18.311339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5046b3-2f02-4900-a835-badf5c7a5461 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:18.311847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5046b3-2f02-4900-a835-badf5c7a5461 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:18.313047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5046b3-2f02-4900-a835-badf5c7a5461 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:18.314136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5046b3-2f02-4900-a835-badf5c7a5461 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:18.316300 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5046b3-2f02-4900-a835-badf5c7a5461 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:18.331174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 384/766] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Aug 19 20:54:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:18.332885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5046b3-2f02-4900-a835-badf5c7a5461 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:18.353996 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f4348-2635-48d5-8e24-bed41cf4c42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:18.356806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f4348-2635-48d5-8e24-bed41cf4c42e None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:18.357500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f4348-2635-48d5-8e24-bed41cf4c42e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:18.358203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f4348-2635-48d5-8e24-bed41cf4c42e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:18.360252 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f4348-2635-48d5-8e24-bed41cf4c42e None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=b9f8b86c01084a09bb8eac50eddfa0a1) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:18.360983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f4348-2635-48d5-8e24-bed41cf4c42e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:18.364506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f4348-2635-48d5-8e24-bed41cf4c42e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:18.385208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 383/767] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:54:18 2022] GET /identity/v3/role_assignments?user.id=b9f8b86c01084a09bb8eac50eddfa0a1&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:18.385208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f4348-2635-48d5-8e24-bed41cf4c42e None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:18.553466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:18.593455 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f4348-2635-48d5-8e24-bed41cf4c42e None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:18.642155 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ed4e7-8e90-4c8e-a7ce-eb905890c66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:18.644974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5046b3-2f02-4900-a835-badf5c7a5461 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:18.645667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ed4e7-8e90-4c8e-a7ce-eb905890c66e None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:18.646179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ed4e7-8e90-4c8e-a7ce-eb905890c66e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:18.646671 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ed4e7-8e90-4c8e-a7ce-eb905890c66e None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:18.647573 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ed4e7-8e90-4c8e-a7ce-eb905890c66e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:18.649936 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ed4e7-8e90-4c8e-a7ce-eb905890c66e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:18.651694 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ed4e7-8e90-4c8e-a7ce-eb905890c66e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:18.668249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 384/768] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Aug 19 20:54:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:18.679857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ed4e7-8e90-4c8e-a7ce-eb905890c66e None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:18.723525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095e1a5-5087-4b29-815b-dcebbe261486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:18.733944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e1a5-5087-4b29-815b-dcebbe261486 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:18.733944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e1a5-5087-4b29-815b-dcebbe261486 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:18.733944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e1a5-5087-4b29-815b-dcebbe261486 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:18.757291 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095e1a5-5087-4b29-815b-dcebbe261486 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:18.759299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095e1a5-5087-4b29-815b-dcebbe261486 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-3095e1a5-5087-4b29-815b-dcebbe261486 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:18.806766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:18.807909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:18.808869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:18.808869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:18.808869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:18.808869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:18.808869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:18.808869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:18.808869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:18.808869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:18.809700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 385/769] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 472 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:18.819094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095e1a5-5087-4b29-815b-dcebbe261486 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:18.862452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:18.875440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ed4e7-8e90-4c8e-a7ce-eb905890c66e None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:18.930722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:18.942387 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a2d9d-6dcd-4f4c-95dd-9d45dc8d3ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:18.943746 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a2d9d-6dcd-4f4c-95dd-9d45dc8d3ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:18.944034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a2d9d-6dcd-4f4c-95dd-9d45dc8d3ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:18.944610 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a2d9d-6dcd-4f4c-95dd-9d45dc8d3ab5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:18.945499 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a2d9d-6dcd-4f4c-95dd-9d45dc8d3ab5 None admin] RBAC: Adding query filter params (interface=public, service_id=06cc8e8de56c49c6a872a2d22abfd255, region_id=RegionOne) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:18.946088 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a2d9d-6dcd-4f4c-95dd-9d45dc8d3ab5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:18.948501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a2d9d-6dcd-4f4c-95dd-9d45dc8d3ab5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:18.959982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 385/770] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Aug 19 20:54:18 2022] GET /identity/v3/endpoints?service_id=06cc8e8de56c49c6a872a2d22abfd255&interface=public®ion_id=RegionOne => generated 194 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:18.961956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f96d-af42-4af8-b7a0-47ae94cd832a None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:18.962516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f96d-af42-4af8-b7a0-47ae94cd832a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:18.962837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f96d-af42-4af8-b7a0-47ae94cd832a None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:18.965879 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 386/771] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:18.972468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25f96d-af42-4af8-b7a0-47ae94cd832a None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:18.991385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095e1a5-5087-4b29-815b-dcebbe261486 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:19.036038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d36fd-21e7-4ab0-94f0-14e9c3eb4fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:19.036659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d36fd-21e7-4ab0-94f0-14e9c3eb4fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:19.036946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d36fd-21e7-4ab0-94f0-14e9c3eb4fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:19.037530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d36fd-21e7-4ab0-94f0-14e9c3eb4fd0 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:19.038245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d36fd-21e7-4ab0-94f0-14e9c3eb4fd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:19.038590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d36fd-21e7-4ab0-94f0-14e9c3eb4fd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:19.041181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d36fd-21e7-4ab0-94f0-14e9c3eb4fd0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:19.057658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 386/772] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:19.059053 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7d163-546b-4f64-a1e0-cb4e114f09f1 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:19.059372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7d163-546b-4f64-a1e0-cb4e114f09f1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:19.060186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7d163-546b-4f64-a1e0-cb4e114f09f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:19.084457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f7d7d163-546b-4f64-a1e0-cb4e114f09f1 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:19.086549 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f7d7d163-546b-4f64-a1e0-cb4e114f09f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:19.134687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25f96d-af42-4af8-b7a0-47ae94cd832a None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:19.175272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af6b78-70a6-4db6-8d31-c03476f8e2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:19.176057 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af6b78-70a6-4db6-8d31-c03476f8e2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:19.176413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af6b78-70a6-4db6-8d31-c03476f8e2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:19.176756 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af6b78-70a6-4db6-8d31-c03476f8e2e9 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:19.177447 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af6b78-70a6-4db6-8d31-c03476f8e2e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:19.178978 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af6b78-70a6-4db6-8d31-c03476f8e2e9 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:19.185963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 387/773] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Aug 19 20:54:18 2022] GET /identity/v3/services => generated 772 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:19.186986 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af6b78-70a6-4db6-8d31-c03476f8e2e9 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:19.190256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 387/774] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:19.261242 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:19.315640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af6b78-70a6-4db6-8d31-c03476f8e2e9 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:19.356676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4631d4-8b78-414e-b0c3-e408587899fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:19.357611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4631d4-8b78-414e-b0c3-e408587899fb None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:19.357903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4631d4-8b78-414e-b0c3-e408587899fb None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:19.358175 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4631d4-8b78-414e-b0c3-e408587899fb None admin] PATH_INFO: `/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/83e51beb8d0e4219af906860ce906500/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:19.360290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4631d4-8b78-414e-b0c3-e408587899fb None admin] RBAC: Authorizing `identity:create_grant(project_id=d1defe14eddd4b28ac969adb3d504c7a, user_id=83e51beb8d0e4219af906860ce906500, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:19.361773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4631d4-8b78-414e-b0c3-e408587899fb None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:19.386573 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 388/775] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:54:19 2022] PUT /identity/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/83e51beb8d0e4219af906860ce906500/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:54:19.620361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7d163-546b-4f64-a1e0-cb4e114f09f1 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:19.623686 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:19.765609 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7d163-546b-4f64-a1e0-cb4e114f09f1 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:19.833953 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bcf3f-8320-4392-99a6-7ef869010dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:19.835452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bcf3f-8320-4392-99a6-7ef869010dde None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:19.836182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bcf3f-8320-4392-99a6-7ef869010dde None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:19.836917 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bcf3f-8320-4392-99a6-7ef869010dde None admin] PATH_INFO: `/v3/services/network` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:19.838246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bcf3f-8320-4392-99a6-7ef869010dde None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:19.842456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bcf3f-8320-4392-99a6-7ef869010dde None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-5e3bcf3f-8320-4392-99a6-7ef869010dde None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:19.863130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:19.865440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 20:54:19.867408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:19.872115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 388/776] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:19 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:19.882683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4631d4-8b78-414e-b0c3-e408587899fb None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:20.094657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4631d4-8b78-414e-b0c3-e408587899fb None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:20.128064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:20.169353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8521c-af8d-4536-b297-8ecda6f424e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:20.170402 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8521c-af8d-4536-b297-8ecda6f424e1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:20.170926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8521c-af8d-4536-b297-8ecda6f424e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:20.171401 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8521c-af8d-4536-b297-8ecda6f424e1 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:20.172623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8521c-af8d-4536-b297-8ecda6f424e1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:20.173145 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8521c-af8d-4536-b297-8ecda6f424e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:20.175820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8521c-af8d-4536-b297-8ecda6f424e1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:20.190580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 389/777] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Aug 19 20:54:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:20.197125 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bcf3f-8320-4392-99a6-7ef869010dde None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:20.367225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:20.445739 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bcf3f-8320-4392-99a6-7ef869010dde None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:20.510629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c868b-1c4b-469f-95be-d58181a0513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:20.511778 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c868b-1c4b-469f-95be-d58181a0513a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:20.513426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c868b-1c4b-469f-95be-d58181a0513a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:20.513919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c868b-1c4b-469f-95be-d58181a0513a None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:20.515118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c868b-1c4b-469f-95be-d58181a0513a None admin] RBAC: Adding query filter params (type=network) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:20.515661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c868b-1c4b-469f-95be-d58181a0513a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:20.518230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c868b-1c4b-469f-95be-d58181a0513a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:20.528923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 389/778] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Aug 19 20:54:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:20.538352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8521c-af8d-4536-b297-8ecda6f424e1 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:20.790614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8521c-af8d-4536-b297-8ecda6f424e1 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:20.887709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d850c8-bfae-4b87-976e-e5c607bf2c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:20.888786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d850c8-bfae-4b87-976e-e5c607bf2c00 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:20.889286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d850c8-bfae-4b87-976e-e5c607bf2c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:20.889785 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d850c8-bfae-4b87-976e-e5c607bf2c00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:20.891162 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d850c8-bfae-4b87-976e-e5c607bf2c00 None admin] RBAC: Adding query filter params (interface=public, service_id=c840c06b7ac740b59c3eea6a30a65927, region_id=RegionOne) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:20.891723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d850c8-bfae-4b87-976e-e5c607bf2c00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:20.894231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d850c8-bfae-4b87-976e-e5c607bf2c00 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:20.908482 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 390/779] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Aug 19 20:54:20 2022] GET /identity/v3/endpoints?service_id=c840c06b7ac740b59c3eea6a30a65927&interface=public®ion_id=RegionOne => generated 194 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:20.917410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c868b-1c4b-469f-95be-d58181a0513a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:21.154498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c868b-1c4b-469f-95be-d58181a0513a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:21.209762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:21.220570 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fb1d0-cf31-49d3-b3ff-abffca1a187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:21.221648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fb1d0-cf31-49d3-b3ff-abffca1a187a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:21.222141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fb1d0-cf31-49d3-b3ff-abffca1a187a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:21.222629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fb1d0-cf31-49d3-b3ff-abffca1a187a None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:21.223772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fb1d0-cf31-49d3-b3ff-abffca1a187a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:21.226305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fb1d0-cf31-49d3-b3ff-abffca1a187a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:21.237281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 390/780] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Aug 19 20:54:20 2022] GET /identity/v3/services => generated 772 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:21.578669 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec236ab5-c41f-4c42-bf1e-b401a0e198c4 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:21.579373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec236ab5-c41f-4c42-bf1e-b401a0e198c4 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:21.579639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec236ab5-c41f-4c42-bf1e-b401a0e198c4 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:21.582612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 391/781] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:21.592028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e2eaf-0fbc-4be5-afcd-0da7dee8f237 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:21.592513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e2eaf-0fbc-4be5-afcd-0da7dee8f237 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:21.593002 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e2eaf-0fbc-4be5-afcd-0da7dee8f237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:21.631203 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f18e2eaf-0fbc-4be5-afcd-0da7dee8f237 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:21.633185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f18e2eaf-0fbc-4be5-afcd-0da7dee8f237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:21.765035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 391/782] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:21.810222 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8461ef-31b4-4575-89a2-033e1f09af02 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:21.811038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8461ef-31b4-4575-89a2-033e1f09af02 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:21.811623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8461ef-31b4-4575-89a2-033e1f09af02 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:21.814316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 392/783] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:21.823348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355388d8-e69f-46bc-a3e8-0563615d3b0f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:21.823842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355388d8-e69f-46bc-a3e8-0563615d3b0f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:21.824433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355388d8-e69f-46bc-a3e8-0563615d3b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:21.858905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd2c4a-63bd-49d3-a9e8-5f36091f20a8 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:21.859855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd2c4a-63bd-49d3-a9e8-5f36091f20a8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:21.860626 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd2c4a-63bd-49d3-a9e8-5f36091f20a8 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:21.863926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 393/784] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:21.871127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-355388d8-e69f-46bc-a3e8-0563615d3b0f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:21.871127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-355388d8-e69f-46bc-a3e8-0563615d3b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:21.874398 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3890e2-1c3a-4cbe-9f32-2958548eaf46 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:21.875271 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3890e2-1c3a-4cbe-9f32-2958548eaf46 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:21.876042 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3890e2-1c3a-4cbe-9f32-2958548eaf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:21.934536 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-4b3890e2-1c3a-4cbe-9f32-2958548eaf46 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:21.937159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4b3890e2-1c3a-4cbe-9f32-2958548eaf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:22.018066 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 392/785] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:22.085568 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:22.157953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 394/786] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:22.419708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355388d8-e69f-46bc-a3e8-0563615d3b0f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:22.522257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:22.561546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3890e2-1c3a-4cbe-9f32-2958548eaf46 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:22.602715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355388d8-e69f-46bc-a3e8-0563615d3b0f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:22.670566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520832c-4ab3-4244-a79e-24fa40c1a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:22.671993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520832c-4ab3-4244-a79e-24fa40c1a563 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:22.672669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520832c-4ab3-4244-a79e-24fa40c1a563 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:22.673360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520832c-4ab3-4244-a79e-24fa40c1a563 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:22.700713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520832c-4ab3-4244-a79e-24fa40c1a563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-8520832c-4ab3-4244-a79e-24fa40c1a563 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:22.710710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:22.713032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:22.715267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:22.715267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:22.715267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:22.715267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:22.715267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:22.715267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:22.715267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:22.715267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:22.715267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:22.715267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:22.715267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:54:22.715267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:22.719636 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 393/787] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:54:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:22.729553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520832c-4ab3-4244-a79e-24fa40c1a563 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:22.900623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3890e2-1c3a-4cbe-9f32-2958548eaf46 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:22.918149 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520832c-4ab3-4244-a79e-24fa40c1a563 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:22.940250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de072c3f-4be0-41d0-bf4b-f371fa0baaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:22.941246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072c3f-4be0-41d0-bf4b-f371fa0baaee None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:22.941551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072c3f-4be0-41d0-bf4b-f371fa0baaee None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:22.941818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072c3f-4be0-41d0-bf4b-f371fa0baaee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:22.948269 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:22.955435 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de072c3f-4be0-41d0-bf4b-f371fa0baaee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-de072c3f-4be0-41d0-bf4b-f371fa0baaee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:22.960352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:22.962115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 395/788] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:54:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:22.963629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28221b0d-ec41-46d1-a105-549d6ba302cf None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:22.965789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28221b0d-ec41-46d1-a105-549d6ba302cf None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:22.965789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28221b0d-ec41-46d1-a105-549d6ba302cf None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:22.970471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 396/789] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:22.971508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28221b0d-ec41-46d1-a105-549d6ba302cf None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:22.998255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91040d48-c717-4b24-b8b5-36bf3e8703d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:22.999337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040d48-c717-4b24-b8b5-36bf3e8703d9 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:23.000177 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040d48-c717-4b24-b8b5-36bf3e8703d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:23.000365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040d48-c717-4b24-b8b5-36bf3e8703d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:23.001460 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91040d48-c717-4b24-b8b5-36bf3e8703d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:23.001998 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91040d48-c717-4b24-b8b5-36bf3e8703d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:23.004525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91040d48-c717-4b24-b8b5-36bf3e8703d9 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:23.017512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 394/790] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:54:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:23.018876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70ba98-effc-4a0d-a7d1-661d2cc71216 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:23.019738 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70ba98-effc-4a0d-a7d1-661d2cc71216 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:23.019738 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70ba98-effc-4a0d-a7d1-661d2cc71216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:23.028631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:23.047058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6e70ba98-effc-4a0d-a7d1-661d2cc71216 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:23.048418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6e70ba98-effc-4a0d-a7d1-661d2cc71216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:23.135979 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 395/791] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:23.137986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70ba98-effc-4a0d-a7d1-661d2cc71216 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:23.190160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28221b0d-ec41-46d1-a105-549d6ba302cf None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:23.256545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67422b4-9212-416e-927c-0ff3c06179c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:23.257525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67422b4-9212-416e-927c-0ff3c06179c3 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:23.258028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67422b4-9212-416e-927c-0ff3c06179c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:23.258523 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67422b4-9212-416e-927c-0ff3c06179c3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:23.259646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67422b4-9212-416e-927c-0ff3c06179c3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:23.262449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67422b4-9212-416e-927c-0ff3c06179c3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-f67422b4-9212-416e-927c-0ff3c06179c3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:23.280209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:23.282467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 20:54:23.284373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:23.289850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 397/792] 10.222.0.17 () {56 vars in 1129 bytes} [Fri Aug 19 20:54:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:23.291573 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67422b4-9212-416e-927c-0ff3c06179c3 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:23.379161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70ba98-effc-4a0d-a7d1-661d2cc71216 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:23.397992 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:23.457365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbad7f1-0b0e-49be-8c7a-544b8a287c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:23.458457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbad7f1-0b0e-49be-8c7a-544b8a287c11 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:23.459151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbad7f1-0b0e-49be-8c7a-544b8a287c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:23.459481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbad7f1-0b0e-49be-8c7a-544b8a287c11 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:23.460706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbad7f1-0b0e-49be-8c7a-544b8a287c11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:23.461306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbad7f1-0b0e-49be-8c7a-544b8a287c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:23.464087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbad7f1-0b0e-49be-8c7a-544b8a287c11 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:23.486779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 396/793] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:54:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:23.486779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbad7f1-0b0e-49be-8c7a-544b8a287c11 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:23.507103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:23.516419 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67422b4-9212-416e-927c-0ff3c06179c3 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:23.603660 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6be65-ead7-401b-9db8-890ec85166f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:23.606169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6be65-ead7-401b-9db8-890ec85166f4 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:23.607512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6be65-ead7-401b-9db8-890ec85166f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:23.608832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6be65-ead7-401b-9db8-890ec85166f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:23.637939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6be65-ead7-401b-9db8-890ec85166f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:23.640722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6be65-ead7-401b-9db8-890ec85166f4 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-2bc6be65-ead7-401b-9db8-890ec85166f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:23.664251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:23.666264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:23.670956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:23.670956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:23.670956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:23.670956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 398/794] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:23.670956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6be65-ead7-401b-9db8-890ec85166f4 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:23.699185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbad7f1-0b0e-49be-8c7a-544b8a287c11 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:23.776557 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d41b9-bb05-48a4-9934-2756ad7da03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:23.777783 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d41b9-bb05-48a4-9934-2756ad7da03c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:23.778215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d41b9-bb05-48a4-9934-2756ad7da03c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:23.778706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d41b9-bb05-48a4-9934-2756ad7da03c None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:23.779900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d41b9-bb05-48a4-9934-2756ad7da03c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:23.780603 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d41b9-bb05-48a4-9934-2756ad7da03c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:23.783473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d41b9-bb05-48a4-9934-2756ad7da03c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:23.793947 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 397/795] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Aug 19 20:54:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:23.795209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d41b9-bb05-48a4-9934-2756ad7da03c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:23.837632 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6be65-ead7-401b-9db8-890ec85166f4 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:23.847419 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:23.892980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cffb3-f94f-447c-805a-c75db9869dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:23.894180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cffb3-f94f-447c-805a-c75db9869dac None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:23.894854 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cffb3-f94f-447c-805a-c75db9869dac None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:23.895360 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cffb3-f94f-447c-805a-c75db9869dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:23.909624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cffb3-f94f-447c-805a-c75db9869dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:23.911816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cffb3-f94f-447c-805a-c75db9869dac None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-444cffb3-f94f-447c-805a-c75db9869dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:23.929751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:23.931023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:23.931918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:23.931918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:23.931918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:23.931918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 399/796] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:23.932153 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cffb3-f94f-447c-805a-c75db9869dac None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:23.935842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:23.987970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d41b9-bb05-48a4-9934-2756ad7da03c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:24.035897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeda6d4-0c03-4c39-992f-db0773b29de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:24.036841 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeda6d4-0c03-4c39-992f-db0773b29de6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:24.036841 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeda6d4-0c03-4c39-992f-db0773b29de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:24.037102 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeda6d4-0c03-4c39-992f-db0773b29de6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:24.056034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeda6d4-0c03-4c39-992f-db0773b29de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ffeda6d4-0c03-4c39-992f-db0773b29de6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:24.069166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:24.070242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 398/797] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:54:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:24.077207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeda6d4-0c03-4c39-992f-db0773b29de6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:24.101778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cffb3-f94f-447c-805a-c75db9869dac None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:24.160037 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f261e12-ef57-43ab-b944-7f74ef9a55eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:24.160664 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f261e12-ef57-43ab-b944-7f74ef9a55eb None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:24.161289 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f261e12-ef57-43ab-b944-7f74ef9a55eb None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:24.161571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f261e12-ef57-43ab-b944-7f74ef9a55eb None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:24.162235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f261e12-ef57-43ab-b944-7f74ef9a55eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:24.162726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f261e12-ef57-43ab-b944-7f74ef9a55eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:24.164235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f261e12-ef57-43ab-b944-7f74ef9a55eb None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:24.179528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 400/798] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:24.185467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f261e12-ef57-43ab-b944-7f74ef9a55eb None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:24.254482 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:24.266413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeda6d4-0c03-4c39-992f-db0773b29de6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:24.276611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:24.336306 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f261e12-ef57-43ab-b944-7f74ef9a55eb None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:24.344106 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3544311-5d1f-4dc5-bee9-8d57f8d082a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:24.345163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3544311-5d1f-4dc5-bee9-8d57f8d082a7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:24.345665 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3544311-5d1f-4dc5-bee9-8d57f8d082a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:24.346162 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3544311-5d1f-4dc5-bee9-8d57f8d082a7 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:24.348249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3544311-5d1f-4dc5-bee9-8d57f8d082a7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:24.348806 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3544311-5d1f-4dc5-bee9-8d57f8d082a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:24.352903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3544311-5d1f-4dc5-bee9-8d57f8d082a7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:24.362582 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 399/799] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Aug 19 20:54:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:24.369430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3544311-5d1f-4dc5-bee9-8d57f8d082a7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:24.387427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93450259-536a-44c0-8103-9583d140c62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:24.388431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93450259-536a-44c0-8103-9583d140c62e None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:24.388842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93450259-536a-44c0-8103-9583d140c62e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:24.389300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93450259-536a-44c0-8103-9583d140c62e None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:24.390152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93450259-536a-44c0-8103-9583d140c62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:24.390620 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93450259-536a-44c0-8103-9583d140c62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:24.392297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93450259-536a-44c0-8103-9583d140c62e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:24.414676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 401/800] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:24.414676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93450259-536a-44c0-8103-9583d140c62e None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:24.534347 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93450259-536a-44c0-8103-9583d140c62e None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:24.566531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3544311-5d1f-4dc5-bee9-8d57f8d082a7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:24.569524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:24.588606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4b04e-1773-449f-9ada-8cf5dfec52be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:24.589573 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b04e-1773-449f-9ada-8cf5dfec52be None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:24.590679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b04e-1773-449f-9ada-8cf5dfec52be None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:24.591182 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b04e-1773-449f-9ada-8cf5dfec52be None admin] PATH_INFO: `/v3/users/swift` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:24.605284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4b04e-1773-449f-9ada-8cf5dfec52be None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:24.608236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4b04e-1773-449f-9ada-8cf5dfec52be None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:24.608386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61759a-fdab-4fc7-9865-ea208054301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:24.608859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61759a-fdab-4fc7-9865-ea208054301d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:24.609138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61759a-fdab-4fc7-9865-ea208054301d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:24.609410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61759a-fdab-4fc7-9865-ea208054301d None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:24.610105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61759a-fdab-4fc7-9865-ea208054301d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:24.610408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61759a-fdab-4fc7-9865-ea208054301d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:24.611843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61759a-fdab-4fc7-9865-ea208054301d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:24.620870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 400/801] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:54:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:24.622996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61759a-fdab-4fc7-9865-ea208054301d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-d8b4b04e-1773-449f-9ada-8cf5dfec52be None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:24.630988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:24.632905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:24.634805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:24.634805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:24.634805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:24.634805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:24.634805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:24.634805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:24.634805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:24.634805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:24.634805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 20:54:24.634805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:24.634805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 402/802] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:54:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:24.634805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4b04e-1773-449f-9ada-8cf5dfec52be None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:24.649010 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:24.758199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61759a-fdab-4fc7-9865-ea208054301d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:24.777137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4b04e-1773-449f-9ada-8cf5dfec52be None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:24.803726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbddce-58ba-413f-8be9-aab09b1e2479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:24.804704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbddce-58ba-413f-8be9-aab09b1e2479 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:24.805150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbddce-58ba-413f-8be9-aab09b1e2479 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:24.805594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbddce-58ba-413f-8be9-aab09b1e2479 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:24.806712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbddce-58ba-413f-8be9-aab09b1e2479 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:24.809391 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbddce-58ba-413f-8be9-aab09b1e2479 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:24.832860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f9bb8-50ee-4faf-ac94-b7b116e53176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:24.833857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9bb8-50ee-4faf-ac94-b7b116e53176 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:24.834304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9bb8-50ee-4faf-ac94-b7b116e53176 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:24.834697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9bb8-50ee-4faf-ac94-b7b116e53176 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:24.842306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 401/803] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 20:54:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:54:24.844069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df39297-8db5-46ab-a721-79d78df8660f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:24.844493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df39297-8db5-46ab-a721-79d78df8660f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:24.844915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df39297-8db5-46ab-a721-79d78df8660f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:24.846824 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 402/804] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:24.848588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f9bb8-50ee-4faf-ac94-b7b116e53176 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:24.851645 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f9bb8-50ee-4faf-ac94-b7b116e53176 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:24.852859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df39297-8db5-46ab-a721-79d78df8660f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-412f9bb8-50ee-4faf-ac94-b7b116e53176 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:24.874000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:24.881614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:24.883528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:24.883528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:24.883528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:24.883528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:24.883528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:24.883528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:24.883528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:24.883528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:24.883528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 20:54:24.883528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:24.883528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 403/805] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Aug 19 20:54:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:24.883528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f9bb8-50ee-4faf-ac94-b7b116e53176 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:24.962476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:24.986179 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:25.035170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df39297-8db5-46ab-a721-79d78df8660f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:25.079993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f9bb8-50ee-4faf-ac94-b7b116e53176 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:25.092061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eee5be-e4d7-4b97-b17a-7584f34f8baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:25.093309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eee5be-e4d7-4b97-b17a-7584f34f8baf None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:25.093793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eee5be-e4d7-4b97-b17a-7584f34f8baf None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:25.094257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eee5be-e4d7-4b97-b17a-7584f34f8baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:25.112305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eee5be-e4d7-4b97-b17a-7584f34f8baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:25.114272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eee5be-e4d7-4b97-b17a-7584f34f8baf None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-e2eee5be-e4d7-4b97-b17a-7584f34f8baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:25.144295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:25.146420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:25.148141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:25.148141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:25.148141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:25.149686 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 403/806] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:25.149885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28173877-dd8f-43f7-8961-c5f17a6b8c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:25.150950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28173877-dd8f-43f7-8961-c5f17a6b8c45 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:25.152560 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28173877-dd8f-43f7-8961-c5f17a6b8c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:25.152753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f066514-1fca-4a16-af49-e0264c7ccc29 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:25.152908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28173877-dd8f-43f7-8961-c5f17a6b8c45 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:25.153072 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f066514-1fca-4a16-af49-e0264c7ccc29 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:25.153072 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f066514-1fca-4a16-af49-e0264c7ccc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:25.153737 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28173877-dd8f-43f7-8961-c5f17a6b8c45 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:25.154371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28173877-dd8f-43f7-8961-c5f17a6b8c45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:25.157209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28173877-dd8f-43f7-8961-c5f17a6b8c45 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:25.188413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 404/807] 10.222.0.17 () {56 vars in 1135 bytes} [Fri Aug 19 20:54:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:25.188413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28173877-dd8f-43f7-8961-c5f17a6b8c45 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:25.188845 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-3f066514-1fca-4a16-af49-e0264c7ccc29 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:25.188845 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3f066514-1fca-4a16-af49-e0264c7ccc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:25.317907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:25.320768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 404/808] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:25.322923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f066514-1fca-4a16-af49-e0264c7ccc29 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:25.323383 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28173877-dd8f-43f7-8961-c5f17a6b8c45 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:25.391664 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d6be6-dac0-482a-a085-6f162211f855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:25.392882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d6be6-dac0-482a-a085-6f162211f855 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:25.393481 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d6be6-dac0-482a-a085-6f162211f855 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:25.394065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d6be6-dac0-482a-a085-6f162211f855 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:25.395466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d6be6-dac0-482a-a085-6f162211f855 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:25.396086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d6be6-dac0-482a-a085-6f162211f855 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:25.399195 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d6be6-dac0-482a-a085-6f162211f855 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:25.435327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 405/809] 10.222.0.17 () {56 vars in 1149 bytes} [Fri Aug 19 20:54:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:25.443967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d6be6-dac0-482a-a085-6f162211f855 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:25.445963 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:25.553597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f066514-1fca-4a16-af49-e0264c7ccc29 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:25.639793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287bb7-ac39-447f-bed0-03cd2c53f654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:25.641905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287bb7-ac39-447f-bed0-03cd2c53f654 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:25.643044 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287bb7-ac39-447f-bed0-03cd2c53f654 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:25.643756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287bb7-ac39-447f-bed0-03cd2c53f654 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:25.645486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287bb7-ac39-447f-bed0-03cd2c53f654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:25.646309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287bb7-ac39-447f-bed0-03cd2c53f654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:25.650103 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287bb7-ac39-447f-bed0-03cd2c53f654 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:25.658408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d6be6-dac0-482a-a085-6f162211f855 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:25.682779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 405/810] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:25.682779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287bb7-ac39-447f-bed0-03cd2c53f654 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:25.722901 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd74b8-9495-467e-a5ed-595f87f542a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:25.723634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd74b8-9495-467e-a5ed-595f87f542a8 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:25.723974 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd74b8-9495-467e-a5ed-595f87f542a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:25.724318 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd74b8-9495-467e-a5ed-595f87f542a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:25.738405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd74b8-9495-467e-a5ed-595f87f542a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:25.739915 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd74b8-9495-467e-a5ed-595f87f542a8 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-4efd74b8-9495-467e-a5ed-595f87f542a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:25.769783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:25.771903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:25.774138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:25.774138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:25.774138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:25.779439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 406/811] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:25.780840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd74b8-9495-467e-a5ed-595f87f542a8 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:25.801330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:25.878368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287bb7-ac39-447f-bed0-03cd2c53f654 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:25.900466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:25.942627 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca52f22-362b-48db-beaf-e8b451215c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:25.943975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca52f22-362b-48db-beaf-e8b451215c9a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:25.944626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca52f22-362b-48db-beaf-e8b451215c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:25.945240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca52f22-362b-48db-beaf-e8b451215c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:25.970922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd74b8-9495-467e-a5ed-595f87f542a8 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:26.039243 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be27433-ecf1-4483-a7cd-047e0f7b6bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:26.040229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be27433-ecf1-4483-a7cd-047e0f7b6bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:26.040648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be27433-ecf1-4483-a7cd-047e0f7b6bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:26.041079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be27433-ecf1-4483-a7cd-047e0f7b6bd8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:26.042108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be27433-ecf1-4483-a7cd-047e0f7b6bd8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:26.044776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be27433-ecf1-4483-a7cd-047e0f7b6bd8 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-1be27433-ecf1-4483-a7cd-047e0f7b6bd8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:26.062220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:26.063500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 20:54:26.064501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:26.067184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 407/812] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:25 2022] GET /identity/v3/services/network => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:26.068464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be27433-ecf1-4483-a7cd-047e0f7b6bd8 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:26.140959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca52f22-362b-48db-beaf-e8b451215c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:26.143687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca52f22-362b-48db-beaf-e8b451215c9a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-9ca52f22-362b-48db-beaf-e8b451215c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:26.172368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:26.173496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:26.174540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:26.174540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:26.174540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:26.181610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 406/813] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 500 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:26.181610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca52f22-362b-48db-beaf-e8b451215c9a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:26.223921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:26.274917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be27433-ecf1-4483-a7cd-047e0f7b6bd8 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:26.336419 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca52f22-362b-48db-beaf-e8b451215c9a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:26.345895 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238412d-b7fc-4a7a-99a2-3538ce22f1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:26.346829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238412d-b7fc-4a7a-99a2-3538ce22f1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:26.347266 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238412d-b7fc-4a7a-99a2-3538ce22f1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:26.347702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238412d-b7fc-4a7a-99a2-3538ce22f1b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:26.357667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238412d-b7fc-4a7a-99a2-3538ce22f1b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:26.359437 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238412d-b7fc-4a7a-99a2-3538ce22f1b3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-0238412d-b7fc-4a7a-99a2-3538ce22f1b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:26.374286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:26.376337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:26.378355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:26.378355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:26.378355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:26.378355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:26.378355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:26.378355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:26.378355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:26.378355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:26.378355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:54:26.378355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:26.388510 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 408/814] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Aug 19 20:54:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:26.390330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238412d-b7fc-4a7a-99a2-3538ce22f1b3 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:26.398017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18c11c-9dd4-4da8-8d04-125297ca086f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:26.398866 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18c11c-9dd4-4da8-8d04-125297ca086f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:26.399290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18c11c-9dd4-4da8-8d04-125297ca086f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:26.399687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18c11c-9dd4-4da8-8d04-125297ca086f None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:26.400474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18c11c-9dd4-4da8-8d04-125297ca086f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:26.400918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18c11c-9dd4-4da8-8d04-125297ca086f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:26.403012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18c11c-9dd4-4da8-8d04-125297ca086f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:26.424307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 407/815] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:26.424307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18c11c-9dd4-4da8-8d04-125297ca086f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:26.459405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:26.578137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238412d-b7fc-4a7a-99a2-3538ce22f1b3 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:26.594302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18c11c-9dd4-4da8-8d04-125297ca086f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:26.617432 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edff1c-a1f8-43f5-96d5-bfa977534c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:26.618070 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edff1c-a1f8-43f5-96d5-bfa977534c24 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:26.618340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edff1c-a1f8-43f5-96d5-bfa977534c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:26.618604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edff1c-a1f8-43f5-96d5-bfa977534c24 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:26.619284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edff1c-a1f8-43f5-96d5-bfa977534c24 None admin] RBAC: Adding query filter params (name=network) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:26.619588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edff1c-a1f8-43f5-96d5-bfa977534c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:26.620976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edff1c-a1f8-43f5-96d5-bfa977534c24 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:26.623062 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:26.627132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 409/816] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Aug 19 20:54:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:26.628140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edff1c-a1f8-43f5-96d5-bfa977534c24 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:26.671505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563484b6-169a-441c-b9c8-ddc805368fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:26.672464 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563484b6-169a-441c-b9c8-ddc805368fdb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:26.672931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563484b6-169a-441c-b9c8-ddc805368fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:26.673393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563484b6-169a-441c-b9c8-ddc805368fdb None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:26.674387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563484b6-169a-441c-b9c8-ddc805368fdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:26.674773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563484b6-169a-441c-b9c8-ddc805368fdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:26.677075 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563484b6-169a-441c-b9c8-ddc805368fdb None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:26.698809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 408/817] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:26.702028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563484b6-169a-441c-b9c8-ddc805368fdb None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:26.822121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edff1c-a1f8-43f5-96d5-bfa977534c24 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:26.856413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:26.869348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f172d08-0adf-4445-9dda-45db43487858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:26.870255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f172d08-0adf-4445-9dda-45db43487858 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:26.870674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f172d08-0adf-4445-9dda-45db43487858 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:26.871668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f172d08-0adf-4445-9dda-45db43487858 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:26.872704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f172d08-0adf-4445-9dda-45db43487858 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:26.873189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f172d08-0adf-4445-9dda-45db43487858 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:26.875152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f172d08-0adf-4445-9dda-45db43487858 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:26.892831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563484b6-169a-441c-b9c8-ddc805368fdb None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:26.900464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 410/818] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Aug 19 20:54:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:26.902198 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f172d08-0adf-4445-9dda-45db43487858 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:26.953765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a55bb-21ae-4f43-b071-d10468ba9517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:26.954664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a55bb-21ae-4f43-b071-d10468ba9517 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:26.955099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a55bb-21ae-4f43-b071-d10468ba9517 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:26.955452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a55bb-21ae-4f43-b071-d10468ba9517 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:26.965035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a55bb-21ae-4f43-b071-d10468ba9517 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:26.967014 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a55bb-21ae-4f43-b071-d10468ba9517 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-2a2a55bb-21ae-4f43-b071-d10468ba9517 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:26.981202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:26.983050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:26.986490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:26.986490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:26.986490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:26.986490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:26.986490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:26.986490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:26.986490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:26.986490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:26.986490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 409/819] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:26.986490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a55bb-21ae-4f43-b071-d10468ba9517 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:27.023815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:27.094608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f172d08-0adf-4445-9dda-45db43487858 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:27.117571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a55bb-21ae-4f43-b071-d10468ba9517 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:27.140987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263db79-c465-4fdf-b8d5-516b9b02c514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:27.141709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263db79-c465-4fdf-b8d5-516b9b02c514 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:27.142038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263db79-c465-4fdf-b8d5-516b9b02c514 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:27.142364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263db79-c465-4fdf-b8d5-516b9b02c514 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:27.143111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263db79-c465-4fdf-b8d5-516b9b02c514 None admin] RBAC: Adding query filter params (type=network) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:27.143462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263db79-c465-4fdf-b8d5-516b9b02c514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:27.144966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263db79-c465-4fdf-b8d5-516b9b02c514 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:27.152015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 411/820] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Aug 19 20:54:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:27.153368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263db79-c465-4fdf-b8d5-516b9b02c514 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:27.172443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f99104-8884-4ed4-8e90-4af30189b228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:27.173446 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f99104-8884-4ed4-8e90-4af30189b228 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:27.174252 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f99104-8884-4ed4-8e90-4af30189b228 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:27.174712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f99104-8884-4ed4-8e90-4af30189b228 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:27.184894 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f99104-8884-4ed4-8e90-4af30189b228 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:27.186217 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f99104-8884-4ed4-8e90-4af30189b228 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-c4f99104-8884-4ed4-8e90-4af30189b228 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:27.204196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:27.206005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:27.207724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:27.207724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:27.207724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:27.207724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:27.207724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:27.207724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:27.207724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:27.207724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:27.207724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 410/821] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:27.207724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f99104-8884-4ed4-8e90-4af30189b228 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:27.214597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:27.306444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263db79-c465-4fdf-b8d5-516b9b02c514 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:27.329446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:27.344918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda0a18-f498-4d56-a989-2acf5dd34e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:27.345539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda0a18-f498-4d56-a989-2acf5dd34e8b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:27.345820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda0a18-f498-4d56-a989-2acf5dd34e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:27.346105 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda0a18-f498-4d56-a989-2acf5dd34e8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:27.360171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f99104-8884-4ed4-8e90-4af30189b228 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:27.420316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda0a18-f498-4d56-a989-2acf5dd34e8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:27.421798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda0a18-f498-4d56-a989-2acf5dd34e8b None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:27.422605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017dd9b0-70cb-4ea3-9f1f-305173d3bfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:27.423675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dd9b0-70cb-4ea3-9f1f-305173d3bfa3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:27.424172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dd9b0-70cb-4ea3-9f1f-305173d3bfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:27.424674 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dd9b0-70cb-4ea3-9f1f-305173d3bfa3 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:27.425973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dd9b0-70cb-4ea3-9f1f-305173d3bfa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:27.426522 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dd9b0-70cb-4ea3-9f1f-305173d3bfa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:27.429304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dd9b0-70cb-4ea3-9f1f-305173d3bfa3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:27.458273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 411/822] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:27.458273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59e8bd-a547-484c-8f28-b3e3cb92d2b3 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:27.458273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59e8bd-a547-484c-8f28-b3e3cb92d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:27.458273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59e8bd-a547-484c-8f28-b3e3cb92d2b3 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:27.458991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 412/823] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:27.459981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59e8bd-a547-484c-8f28-b3e3cb92d2b3 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:27.545374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 412/824] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:54:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:54:27.545374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda0a18-f498-4d56-a989-2acf5dd34e8b None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:27.566129 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:27.566528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:27.622721 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59e8bd-a547-484c-8f28-b3e3cb92d2b3 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:27.669231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda0a18-f498-4d56-a989-2acf5dd34e8b None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:27.669454 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693ee1e-e07d-4960-bde4-27981232ec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:27.670342 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693ee1e-e07d-4960-bde4-27981232ec97 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:27.670856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693ee1e-e07d-4960-bde4-27981232ec97 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:27.671342 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693ee1e-e07d-4960-bde4-27981232ec97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:27.672549 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693ee1e-e07d-4960-bde4-27981232ec97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:27.675120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693ee1e-e07d-4960-bde4-27981232ec97 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:27.701200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 413/825] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 20:54:27 2022] POST /identity/v3/endpoints => generated 337 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:54:27.702605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693ee1e-e07d-4960-bde4-27981232ec97 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:27.734713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc7ada-3ef7-4f6e-89ac-daae8a369e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:27.735616 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc7ada-3ef7-4f6e-89ac-daae8a369e44 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:27.736041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc7ada-3ef7-4f6e-89ac-daae8a369e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:27.736455 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc7ada-3ef7-4f6e-89ac-daae8a369e44 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:27.737568 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc7ada-3ef7-4f6e-89ac-daae8a369e44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:27.738033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc7ada-3ef7-4f6e-89ac-daae8a369e44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:27.742783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc7ada-3ef7-4f6e-89ac-daae8a369e44 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:27.767707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 413/826] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:27.767707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d775e1f-5c11-457b-b61d-c6b6b8323987 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:27.767707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d775e1f-5c11-457b-b61d-c6b6b8323987 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:27.767707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d775e1f-5c11-457b-b61d-c6b6b8323987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:27.794974 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-2d775e1f-5c11-457b-b61d-c6b6b8323987 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:27.797083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2d775e1f-5c11-457b-b61d-c6b6b8323987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:27.901435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693ee1e-e07d-4960-bde4-27981232ec97 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:27.910815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 414/827] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:27.910815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d775e1f-5c11-457b-b61d-c6b6b8323987 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:27.923130 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:27.955028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:27.991211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a0985-d439-48c2-9689-166f6f05844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:27.992676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a0985-d439-48c2-9689-166f6f05844b None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:27.993366 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a0985-d439-48c2-9689-166f6f05844b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:27.994047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a0985-d439-48c2-9689-166f6f05844b None admin] PATH_INFO: `/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/6fbfc93e45704b3ba2e5a4bcf7568a14/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:28.002406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a0985-d439-48c2-9689-166f6f05844b None admin] RBAC: Authorizing `identity:create_grant(project_id=d1defe14eddd4b28ac969adb3d504c7a, user_id=6fbfc93e45704b3ba2e5a4bcf7568a14, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:28.007049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a0985-d439-48c2-9689-166f6f05844b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:28.037154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 414/828] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:54:27 2022] PUT /identity/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/6fbfc93e45704b3ba2e5a4bcf7568a14/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:54:28.039147 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a0985-d439-48c2-9689-166f6f05844b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:28.130479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d775e1f-5c11-457b-b61d-c6b6b8323987 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:28.199914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c026e1-ae64-4822-b29e-46f6b7f58b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:28.200957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c026e1-ae64-4822-b29e-46f6b7f58b97 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:28.201247 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c026e1-ae64-4822-b29e-46f6b7f58b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:28.201774 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c026e1-ae64-4822-b29e-46f6b7f58b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:28.218801 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c026e1-ae64-4822-b29e-46f6b7f58b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:28.220417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c026e1-ae64-4822-b29e-46f6b7f58b97 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-b3c026e1-ae64-4822-b29e-46f6b7f58b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:28.242363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:28.243539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:28.244642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:28.244642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:28.244642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:28.247088 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 415/829] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:28.248590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c026e1-ae64-4822-b29e-46f6b7f58b97 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:28.272812 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a0985-d439-48c2-9689-166f6f05844b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:28.328283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:28.345624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bd0c7-9bc0-4dd4-a505-d2e2f963b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:28.346811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bd0c7-9bc0-4dd4-a505-d2e2f963b219 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:28.347306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bd0c7-9bc0-4dd4-a505-d2e2f963b219 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:28.347823 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bd0c7-9bc0-4dd4-a505-d2e2f963b219 None admin] PATH_INFO: `/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/b9f8b86c01084a09bb8eac50eddfa0a1/roles/7ba43d9ef6cf4709ae99d7e4c68ce879` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:28.378362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bd0c7-9bc0-4dd4-a505-d2e2f963b219 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1defe14eddd4b28ac969adb3d504c7a, user_id=b9f8b86c01084a09bb8eac50eddfa0a1, role_id=7ba43d9ef6cf4709ae99d7e4c68ce879)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:28.381472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bd0c7-9bc0-4dd4-a505-d2e2f963b219 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:28.385316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c026e1-ae64-4822-b29e-46f6b7f58b97 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:28.405924 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 415/830] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:54:28 2022] PUT /identity/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/b9f8b86c01084a09bb8eac50eddfa0a1/roles/7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:54:28.407929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bd0c7-9bc0-4dd4-a505-d2e2f963b219 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:28.439405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef572e-8a47-4689-852a-8803f9207a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:28.440677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef572e-8a47-4689-852a-8803f9207a6d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:28.441331 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef572e-8a47-4689-852a-8803f9207a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:28.441841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef572e-8a47-4689-852a-8803f9207a6d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:28.442765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef572e-8a47-4689-852a-8803f9207a6d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:28.444473 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef572e-8a47-4689-852a-8803f9207a6d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-95ef572e-8a47-4689-852a-8803f9207a6d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:28.459659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:28.460837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 20:54:28.461714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:28.465531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 416/831] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:54:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:28.474942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef572e-8a47-4689-852a-8803f9207a6d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:28.493882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:28.591991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bd0c7-9bc0-4dd4-a505-d2e2f963b219 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:28.633724 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef572e-8a47-4689-852a-8803f9207a6d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:28.636144 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a06c99-08fd-40fc-8efc-11b90f5adac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:28.637729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a06c99-08fd-40fc-8efc-11b90f5adac7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:28.638220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a06c99-08fd-40fc-8efc-11b90f5adac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:28.638645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a06c99-08fd-40fc-8efc-11b90f5adac7 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:28.639602 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a06c99-08fd-40fc-8efc-11b90f5adac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:28.640077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a06c99-08fd-40fc-8efc-11b90f5adac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:28.641674 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a06c99-08fd-40fc-8efc-11b90f5adac7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:28.660187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 416/832] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:28.661923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a06c99-08fd-40fc-8efc-11b90f5adac7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:28.664618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:28.684433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40938397-537c-47c1-93ee-a4de1180d28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:28.685348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40938397-537c-47c1-93ee-a4de1180d28d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:28.685676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40938397-537c-47c1-93ee-a4de1180d28d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:28.685958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40938397-537c-47c1-93ee-a4de1180d28d None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:28.686629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40938397-537c-47c1-93ee-a4de1180d28d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:28.686987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40938397-537c-47c1-93ee-a4de1180d28d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:28.688480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40938397-537c-47c1-93ee-a4de1180d28d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:28.693815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 417/833] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:54:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:28.700250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40938397-537c-47c1-93ee-a4de1180d28d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:28.789653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:28.802325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a06c99-08fd-40fc-8efc-11b90f5adac7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:28.844430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77166823-1058-4c58-8e67-164c5cb3cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:28.845378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77166823-1058-4c58-8e67-164c5cb3cd00 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:28.845810 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77166823-1058-4c58-8e67-164c5cb3cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:28.846240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77166823-1058-4c58-8e67-164c5cb3cd00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:28.855684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77166823-1058-4c58-8e67-164c5cb3cd00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:28.857551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77166823-1058-4c58-8e67-164c5cb3cd00 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-77166823-1058-4c58-8e67-164c5cb3cd00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:28.871387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:28.872590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:28.873488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:28.873488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:28.873488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:28.873488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:28.873488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:28.873488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:28.873488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:28.873488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:28.875817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40938397-537c-47c1-93ee-a4de1180d28d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:28.881192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 417/834] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:28.882519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77166823-1058-4c58-8e67-164c5cb3cd00 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:28.959639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d87c0-ec1c-4b2e-85c7-305a840775c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:28.960889 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d87c0-ec1c-4b2e-85c7-305a840775c7 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:28.961383 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d87c0-ec1c-4b2e-85c7-305a840775c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:28.962440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d87c0-ec1c-4b2e-85c7-305a840775c7 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:28.963586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d87c0-ec1c-4b2e-85c7-305a840775c7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:28.964220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d87c0-ec1c-4b2e-85c7-305a840775c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:28.968067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d87c0-ec1c-4b2e-85c7-305a840775c7 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:28.977133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 418/835] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:54:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:29.004908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77166823-1058-4c58-8e67-164c5cb3cd00 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:29.048669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d628f-3412-458a-91fa-98e337b9da29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:29.049659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d628f-3412-458a-91fa-98e337b9da29 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:29.050178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d628f-3412-458a-91fa-98e337b9da29 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:29.050673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d628f-3412-458a-91fa-98e337b9da29 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:29.051688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d628f-3412-458a-91fa-98e337b9da29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:29.052232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d628f-3412-458a-91fa-98e337b9da29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:29.054295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d628f-3412-458a-91fa-98e337b9da29 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:29.069941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 418/836] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:29.077694 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d87c0-ec1c-4b2e-85c7-305a840775c7 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:29.164798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:29.227158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d87c0-ec1c-4b2e-85c7-305a840775c7 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:29.271833 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109abaa-4b5e-4fe1-a694-89b2ceec0b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:29.272469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109abaa-4b5e-4fe1-a694-89b2ceec0b6a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:29.272751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109abaa-4b5e-4fe1-a694-89b2ceec0b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:29.273029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109abaa-4b5e-4fe1-a694-89b2ceec0b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:29.273793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109abaa-4b5e-4fe1-a694-89b2ceec0b6a None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=83e51beb8d0e4219af906860ce906500) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:29.274105 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109abaa-4b5e-4fe1-a694-89b2ceec0b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:29.275640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109abaa-4b5e-4fe1-a694-89b2ceec0b6a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:29.283852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 419/837] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:54:29 2022] GET /identity/v3/role_assignments?user.id=83e51beb8d0e4219af906860ce906500&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:30.140642 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7d6b0-d070-4cf8-88e1-1e93b2150098 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:30.141458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7d6b0-d070-4cf8-88e1-1e93b2150098 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:30.141458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7d6b0-d070-4cf8-88e1-1e93b2150098 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:30.142914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 419/838] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:30.148470 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9ef2-382a-48b9-99df-0851e2e49835 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:30.148851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9ef2-382a-48b9-99df-0851e2e49835 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:30.149093 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9ef2-382a-48b9-99df-0851e2e49835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:30.169351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-fa0b9ef2-382a-48b9-99df-0851e2e49835 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:30.170613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-fa0b9ef2-382a-48b9-99df-0851e2e49835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:30.248209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 420/839] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:30.529844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7d6b0-d070-4cf8-88e1-1e93b2150098 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:30.543730 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:30.681771 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7d6b0-d070-4cf8-88e1-1e93b2150098 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:30.721506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f37016-dc9e-4404-a860-0dc313153c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:30.722156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f37016-dc9e-4404-a860-0dc313153c90 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:30.722440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f37016-dc9e-4404-a860-0dc313153c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:30.722714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f37016-dc9e-4404-a860-0dc313153c90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:30.734564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f37016-dc9e-4404-a860-0dc313153c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-b2f37016-dc9e-4404-a860-0dc313153c90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:30.739834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:30.741388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:30.742994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:30.742994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:30.742994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:30.742994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:30.742994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:30.742994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:30.742994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:30.742994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:30.742994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:30.742994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:30.742994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:54:30.742994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:30.742994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 420/840] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:54:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:30.747926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b9ef2-382a-48b9-99df-0851e2e49835 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:30.807448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:30.869816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b9ef2-382a-48b9-99df-0851e2e49835 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:30.911022 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fe640-ff88-43c1-b711-e921e69c9a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:30.911998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fe640-ff88-43c1-b711-e921e69c9a60 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:30.912541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fe640-ff88-43c1-b711-e921e69c9a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:30.913020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fe640-ff88-43c1-b711-e921e69c9a60 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:30.913939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fe640-ff88-43c1-b711-e921e69c9a60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:30.914444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fe640-ff88-43c1-b711-e921e69c9a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:30.916059 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fe640-ff88-43c1-b711-e921e69c9a60 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:30.927454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 421/841] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:54:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:30.936352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f37016-dc9e-4404-a860-0dc313153c90 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:31.021117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:31.057837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f37016-dc9e-4404-a860-0dc313153c90 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:31.098831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecafde-bdcd-472d-b93b-4133c4a1b252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:31.099849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecafde-bdcd-472d-b93b-4133c4a1b252 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:31.100359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecafde-bdcd-472d-b93b-4133c4a1b252 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:31.100836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecafde-bdcd-472d-b93b-4133c4a1b252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:31.114217 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecafde-bdcd-472d-b93b-4133c4a1b252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:31.116123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecafde-bdcd-472d-b93b-4133c4a1b252 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-8fecafde-bdcd-472d-b93b-4133c4a1b252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:31.134884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:31.135920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:31.136877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:31.136877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:31.136877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:31.139212 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 421/842] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:31.150918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fe640-ff88-43c1-b711-e921e69c9a60 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:31.273367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fe640-ff88-43c1-b711-e921e69c9a60 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:31.282577 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:31.315010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5755fa6-d04b-437c-b994-b56d5e5daa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:31.315887 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5755fa6-d04b-437c-b994-b56d5e5daa81 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:31.316314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5755fa6-d04b-437c-b994-b56d5e5daa81 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:31.316734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5755fa6-d04b-437c-b994-b56d5e5daa81 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:31.317538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5755fa6-d04b-437c-b994-b56d5e5daa81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:31.317987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5755fa6-d04b-437c-b994-b56d5e5daa81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:31.319551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5755fa6-d04b-437c-b994-b56d5e5daa81 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:31.334631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 422/843] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:31.340826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecafde-bdcd-472d-b93b-4133c4a1b252 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:31.352859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ea5e6-e37e-4551-97aa-4154a6106069 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:31.353170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ea5e6-e37e-4551-97aa-4154a6106069 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:31.353437 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ea5e6-e37e-4551-97aa-4154a6106069 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:31.354975 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 423/844] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:54:31.361957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a6d68-c33f-4dc9-9fd3-76eea65850aa None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:31.362252 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a6d68-c33f-4dc9-9fd3-76eea65850aa None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:31.362525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a6d68-c33f-4dc9-9fd3-76eea65850aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:31.387197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-d36a6d68-c33f-4dc9-9fd3-76eea65850aa None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:31.389277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d36a6d68-c33f-4dc9-9fd3-76eea65850aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:31.464647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 424/845] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:54:31.466853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ab37e-3c06-40b0-9293-f2c9248d2d81 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:31.467356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ab37e-3c06-40b0-9293-f2c9248d2d81 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:31.467834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ab37e-3c06-40b0-9293-f2c9248d2d81 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:31.469676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 425/846] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:31.477066 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f29a30-14dc-4991-b4d9-02ac68d810d6 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:31.477443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f29a30-14dc-4991-b4d9-02ac68d810d6 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:31.477593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f29a30-14dc-4991-b4d9-02ac68d810d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:31.497238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-20f29a30-14dc-4991-b4d9-02ac68d810d6 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:31.498456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-20f29a30-14dc-4991-b4d9-02ac68d810d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:31.518102 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecafde-bdcd-472d-b93b-4133c4a1b252 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:31.564748 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:31.582866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 426/847] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:54:31.596419 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f125a64-cb08-4cc1-9a55-192990bb2bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:31.597518 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f125a64-cb08-4cc1-9a55-192990bb2bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:31.598002 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f125a64-cb08-4cc1-9a55-192990bb2bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:31.598483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f125a64-cb08-4cc1-9a55-192990bb2bf5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:31.608079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f125a64-cb08-4cc1-9a55-192990bb2bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:31.609887 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f125a64-cb08-4cc1-9a55-192990bb2bf5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-7f125a64-cb08-4cc1-9a55-192990bb2bf5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:31.623594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:31.624669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:31.625658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:31.625658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:31.625658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:31.625658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:31.625658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:31.625658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:31.625658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:31.625658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:31.625658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 20:54:31.625658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:31.629305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 422/848] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:54:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:31.635086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f29a30-14dc-4991-b4d9-02ac68d810d6 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:31.671361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:31.751132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f29a30-14dc-4991-b4d9-02ac68d810d6 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:31.766166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f125a64-cb08-4cc1-9a55-192990bb2bf5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:31.811896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ea8c4-68af-4bfe-ac86-9fd323e94cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:31.812550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ea8c4-68af-4bfe-ac86-9fd323e94cac None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:31.812834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ea8c4-68af-4bfe-ac86-9fd323e94cac None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:31.813133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ea8c4-68af-4bfe-ac86-9fd323e94cac None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:31.813871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ea8c4-68af-4bfe-ac86-9fd323e94cac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:31.814184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ea8c4-68af-4bfe-ac86-9fd323e94cac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:31.816154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ea8c4-68af-4bfe-ac86-9fd323e94cac None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:31.841085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 427/849] 10.222.0.17 () {56 vars in 1135 bytes} [Fri Aug 19 20:54:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:31.847105 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ea8c4-68af-4bfe-ac86-9fd323e94cac None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:31.951342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:31.955348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f125a64-cb08-4cc1-9a55-192990bb2bf5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:31.965898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ea8c4-68af-4bfe-ac86-9fd323e94cac None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:32.009266 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a7a70-b976-47be-b907-5e3f663d9516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:32.009890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7a70-b976-47be-b907-5e3f663d9516 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:32.010171 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7a70-b976-47be-b907-5e3f663d9516 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:32.010448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7a70-b976-47be-b907-5e3f663d9516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:32.011192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a00f4-f920-487b-b7db-8276fc6caa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:32.013393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a00f4-f920-487b-b7db-8276fc6caa8a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:32.013867 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a00f4-f920-487b-b7db-8276fc6caa8a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:32.014639 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a00f4-f920-487b-b7db-8276fc6caa8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:32.035158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a00f4-f920-487b-b7db-8276fc6caa8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-880a00f4-f920-487b-b7db-8276fc6caa8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:32.040411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:32.042237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 423/850] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:54:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:32.044987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b588e2-1c3b-4fe9-a533-15f9a50c218b None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:32.047521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b588e2-1c3b-4fe9-a533-15f9a50c218b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:32.047521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b588e2-1c3b-4fe9-a533-15f9a50c218b None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:32.047521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 424/851] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:32.048895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b588e2-1c3b-4fe9-a533-15f9a50c218b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:32.099202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:32.106875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a7a70-b976-47be-b907-5e3f663d9516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:32.109334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a7a70-b976-47be-b907-5e3f663d9516 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:32.165195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b588e2-1c3b-4fe9-a533-15f9a50c218b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:32.199893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:32.200985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e64b6-bd9a-44a2-952f-68863eb47832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:32.201683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e64b6-bd9a-44a2-952f-68863eb47832 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:32.201889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e64b6-bd9a-44a2-952f-68863eb47832 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:32.202178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e64b6-bd9a-44a2-952f-68863eb47832 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:32.202888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e64b6-bd9a-44a2-952f-68863eb47832 None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:32.203189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e64b6-bd9a-44a2-952f-68863eb47832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:32.204609 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e64b6-bd9a-44a2-952f-68863eb47832 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:32.213882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 425/852] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:54:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:32.215699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883aa15-ebee-41d0-bad1-bd9751cd8a24 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:32.215991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883aa15-ebee-41d0-bad1-bd9751cd8a24 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:32.216497 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883aa15-ebee-41d0-bad1-bd9751cd8a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:32.224518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 428/853] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:54:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 20:54:32.224518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a7a70-b976-47be-b907-5e3f663d9516 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:32.236220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7883aa15-ebee-41d0-bad1-bd9751cd8a24 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:32.237491 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7883aa15-ebee-41d0-bad1-bd9751cd8a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:32.315543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 426/854] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:32.317123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883aa15-ebee-41d0-bad1-bd9751cd8a24 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:32.349733 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a7a70-b976-47be-b907-5e3f663d9516 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:32.386870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:32.391989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cb3c3-bdd9-4e1e-81bc-7bcc5296e8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:32.392733 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cb3c3-bdd9-4e1e-81bc-7bcc5296e8d3 None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:32.393014 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cb3c3-bdd9-4e1e-81bc-7bcc5296e8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:32.393288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cb3c3-bdd9-4e1e-81bc-7bcc5296e8d3 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:32.393956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cb3c3-bdd9-4e1e-81bc-7bcc5296e8d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:32.395371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cb3c3-bdd9-4e1e-81bc-7bcc5296e8d3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:32.415244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 429/855] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:54:32 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:54:32.416689 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cb3c3-bdd9-4e1e-81bc-7bcc5296e8d3 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:32.500953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:32.529431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883aa15-ebee-41d0-bad1-bd9751cd8a24 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:32.594869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d102e-1c09-48f0-8061-809fbdfe6ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:32.594869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d102e-1c09-48f0-8061-809fbdfe6ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:32.594869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d102e-1c09-48f0-8061-809fbdfe6ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:32.594869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d102e-1c09-48f0-8061-809fbdfe6ec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:32.609124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d102e-1c09-48f0-8061-809fbdfe6ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:32.611294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d102e-1c09-48f0-8061-809fbdfe6ec3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:32.626161 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cb3c3-bdd9-4e1e-81bc-7bcc5296e8d3 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-074d102e-1c09-48f0-8061-809fbdfe6ec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:32.640766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:32.641833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:32.642872 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:32.642872 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:32.642872 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:32.643045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 427/856] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:32.649623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d102e-1c09-48f0-8061-809fbdfe6ec3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:32.681098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbca408-63a6-4aad-9e56-424f3aa28ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:32.682377 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbca408-63a6-4aad-9e56-424f3aa28ada None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:32.682904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbca408-63a6-4aad-9e56-424f3aa28ada None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:32.683358 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbca408-63a6-4aad-9e56-424f3aa28ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:32.698935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbca408-63a6-4aad-9e56-424f3aa28ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:32.702119 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbca408-63a6-4aad-9e56-424f3aa28ada None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-1cbca408-63a6-4aad-9e56-424f3aa28ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:32.722695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:32.723738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:32.724631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:32.724631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:32.724631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:32.727606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 430/857] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:32.738829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbca408-63a6-4aad-9e56-424f3aa28ada None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:32.786101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:32.809921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d102e-1c09-48f0-8061-809fbdfe6ec3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:32.855661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f530e-2523-4852-b358-5dadc6c17efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:32.856635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f530e-2523-4852-b358-5dadc6c17efc None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:32.857060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f530e-2523-4852-b358-5dadc6c17efc None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:32.857214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f530e-2523-4852-b358-5dadc6c17efc None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:32.857836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f530e-2523-4852-b358-5dadc6c17efc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:32.858570 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f530e-2523-4852-b358-5dadc6c17efc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:32.859619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f530e-2523-4852-b358-5dadc6c17efc None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:32.874831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 428/858] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:32.875578 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f530e-2523-4852-b358-5dadc6c17efc None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:32.937330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:32.951483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbca408-63a6-4aad-9e56-424f3aa28ada None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:33.013370 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a2a05-5917-42ef-a8a9-41a53c44eecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:33.015152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a2a05-5917-42ef-a8a9-41a53c44eecf None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:33.015654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a2a05-5917-42ef-a8a9-41a53c44eecf None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:33.016127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a2a05-5917-42ef-a8a9-41a53c44eecf None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:33.017941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a2a05-5917-42ef-a8a9-41a53c44eecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:33.018840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a2a05-5917-42ef-a8a9-41a53c44eecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:33.020499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f530e-2523-4852-b358-5dadc6c17efc None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:33.021515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a2a05-5917-42ef-a8a9-41a53c44eecf None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:33.051121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 431/859] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:33.052944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a2a05-5917-42ef-a8a9-41a53c44eecf None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:33.075202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38101464-5732-4162-a5e4-39e308a7a7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:33.076478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38101464-5732-4162-a5e4-39e308a7a7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:33.076758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38101464-5732-4162-a5e4-39e308a7a7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:33.077027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38101464-5732-4162-a5e4-39e308a7a7e6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:33.077805 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38101464-5732-4162-a5e4-39e308a7a7e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:33.079252 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38101464-5732-4162-a5e4-39e308a7a7e6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-38101464-5732-4162-a5e4-39e308a7a7e6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:33.089453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:33.090610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:33.091873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 429/860] 10.222.0.17 () {56 vars in 1132 bytes} [Fri Aug 19 20:54:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:33.092902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38101464-5732-4162-a5e4-39e308a7a7e6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:33.106375 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:33.221666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a2a05-5917-42ef-a8a9-41a53c44eecf None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:33.251235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38101464-5732-4162-a5e4-39e308a7a7e6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:33.268466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3511d8-6b40-440c-b4c8-eb964a10ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:33.269113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3511d8-6b40-440c-b4c8-eb964a10ee05 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:33.269410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3511d8-6b40-440c-b4c8-eb964a10ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:33.269681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3511d8-6b40-440c-b4c8-eb964a10ee05 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:33.284757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3511d8-6b40-440c-b4c8-eb964a10ee05 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:33.286208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3511d8-6b40-440c-b4c8-eb964a10ee05 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-cc3511d8-6b40-440c-b4c8-eb964a10ee05 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:33.299630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:33.300741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:33.302608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:33.302608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:33.302608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:33.302608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:33.302608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:33.302608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:33.302608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:33.302608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:33.302608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 20:54:33.302608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:33.302608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 432/861] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Aug 19 20:54:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:33.302608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3511d8-6b40-440c-b4c8-eb964a10ee05 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:33.311795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea8394-481c-4a07-8e2c-4e8fc6284611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:33.312783 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea8394-481c-4a07-8e2c-4e8fc6284611 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:33.313222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea8394-481c-4a07-8e2c-4e8fc6284611 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:33.313637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea8394-481c-4a07-8e2c-4e8fc6284611 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:33.322778 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea8394-481c-4a07-8e2c-4e8fc6284611 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:33.324661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea8394-481c-4a07-8e2c-4e8fc6284611 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:33.329613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-58ea8394-481c-4a07-8e2c-4e8fc6284611 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:33.342159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:33.344114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:33.347323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:33.347323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:33.347323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:33.347323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:33.347323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:33.347323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:33.347323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:33.347323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:33.347323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 430/862] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:33.347323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea8394-481c-4a07-8e2c-4e8fc6284611 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:33.430070 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:33.451719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3511d8-6b40-440c-b4c8-eb964a10ee05 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:33.476327 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea8394-481c-4a07-8e2c-4e8fc6284611 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:33.499572 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcf563-583f-47ed-8ec0-8fb40e310750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:33.500463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcf563-583f-47ed-8ec0-8fb40e310750 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:33.500897 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcf563-583f-47ed-8ec0-8fb40e310750 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:33.501307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcf563-583f-47ed-8ec0-8fb40e310750 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:33.502263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcf563-583f-47ed-8ec0-8fb40e310750 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:33.502751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcf563-583f-47ed-8ec0-8fb40e310750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:33.505171 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcf563-583f-47ed-8ec0-8fb40e310750 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:33.513716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 433/863] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Aug 19 20:54:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:33.515217 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcf563-583f-47ed-8ec0-8fb40e310750 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:33.521927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981901fa-1013-4944-a8c3-4e842ab98a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:33.522548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981901fa-1013-4944-a8c3-4e842ab98a16 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:33.522868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981901fa-1013-4944-a8c3-4e842ab98a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:33.523144 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981901fa-1013-4944-a8c3-4e842ab98a16 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:33.523895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981901fa-1013-4944-a8c3-4e842ab98a16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:33.524202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981901fa-1013-4944-a8c3-4e842ab98a16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:33.525642 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981901fa-1013-4944-a8c3-4e842ab98a16 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:33.550421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 431/864] 10.222.0.17 () {56 vars in 1149 bytes} [Fri Aug 19 20:54:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:33.550421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981901fa-1013-4944-a8c3-4e842ab98a16 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:33.646710 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:33.670409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981901fa-1013-4944-a8c3-4e842ab98a16 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:33.677201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcf563-583f-47ed-8ec0-8fb40e310750 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:33.698933 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:33.717250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a7f8a-c1d5-4973-b131-d22615ecacfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:33.717992 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a7f8a-c1d5-4973-b131-d22615ecacfa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:33.718273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a7f8a-c1d5-4973-b131-d22615ecacfa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:33.718551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a7f8a-c1d5-4973-b131-d22615ecacfa None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:33.719353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a7f8a-c1d5-4973-b131-d22615ecacfa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:33.719658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a7f8a-c1d5-4973-b131-d22615ecacfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:33.721041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a7f8a-c1d5-4973-b131-d22615ecacfa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:33.726486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 432/865] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Aug 19 20:54:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:33.727638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a7f8a-c1d5-4973-b131-d22615ecacfa None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:33.739787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c8e9d-e4a5-485c-a683-b0cd35434934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:33.740458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c8e9d-e4a5-485c-a683-b0cd35434934 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:33.740782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c8e9d-e4a5-485c-a683-b0cd35434934 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:33.741620 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c8e9d-e4a5-485c-a683-b0cd35434934 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:33.741804 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c8e9d-e4a5-485c-a683-b0cd35434934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:33.742077 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c8e9d-e4a5-485c-a683-b0cd35434934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:33.743730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c8e9d-e4a5-485c-a683-b0cd35434934 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:33.765266 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 434/866] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:33.766246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c8e9d-e4a5-485c-a683-b0cd35434934 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:33.888824 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a7f8a-c1d5-4973-b131-d22615ecacfa None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:33.944711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c8e9d-e4a5-485c-a683-b0cd35434934 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:33.951466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64922352-abbb-4268-8dcc-314a3161cf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:33.952392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64922352-abbb-4268-8dcc-314a3161cf85 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:33.952742 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64922352-abbb-4268-8dcc-314a3161cf85 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:33.953204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64922352-abbb-4268-8dcc-314a3161cf85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:33.996857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfd01e-9aa9-4cff-aaa7-280fc9252881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:33.997630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfd01e-9aa9-4cff-aaa7-280fc9252881 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:33.997914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfd01e-9aa9-4cff-aaa7-280fc9252881 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:33.998279 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfd01e-9aa9-4cff-aaa7-280fc9252881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:33.999718 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfd01e-9aa9-4cff-aaa7-280fc9252881 None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=6fbfc93e45704b3ba2e5a4bcf7568a14) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:34.000042 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfd01e-9aa9-4cff-aaa7-280fc9252881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:34.001987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfd01e-9aa9-4cff-aaa7-280fc9252881 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:34.018792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 435/867] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:54:33 2022] GET /identity/v3/role_assignments?user.id=6fbfc93e45704b3ba2e5a4bcf7568a14&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:34.053748 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:34.073275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64922352-abbb-4268-8dcc-314a3161cf85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:34.076011 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64922352-abbb-4268-8dcc-314a3161cf85 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:34.254281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 433/868] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:54:33 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:54:34.259853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfd01e-9aa9-4cff-aaa7-280fc9252881 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:34.267122 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:34.386428 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfd01e-9aa9-4cff-aaa7-280fc9252881 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:34.425591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcfec8-b4b0-4d1e-99f9-7366862761f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:34.426644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcfec8-b4b0-4d1e-99f9-7366862761f1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:34.427180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcfec8-b4b0-4d1e-99f9-7366862761f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:34.427664 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcfec8-b4b0-4d1e-99f9-7366862761f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:34.441256 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcfec8-b4b0-4d1e-99f9-7366862761f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:34.443169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcfec8-b4b0-4d1e-99f9-7366862761f1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-7fdcfec8-b4b0-4d1e-99f9-7366862761f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:34.461166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:34.462630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:34.463606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:34.463606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:34.463606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:34.467004 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 436/869] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:34.472869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64922352-abbb-4268-8dcc-314a3161cf85 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:34.645945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:34.651096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b269a40-74d9-4d3d-ab21-cb3cffe16c36 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:34.651674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b269a40-74d9-4d3d-ab21-cb3cffe16c36 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:34.651950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b269a40-74d9-4d3d-ab21-cb3cffe16c36 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:34.654479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 437/870] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:34.660545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf449c-038c-46fb-821d-cefc51aee490 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:34.661152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf449c-038c-46fb-821d-cefc51aee490 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:34.661703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf449c-038c-46fb-821d-cefc51aee490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:34.673447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64922352-abbb-4268-8dcc-314a3161cf85 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:34.682160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-3daf449c-038c-46fb-821d-cefc51aee490 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:34.684445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3daf449c-038c-46fb-821d-cefc51aee490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:34.733668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e9a42-aa0b-4f24-8491-85cd303365fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:34.734664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e9a42-aa0b-4f24-8491-85cd303365fa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:34.735180 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e9a42-aa0b-4f24-8491-85cd303365fa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:34.735662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e9a42-aa0b-4f24-8491-85cd303365fa None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:34.736609 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e9a42-aa0b-4f24-8491-85cd303365fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:34.737115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e9a42-aa0b-4f24-8491-85cd303365fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:34.738727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e9a42-aa0b-4f24-8491-85cd303365fa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:34.755369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 434/871] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:34.766852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e9a42-aa0b-4f24-8491-85cd303365fa None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:34.781411 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:34.832569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 438/872] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:34 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:54:34.901649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e9a42-aa0b-4f24-8491-85cd303365fa None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:34.942848 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f5f60-5866-4a7a-82cc-797ec887d37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:34.943518 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f5f60-5866-4a7a-82cc-797ec887d37d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:34.943791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f5f60-5866-4a7a-82cc-797ec887d37d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:34.944065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f5f60-5866-4a7a-82cc-797ec887d37d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:34.953243 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f5f60-5866-4a7a-82cc-797ec887d37d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:34.954761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f5f60-5866-4a7a-82cc-797ec887d37d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-d41f5f60-5866-4a7a-82cc-797ec887d37d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:34.968112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:34.969731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:34.971492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:34.971492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:34.971492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:34.971492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:34.971492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:34.971492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:34.971492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:34.971492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:34.974399 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 435/873] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:34.975887 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf449c-038c-46fb-821d-cefc51aee490 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:35.108967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f5f60-5866-4a7a-82cc-797ec887d37d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:35.122357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:35.146971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf449c-038c-46fb-821d-cefc51aee490 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:35.185035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b53da4-c0db-4fe5-9e35-d5c41ba2160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:35.185642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b53da4-c0db-4fe5-9e35-d5c41ba2160f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:35.185881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b53da4-c0db-4fe5-9e35-d5c41ba2160f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:35.186162 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b53da4-c0db-4fe5-9e35-d5c41ba2160f None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:35.186917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b53da4-c0db-4fe5-9e35-d5c41ba2160f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:35.187231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b53da4-c0db-4fe5-9e35-d5c41ba2160f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:35.188709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b53da4-c0db-4fe5-9e35-d5c41ba2160f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:35.207395 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 439/874] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:35.209938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b53da4-c0db-4fe5-9e35-d5c41ba2160f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:35.239375 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f5f60-5866-4a7a-82cc-797ec887d37d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:35.286167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:35.287020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705b8de-09f2-487d-b880-d5bc31219801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:35.287972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705b8de-09f2-487d-b880-d5bc31219801 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:35.288414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705b8de-09f2-487d-b880-d5bc31219801 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:35.288783 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705b8de-09f2-487d-b880-d5bc31219801 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:35.289765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705b8de-09f2-487d-b880-d5bc31219801 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:35.291465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705b8de-09f2-487d-b880-d5bc31219801 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-9705b8de-09f2-487d-b880-d5bc31219801 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:35.303261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:35.304458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 20:54:35.305319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:35.306817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 436/875] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:54:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:35.312065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705b8de-09f2-487d-b880-d5bc31219801 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:35.369750 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b53da4-c0db-4fe5-9e35-d5c41ba2160f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:35.407274 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:35.420947 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853298ca-8ae0-46a9-85d5-3b07436a2ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:35.422082 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853298ca-8ae0-46a9-85d5-3b07436a2ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:35.423095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853298ca-8ae0-46a9-85d5-3b07436a2ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:35.423583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853298ca-8ae0-46a9-85d5-3b07436a2ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:35.424753 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853298ca-8ae0-46a9-85d5-3b07436a2ab3 None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=b9f8b86c01084a09bb8eac50eddfa0a1) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:35.425277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853298ca-8ae0-46a9-85d5-3b07436a2ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:35.427539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853298ca-8ae0-46a9-85d5-3b07436a2ab3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:35.443375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 440/876] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:54:35 2022] GET /identity/v3/role_assignments?user.id=b9f8b86c01084a09bb8eac50eddfa0a1&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:35.451149 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705b8de-09f2-487d-b880-d5bc31219801 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:35.492581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126047fa-cebc-4886-824b-45dd875cb237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:35.493231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126047fa-cebc-4886-824b-45dd875cb237 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:35.493492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126047fa-cebc-4886-824b-45dd875cb237 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:35.493759 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126047fa-cebc-4886-824b-45dd875cb237 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:35.494418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126047fa-cebc-4886-824b-45dd875cb237 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:35.494836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126047fa-cebc-4886-824b-45dd875cb237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:35.496877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126047fa-cebc-4886-824b-45dd875cb237 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:35.502993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 437/877] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:54:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:35.509971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853298ca-8ae0-46a9-85d5-3b07436a2ab3 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:35.633960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853298ca-8ae0-46a9-85d5-3b07436a2ab3 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:35.651847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:35.677572 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa8ad1-daee-4aa6-be22-60d9a02cf17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:35.678200 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa8ad1-daee-4aa6-be22-60d9a02cf17c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:35.678503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa8ad1-daee-4aa6-be22-60d9a02cf17c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:35.678818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa8ad1-daee-4aa6-be22-60d9a02cf17c None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:35.679444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa8ad1-daee-4aa6-be22-60d9a02cf17c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:35.679747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa8ad1-daee-4aa6-be22-60d9a02cf17c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:35.681154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa8ad1-daee-4aa6-be22-60d9a02cf17c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:35.688697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 441/878] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:54:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:35.694390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126047fa-cebc-4886-824b-45dd875cb237 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:35.838392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126047fa-cebc-4886-824b-45dd875cb237 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:35.882843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc23737-a536-4e14-a6de-ac0e6d179fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:35.883472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc23737-a536-4e14-a6de-ac0e6d179fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:35.883755 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc23737-a536-4e14-a6de-ac0e6d179fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:35.884025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc23737-a536-4e14-a6de-ac0e6d179fe1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:35.884750 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc23737-a536-4e14-a6de-ac0e6d179fe1 None admin] RBAC: Adding query filter params (interface=public, service_id=5774ce4f0ff541f0a23dcc658f002fc8, region_id=RegionOne) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:35.885060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc23737-a536-4e14-a6de-ac0e6d179fe1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:35.886444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc23737-a536-4e14-a6de-ac0e6d179fe1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:35.891943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:35.896179 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 438/879] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Aug 19 20:54:35 2022] GET /identity/v3/endpoints?service_id=5774ce4f0ff541f0a23dcc658f002fc8&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:35.905084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa8ad1-daee-4aa6-be22-60d9a02cf17c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:36.100422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa8ad1-daee-4aa6-be22-60d9a02cf17c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:36.173757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c915-8475-441d-994a-2145d6d017e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:36.174836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c915-8475-441d-994a-2145d6d017e0 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:36.175353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c915-8475-441d-994a-2145d6d017e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:36.175847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c915-8475-441d-994a-2145d6d017e0 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:36.176699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010c915-8475-441d-994a-2145d6d017e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:36.178352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010c915-8475-441d-994a-2145d6d017e0 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:36.185706 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 442/880] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Aug 19 20:54:35 2022] GET /identity/v3/services => generated 1011 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 20:54:36.583918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de739b69-9e14-4c96-a02f-6450040d9601 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:36.584750 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de739b69-9e14-4c96-a02f-6450040d9601 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:36.584897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de739b69-9e14-4c96-a02f-6450040d9601 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:36.587748 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 439/881] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:36.596085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c23a73-7b86-48a6-8571-06e5a6461eea None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:36.596871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c23a73-7b86-48a6-8571-06e5a6461eea None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:36.596871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c23a73-7b86-48a6-8571-06e5a6461eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:36.615850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-31c23a73-7b86-48a6-8571-06e5a6461eea None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:36.617049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-31c23a73-7b86-48a6-8571-06e5a6461eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:36.650614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:36.693073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 443/882] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:36.978929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de739b69-9e14-4c96-a02f-6450040d9601 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:37.144963 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de739b69-9e14-4c96-a02f-6450040d9601 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:37.207186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cafc1-fef6-4372-bb0d-f62f2b05436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:37.208211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cafc1-fef6-4372-bb0d-f62f2b05436c None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:37.208698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cafc1-fef6-4372-bb0d-f62f2b05436c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:37.209186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cafc1-fef6-4372-bb0d-f62f2b05436c None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:37.210340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cafc1-fef6-4372-bb0d-f62f2b05436c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:37.212871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cafc1-fef6-4372-bb0d-f62f2b05436c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:37.243264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 440/883] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:54:36 2022] POST /identity/v3/services => generated 269 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:54:37.297201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd386b8-d5cf-4cb7-810b-06cb4463fc87 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:37.297683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd386b8-d5cf-4cb7-810b-06cb4463fc87 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:37.298168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd386b8-d5cf-4cb7-810b-06cb4463fc87 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:37.301264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 444/884] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:54:37.309507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75197cac-6e03-4dcc-b8a2-af1ebfa4a32e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:37.310006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75197cac-6e03-4dcc-b8a2-af1ebfa4a32e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:37.310560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75197cac-6e03-4dcc-b8a2-af1ebfa4a32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:37.343917 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-75197cac-6e03-4dcc-b8a2-af1ebfa4a32e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:37.346064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-75197cac-6e03-4dcc-b8a2-af1ebfa4a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:37.456607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:37.475543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 441/885] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:37.844086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd386b8-d5cf-4cb7-810b-06cb4463fc87 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:37.935055 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faae8b-2e5a-4fa4-be00-9abdf7a0037d None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:37.935859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faae8b-2e5a-4fa4-be00-9abdf7a0037d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:37.935859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faae8b-2e5a-4fa4-be00-9abdf7a0037d None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:37.937276 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 442/886] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:37.943027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b748fa-24b4-422e-92a7-32fb3f62dd31 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:37.943308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b748fa-24b4-422e-92a7-32fb3f62dd31 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:37.943591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b748fa-24b4-422e-92a7-32fb3f62dd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:37.963740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d0b748fa-24b4-422e-92a7-32fb3f62dd31 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:37.965163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d0b748fa-24b4-422e-92a7-32fb3f62dd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:37.969505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd386b8-d5cf-4cb7-810b-06cb4463fc87 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:38.017999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec16b7-a89f-4727-a51c-fc0132205e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:38.019164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec16b7-a89f-4727-a51c-fc0132205e84 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:38.019623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec16b7-a89f-4727-a51c-fc0132205e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:38.020098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec16b7-a89f-4727-a51c-fc0132205e84 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:38.020864 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec16b7-a89f-4727-a51c-fc0132205e84 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:38.023366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec16b7-a89f-4727-a51c-fc0132205e84 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-b1ec16b7-a89f-4727-a51c-fc0132205e84 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:38.035569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:38.036857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:38.037853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:38.041225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 445/887] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Aug 19 20:54:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:38.047841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec16b7-a89f-4727-a51c-fc0132205e84 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:38.064569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 443/888] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:38.086967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:38.176195 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec16b7-a89f-4727-a51c-fc0132205e84 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:38.218385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ef97d-688e-47cc-99c4-ecebafc86d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:38.219358 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ef97d-688e-47cc-99c4-ecebafc86d3d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:38.219828 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ef97d-688e-47cc-99c4-ecebafc86d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:38.220317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ef97d-688e-47cc-99c4-ecebafc86d3d None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:38.221146 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ef97d-688e-47cc-99c4-ecebafc86d3d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:38.221641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ef97d-688e-47cc-99c4-ecebafc86d3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:38.223255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ef97d-688e-47cc-99c4-ecebafc86d3d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:38.234137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 446/889] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Aug 19 20:54:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:38.239890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b748fa-24b4-422e-92a7-32fb3f62dd31 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:38.395357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b748fa-24b4-422e-92a7-32fb3f62dd31 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:38.435973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:38.452848 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2a115-87d1-42ba-8229-4f03049a9c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:38.453499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a115-87d1-42ba-8229-4f03049a9c27 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:38.453779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a115-87d1-42ba-8229-4f03049a9c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:38.454057 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a115-87d1-42ba-8229-4f03049a9c27 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:38.454859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2a115-87d1-42ba-8229-4f03049a9c27 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:38.455169 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2a115-87d1-42ba-8229-4f03049a9c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:38.456673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2a115-87d1-42ba-8229-4f03049a9c27 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:38.462374 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 444/890] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Aug 19 20:54:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:38.535634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ef97d-688e-47cc-99c4-ecebafc86d3d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:38.581086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9dc7d-030a-4e7a-a30c-09c509b18314 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:38.581382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9dc7d-030a-4e7a-a30c-09c509b18314 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:38.581682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9dc7d-030a-4e7a-a30c-09c509b18314 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:38.583393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 445/891] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:54:38.589239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bb239-3adf-46a0-8a8f-d56839b35a40 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:38.589676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bb239-3adf-46a0-8a8f-d56839b35a40 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:38.589831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bb239-3adf-46a0-8a8f-d56839b35a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:38.611306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1a2bb239-3adf-46a0-8a8f-d56839b35a40 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:38.612593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1a2bb239-3adf-46a0-8a8f-d56839b35a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:38.724831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:38.731594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 446/892] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:54:38.731927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ef97d-688e-47cc-99c4-ecebafc86d3d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:38.782654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a979c4-075b-4fe2-91a3-5117979fcad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:38.784210 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a979c4-075b-4fe2-91a3-5117979fcad2 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:38.784979 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a979c4-075b-4fe2-91a3-5117979fcad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:38.785765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a979c4-075b-4fe2-91a3-5117979fcad2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:38.806176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a979c4-075b-4fe2-91a3-5117979fcad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-26a979c4-075b-4fe2-91a3-5117979fcad2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:38.817286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:38.819205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:38.821600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:38.821600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:38.821600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:38.821600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:38.821600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:38.821600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:38.821600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:38.821600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:38.821600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:38.821600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:38.821600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 20:54:38.821600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:38.826525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 447/893] 10.222.0.17 () {56 vars in 1120 bytes} [Fri Aug 19 20:54:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:38.835443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bb239-3adf-46a0-8a8f-d56839b35a40 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:39.013910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bb239-3adf-46a0-8a8f-d56839b35a40 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:39.034088 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:39.063770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a979c4-075b-4fe2-91a3-5117979fcad2 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:39.086626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4c408-589f-403e-a9b6-4a892c0dbfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:39.088086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4c408-589f-403e-a9b6-4a892c0dbfcd None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:39.088952 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4c408-589f-403e-a9b6-4a892c0dbfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:39.090194 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4c408-589f-403e-a9b6-4a892c0dbfcd None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:39.092069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4c408-589f-403e-a9b6-4a892c0dbfcd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:39.093042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4c408-589f-403e-a9b6-4a892c0dbfcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:39.096467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4c408-589f-403e-a9b6-4a892c0dbfcd None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:39.118625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 447/894] 10.222.0.17 () {56 vars in 1115 bytes} [Fri Aug 19 20:54:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:39.125113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4c408-589f-403e-a9b6-4a892c0dbfcd None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:39.181202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a979c4-075b-4fe2-91a3-5117979fcad2 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:39.220454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020d744-4fa1-4bfd-b8af-c8f5b1de73e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:39.220989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d744-4fa1-4bfd-b8af-c8f5b1de73e0 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:39.221275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d744-4fa1-4bfd-b8af-c8f5b1de73e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:39.221552 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d744-4fa1-4bfd-b8af-c8f5b1de73e0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:39.222212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020d744-4fa1-4bfd-b8af-c8f5b1de73e0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:39.223636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020d744-4fa1-4bfd-b8af-c8f5b1de73e0 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-c020d744-4fa1-4bfd-b8af-c8f5b1de73e0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:39.234185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:39.236167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 20:54:39.237827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:39.240159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 448/895] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:54:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:39.241202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020d744-4fa1-4bfd-b8af-c8f5b1de73e0 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:39.267202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:39.320172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4c408-589f-403e-a9b6-4a892c0dbfcd None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:39.357274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020d744-4fa1-4bfd-b8af-c8f5b1de73e0 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:39.385271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0aed4-8b45-4426-b38b-2e7de2301317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:39.387398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0aed4-8b45-4426-b38b-2e7de2301317 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:39.388149 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0aed4-8b45-4426-b38b-2e7de2301317 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:39.388895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0aed4-8b45-4426-b38b-2e7de2301317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:39.396657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3e4c2-e724-4e7e-90eb-cf86bda1e881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:39.397284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e4c2-e724-4e7e-90eb-cf86bda1e881 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:39.397557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e4c2-e724-4e7e-90eb-cf86bda1e881 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:39.397833 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e4c2-e724-4e7e-90eb-cf86bda1e881 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:39.398475 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3e4c2-e724-4e7e-90eb-cf86bda1e881 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:39.398802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3e4c2-e724-4e7e-90eb-cf86bda1e881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:39.400182 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3e4c2-e724-4e7e-90eb-cf86bda1e881 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:39.411539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 449/896] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:54:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:39.412520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3e4c2-e724-4e7e-90eb-cf86bda1e881 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:39.413167 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0aed4-8b45-4426-b38b-2e7de2301317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:39.416172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0aed4-8b45-4426-b38b-2e7de2301317 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f9a0aed4-8b45-4426-b38b-2e7de2301317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:39.444886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:39.446652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:39.448725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:39.448725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:39.448725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:39.459120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 448/897] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:39.462263 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0aed4-8b45-4426-b38b-2e7de2301317 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:39.510356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:39.512770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:39.533256 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3e4c2-e724-4e7e-90eb-cf86bda1e881 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:39.572903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73890dc-4376-4a3f-96df-6d8fad2bb9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:39.573792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73890dc-4376-4a3f-96df-6d8fad2bb9ab None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:39.574808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73890dc-4376-4a3f-96df-6d8fad2bb9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:39.575543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73890dc-4376-4a3f-96df-6d8fad2bb9ab None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:39.576481 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73890dc-4376-4a3f-96df-6d8fad2bb9ab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:39.576993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73890dc-4376-4a3f-96df-6d8fad2bb9ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:39.578537 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73890dc-4376-4a3f-96df-6d8fad2bb9ab None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:39.589446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 450/898] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Aug 19 20:54:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:39.591692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73890dc-4376-4a3f-96df-6d8fad2bb9ab None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:39.655867 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0aed4-8b45-4426-b38b-2e7de2301317 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:39.707644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73890dc-4376-4a3f-96df-6d8fad2bb9ab None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:39.718004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b325d8a-be72-4211-bada-c25045117e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:39.719090 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b325d8a-be72-4211-bada-c25045117e1b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:39.719593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b325d8a-be72-4211-bada-c25045117e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:39.720090 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b325d8a-be72-4211-bada-c25045117e1b None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:39.721151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b325d8a-be72-4211-bada-c25045117e1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:39.721722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b325d8a-be72-4211-bada-c25045117e1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:39.724051 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b325d8a-be72-4211-bada-c25045117e1b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:39.751094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 449/899] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:39.754207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b325d8a-be72-4211-bada-c25045117e1b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:39.761118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b322b-11e7-4ec9-870e-9c10d258ef45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:39.761118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b322b-11e7-4ec9-870e-9c10d258ef45 None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:39.761625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b322b-11e7-4ec9-870e-9c10d258ef45 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:39.761791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b322b-11e7-4ec9-870e-9c10d258ef45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:39.762438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b322b-11e7-4ec9-870e-9c10d258ef45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:39.764058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b322b-11e7-4ec9-870e-9c10d258ef45 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:39.798998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 451/900] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 20:54:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:54:39.939149 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:39.948084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b325d8a-be72-4211-bada-c25045117e1b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:39.992179 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0895b6-f5b3-4cdd-8a6f-b18c71fb6578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:39.992835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0895b6-f5b3-4cdd-8a6f-b18c71fb6578 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:39.993113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0895b6-f5b3-4cdd-8a6f-b18c71fb6578 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:39.993385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0895b6-f5b3-4cdd-8a6f-b18c71fb6578 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:40.001930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0895b6-f5b3-4cdd-8a6f-b18c71fb6578 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:40.003466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0895b6-f5b3-4cdd-8a6f-b18c71fb6578 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-af0895b6-f5b3-4cdd-8a6f-b18c71fb6578 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:40.017671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:40.019157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:40.020104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:40.020104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:40.020104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:40.020104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:40.020104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:40.020104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:40.020104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:40.020104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:40.020104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 20:54:40.020104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:40.020104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 450/901] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Aug 19 20:54:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:40.024917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b322b-11e7-4ec9-870e-9c10d258ef45 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:40.030769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:40.130670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bab6b-ee5a-4375-bff4-5610a74745c3 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:40.131447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bab6b-ee5a-4375-bff4-5610a74745c3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:40.131915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bab6b-ee5a-4375-bff4-5610a74745c3 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:40.139098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 451/902] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:54:40.144242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ba17b-58be-46ba-b3b0-fdd4a871139a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:40.144412 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b322b-11e7-4ec9-870e-9c10d258ef45 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:40.145012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ba17b-58be-46ba-b3b0-fdd4a871139a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:40.145610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ba17b-58be-46ba-b3b0-fdd4a871139a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:40.176255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-162ba17b-58be-46ba-b3b0-fdd4a871139a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:40.178311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-162ba17b-58be-46ba-b3b0-fdd4a871139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:40.186570 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb01fb-177d-489b-ad78-b575f2b1e963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:40.187232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb01fb-177d-489b-ad78-b575f2b1e963 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:40.187513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb01fb-177d-489b-ad78-b575f2b1e963 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:40.187789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb01fb-177d-489b-ad78-b575f2b1e963 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:40.188534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb01fb-177d-489b-ad78-b575f2b1e963 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:40.188846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb01fb-177d-489b-ad78-b575f2b1e963 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:40.190287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb01fb-177d-489b-ad78-b575f2b1e963 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:40.216732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 452/903] 10.222.0.17 () {56 vars in 1149 bytes} [Fri Aug 19 20:54:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:40.224801 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb01fb-177d-489b-ad78-b575f2b1e963 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:40.279736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 452/904] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:54:40.323133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:40.369319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb01fb-177d-489b-ad78-b575f2b1e963 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:40.409724 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef3c71-8446-4a58-998c-bcc05fedecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:40.410576 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef3c71-8446-4a58-998c-bcc05fedecfb None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:40.411131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef3c71-8446-4a58-998c-bcc05fedecfb None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:40.411557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef3c71-8446-4a58-998c-bcc05fedecfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:40.530197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef3c71-8446-4a58-998c-bcc05fedecfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:40.532804 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef3c71-8446-4a58-998c-bcc05fedecfb None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:40.659118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:40.718228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 453/905] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:54:40 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:54:40.723827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ba17b-58be-46ba-b3b0-fdd4a871139a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:40.778919 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef3c71-8446-4a58-998c-bcc05fedecfb None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:40.818962 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:40.860385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ba17b-58be-46ba-b3b0-fdd4a871139a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:40.919762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570049-d589-4242-9c75-83b09397a906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:40.922563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570049-d589-4242-9c75-83b09397a906 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:40.923776 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570049-d589-4242-9c75-83b09397a906 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:40.924530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570049-d589-4242-9c75-83b09397a906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:40.939899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb570049-d589-4242-9c75-83b09397a906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:40.940951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb570049-d589-4242-9c75-83b09397a906 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-bb570049-d589-4242-9c75-83b09397a906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:40.959036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:40.960884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:40.963211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:40.963211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:40.963211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:40.965435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 453/906] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:40.966536 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570049-d589-4242-9c75-83b09397a906 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:40.999093 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef3c71-8446-4a58-998c-bcc05fedecfb None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:41.062632 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71615c-615c-4f35-9ef4-87dc58cd6418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:41.064643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71615c-615c-4f35-9ef4-87dc58cd6418 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:41.066061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71615c-615c-4f35-9ef4-87dc58cd6418 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:41.067170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71615c-615c-4f35-9ef4-87dc58cd6418 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:41.068819 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71615c-615c-4f35-9ef4-87dc58cd6418 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:41.072679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71615c-615c-4f35-9ef4-87dc58cd6418 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-aa71615c-615c-4f35-9ef4-87dc58cd6418 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:41.084846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:41.086623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 20:54:41.089049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:41.093505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 454/907] 10.222.0.17 () {56 vars in 1132 bytes} [Fri Aug 19 20:54:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:41.095052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71615c-615c-4f35-9ef4-87dc58cd6418 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:41.128505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:41.176438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570049-d589-4242-9c75-83b09397a906 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:41.216202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:41.230991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71615c-615c-4f35-9ef4-87dc58cd6418 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:41.240668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46986392-9c4d-4921-8826-6d2b383b738c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:41.241317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986392-9c4d-4921-8826-6d2b383b738c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:41.241599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986392-9c4d-4921-8826-6d2b383b738c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:41.241874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986392-9c4d-4921-8826-6d2b383b738c None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:41.242587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46986392-9c4d-4921-8826-6d2b383b738c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:41.242946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46986392-9c4d-4921-8826-6d2b383b738c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:41.244331 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46986392-9c4d-4921-8826-6d2b383b738c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:41.267141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 454/908] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:41.276310 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46986392-9c4d-4921-8826-6d2b383b738c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:41.288438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4c0b5-d9a1-4a10-a084-dde540351b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:41.289069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4c0b5-d9a1-4a10-a084-dde540351b19 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:41.289352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4c0b5-d9a1-4a10-a084-dde540351b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:41.289631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4c0b5-d9a1-4a10-a084-dde540351b19 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:41.290282 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4c0b5-d9a1-4a10-a084-dde540351b19 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:41.290567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4c0b5-d9a1-4a10-a084-dde540351b19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:41.292012 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4c0b5-d9a1-4a10-a084-dde540351b19 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:41.298640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 455/909] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Aug 19 20:54:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:41.304815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4c0b5-d9a1-4a10-a084-dde540351b19 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:41.416495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:41.428794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4c0b5-d9a1-4a10-a084-dde540351b19 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:41.469267 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8f34b-0b65-4e99-a546-ddecba12ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:41.470242 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8f34b-0b65-4e99-a546-ddecba12ab1c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:41.470878 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8f34b-0b65-4e99-a546-ddecba12ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:41.471338 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8f34b-0b65-4e99-a546-ddecba12ab1c None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:41.472194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8f34b-0b65-4e99-a546-ddecba12ab1c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:41.472634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8f34b-0b65-4e99-a546-ddecba12ab1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:41.474163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8f34b-0b65-4e99-a546-ddecba12ab1c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:41.485997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 456/910] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Aug 19 20:54:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:41.486638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46986392-9c4d-4921-8826-6d2b383b738c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:41.487498 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8f34b-0b65-4e99-a546-ddecba12ab1c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:41.555553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff0943-bba5-4498-a03d-4528635d91a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:41.556739 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff0943-bba5-4498-a03d-4528635d91a4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:41.557362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff0943-bba5-4498-a03d-4528635d91a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:41.558011 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff0943-bba5-4498-a03d-4528635d91a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:41.572638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff0943-bba5-4498-a03d-4528635d91a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:41.575954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff0943-bba5-4498-a03d-4528635d91a4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-d6ff0943-bba5-4498-a03d-4528635d91a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:41.598714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:41.599861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:41.600922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:41.600922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:41.600922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:41.600922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:41.600922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:41.600922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:41.600922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:41.600922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:41.610922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 455/911] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:41.613997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8f34b-0b65-4e99-a546-ddecba12ab1c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:41.614564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff0943-bba5-4498-a03d-4528635d91a4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:41.657345 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd1399-a885-4678-b561-f7dda482a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:41.658375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd1399-a885-4678-b561-f7dda482a236 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:41.658870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd1399-a885-4678-b561-f7dda482a236 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:41.659297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd1399-a885-4678-b561-f7dda482a236 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:41.660165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd1399-a885-4678-b561-f7dda482a236 None admin] RBAC: Adding query filter params (interface=public, service_id=55f3c25095414d3e91b220a2eb96a641, region_id=RegionOne) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:41.660693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd1399-a885-4678-b561-f7dda482a236 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:41.662270 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd1399-a885-4678-b561-f7dda482a236 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:41.673716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 457/912] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Aug 19 20:54:41 2022] GET /identity/v3/endpoints?service_id=55f3c25095414d3e91b220a2eb96a641&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:41.673716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f9127-a7b9-4b68-a4b0-8a03d1c564c4 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:41.673716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f9127-a7b9-4b68-a4b0-8a03d1c564c4 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:41.673716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f9127-a7b9-4b68-a4b0-8a03d1c564c4 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:41.674875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 458/913] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:41.675974 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f9127-a7b9-4b68-a4b0-8a03d1c564c4 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:41.700273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:41.710862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:41.785323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff0943-bba5-4498-a03d-4528635d91a4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:41.824553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dba6f-3121-41ca-b582-59ab318eeecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:41.825508 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dba6f-3121-41ca-b582-59ab318eeecf None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:41.825933 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dba6f-3121-41ca-b582-59ab318eeecf None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:41.826365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dba6f-3121-41ca-b582-59ab318eeecf None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:41.827315 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dba6f-3121-41ca-b582-59ab318eeecf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:41.827770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dba6f-3121-41ca-b582-59ab318eeecf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:41.829352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dba6f-3121-41ca-b582-59ab318eeecf None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:41.849049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f9127-a7b9-4b68-a4b0-8a03d1c564c4 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:41.853267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 456/914] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:41.856081 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027e1e3-96bf-43d2-b270-eeb7430ad1b8 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:41.856516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027e1e3-96bf-43d2-b270-eeb7430ad1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:41.856971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027e1e3-96bf-43d2-b270-eeb7430ad1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:41.887222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f027e1e3-96bf-43d2-b270-eeb7430ad1b8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:41.889101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f027e1e3-96bf-43d2-b270-eeb7430ad1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:41.889349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2cb0-055b-4812-9532-51ebfaa69d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:41.890177 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2cb0-055b-4812-9532-51ebfaa69d03 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:41.890603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2cb0-055b-4812-9532-51ebfaa69d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:41.891063 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2cb0-055b-4812-9532-51ebfaa69d03 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:41.891815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d2cb0-055b-4812-9532-51ebfaa69d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:41.893434 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d2cb0-055b-4812-9532-51ebfaa69d03 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:41.900126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 459/915] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Aug 19 20:54:41 2022] GET /identity/v3/services => generated 1268 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 20:54:41.901210 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2cb0-055b-4812-9532-51ebfaa69d03 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:42.038775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 457/916] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:42.054106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:42.077654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2cb0-055b-4812-9532-51ebfaa69d03 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:42.140664 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc5d34-a1f5-41eb-b182-74a9c1556fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:42.141965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc5d34-a1f5-41eb-b182-74a9c1556fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:42.142585 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc5d34-a1f5-41eb-b182-74a9c1556fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:42.143237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc5d34-a1f5-41eb-b182-74a9c1556fe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:42.144712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc5d34-a1f5-41eb-b182-74a9c1556fe8 None admin] RBAC: Adding query filter params (role.id=2acaf26ecd8a4392aac8a20d15f672ad, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=b9f8b86c01084a09bb8eac50eddfa0a1) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:42.145371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc5d34-a1f5-41eb-b182-74a9c1556fe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:42.148236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc5d34-a1f5-41eb-b182-74a9c1556fe8 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:42.160004 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 460/917] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:54:41 2022] GET /identity/v3/role_assignments?user.id=b9f8b86c01084a09bb8eac50eddfa0a1&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=2acaf26ecd8a4392aac8a20d15f672ad => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:42.332398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027e1e3-96bf-43d2-b270-eeb7430ad1b8 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:42.368776 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:42.462433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027e1e3-96bf-43d2-b270-eeb7430ad1b8 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:42.524736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395aa54-252d-46f4-aa35-58de830dd84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:42.525634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395aa54-252d-46f4-aa35-58de830dd84e None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:42.526074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395aa54-252d-46f4-aa35-58de830dd84e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:42.526495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395aa54-252d-46f4-aa35-58de830dd84e None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:42.527920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395aa54-252d-46f4-aa35-58de830dd84e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:42.529507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395aa54-252d-46f4-aa35-58de830dd84e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:42.549808 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 458/918] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:54:42 2022] POST /identity/v3/services => generated 241 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:54:42.833634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aee1a5-076e-4ab7-825f-16e8e9afaf0e None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:42.834196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aee1a5-076e-4ab7-825f-16e8e9afaf0e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:42.834637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aee1a5-076e-4ab7-825f-16e8e9afaf0e None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:42.837698 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 461/919] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:42.847662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d11233-a5b4-4399-a77c-29b507f6d196 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:42.848183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d11233-a5b4-4399-a77c-29b507f6d196 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:42.848688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d11233-a5b4-4399-a77c-29b507f6d196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:42.880900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-26d11233-a5b4-4399-a77c-29b507f6d196 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:42.883340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-26d11233-a5b4-4399-a77c-29b507f6d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:43.033153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 459/920] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:43.316442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aee1a5-076e-4ab7-825f-16e8e9afaf0e None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:43.500010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aee1a5-076e-4ab7-825f-16e8e9afaf0e None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:43.566418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f1b09-b335-416e-97e6-5ad98bcca9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:43.567624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f1b09-b335-416e-97e6-5ad98bcca9d7 None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:43.568034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f1b09-b335-416e-97e6-5ad98bcca9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:43.568526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f1b09-b335-416e-97e6-5ad98bcca9d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:43.569738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f1b09-b335-416e-97e6-5ad98bcca9d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:43.572242 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f1b09-b335-416e-97e6-5ad98bcca9d7 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:43.576973 dv-cinder-852209-6-smb devstack@keystone.service[81640]: WARNING keystone.server.flask.common [None req-7f8f1b09-b335-416e-97e6-5ad98bcca9d7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 20:54:43.607962 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.sql.core [None req-7f8f1b09-b335-416e-97e6-5ad98bcca9d7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 20:54:43.607962 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 20:54:43.607962 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [parameters: {'id': '3748ac4d60014711b4dc321899984058', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 20:54:43.607962 dv-cinder-852209-6-smb devstack@keystone.service[81640]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81640) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 20:54:43.616880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-7f8f1b09-b335-416e-97e6-5ad98bcca9d7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3748ac4d60014711b4dc321899984058.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3748ac4d60014711b4dc321899984058. Aug 19 20:54:43.616880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:43.616880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 20:54:43.616880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 20:54:43.616880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 20:54:43.616880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 20:54:43.616880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 20:54:43.616880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 20:54:43.616880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 20:54:43.616880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application conn.query(q) Aug 19 20:54:43.616880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 20:54:43.616880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 20:54:43.616880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application result.read() Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 20:54:43.618794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application next(self.gen) Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application yield resource Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application next(self.gen) Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise self.value Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application session.commit() Aug 19 20:54:43.621631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self.session.flush() Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application compat.raise_( Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 20:54:43.623951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 20:54:43.626191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application conn.query(q) Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application result.read() Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 20:54:43.635943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [parameters: {'id': '3748ac4d60014711b4dc321899984058', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:43.638234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:43.639297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:43.640624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:43.640624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 20:54:43.640624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 20:54:43.640624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:43.640624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:43.640624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 20:54:43.640624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 20:54:43.640624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3748ac4d60014711b4dc321899984058. Aug 19 20:54:43.640624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:43.640624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 462/921] 10.222.0.17 () {60 vars in 1140 bytes} [Fri Aug 19 20:54:43 2022] POST /identity/v3/projects => generated 262 bytes in 303 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:43.641747 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d11233-a5b4-4399-a77c-29b507f6d196 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:43.650086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:43.763027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d11233-a5b4-4399-a77c-29b507f6d196 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:43.824300 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eefde1-195e-432f-87e7-18a768505305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:43.824928 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eefde1-195e-432f-87e7-18a768505305 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:43.825334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eefde1-195e-432f-87e7-18a768505305 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:43.825608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eefde1-195e-432f-87e7-18a768505305 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:43.833348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eefde1-195e-432f-87e7-18a768505305 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:43.834838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eefde1-195e-432f-87e7-18a768505305 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-69eefde1-195e-432f-87e7-18a768505305 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:43.847401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:43.849500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:43.851623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:43.851623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:43.851623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:43.851623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:43.851623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:43.851623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:43.851623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:43.851623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:43.851623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 460/922] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:43.858628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f1b09-b335-416e-97e6-5ad98bcca9d7 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:43.863885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:44.042341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f1b09-b335-416e-97e6-5ad98bcca9d7 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:44.098543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62721114-0ad1-4eae-b9c1-0a8fc1251597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:44.099427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62721114-0ad1-4eae-b9c1-0a8fc1251597 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:44.099915 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62721114-0ad1-4eae-b9c1-0a8fc1251597 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:44.100449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62721114-0ad1-4eae-b9c1-0a8fc1251597 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:44.101670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62721114-0ad1-4eae-b9c1-0a8fc1251597 None admin] RBAC: Adding query filter params (name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:44.102217 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62721114-0ad1-4eae-b9c1-0a8fc1251597 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:44.105061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62721114-0ad1-4eae-b9c1-0a8fc1251597 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:44.147017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 463/923] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Aug 19 20:54:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:44.404885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5aa96-3d14-47dc-97b5-53ad04678331 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:44.404885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5aa96-3d14-47dc-97b5-53ad04678331 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:44.404885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5aa96-3d14-47dc-97b5-53ad04678331 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:44.404885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 461/924] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:44.414322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69ef91-f53d-4485-854d-3875b8af5c7b None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:44.414322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69ef91-f53d-4485-854d-3875b8af5c7b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:44.414322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69ef91-f53d-4485-854d-3875b8af5c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:44.433268 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-5c69ef91-f53d-4485-854d-3875b8af5c7b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:44.435772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5c69ef91-f53d-4485-854d-3875b8af5c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:44.527213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:44.540284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 464/925] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:44.674662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c28d2-9e94-4a93-a3a8-315a4ae5033f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:44.675223 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c28d2-9e94-4a93-a3a8-315a4ae5033f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:44.675223 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c28d2-9e94-4a93-a3a8-315a4ae5033f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:44.677413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 462/926] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:44.683195 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8d80a-7985-4402-b658-e0d85e128c34 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:44.683684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8d80a-7985-4402-b658-e0d85e128c34 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:44.684063 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8d80a-7985-4402-b658-e0d85e128c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:44.710044 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-77d8d80a-7985-4402-b658-e0d85e128c34 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:44.711324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-77d8d80a-7985-4402-b658-e0d85e128c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:44.734378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ddb08-2ada-4c4d-b666-60fa2ab3eca7 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:44.734866 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ddb08-2ada-4c4d-b666-60fa2ab3eca7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:44.735325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ddb08-2ada-4c4d-b666-60fa2ab3eca7 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:44.738727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 463/927] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:44.750519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b011a-7fa5-441d-9ee8-df1c17b76a1d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:44.750856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b011a-7fa5-441d-9ee8-df1c17b76a1d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:44.751115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b011a-7fa5-441d-9ee8-df1c17b76a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:44.783344 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-331b011a-7fa5-441d-9ee8-df1c17b76a1d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:44.787677 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-331b011a-7fa5-441d-9ee8-df1c17b76a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:44.805378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 465/928] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:44.840580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8d80a-7985-4402-b658-e0d85e128c34 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:44.873998 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 464/929] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:45.030864 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8d80a-7985-4402-b658-e0d85e128c34 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:45.075571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:45.096265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b011a-7fa5-441d-9ee8-df1c17b76a1d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:45.097660 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d62ccb-3e27-4937-9806-82811df03c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:45.098699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d62ccb-3e27-4937-9806-82811df03c6c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:45.099192 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d62ccb-3e27-4937-9806-82811df03c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:45.099644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d62ccb-3e27-4937-9806-82811df03c6c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:45.108804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:45.121489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d62ccb-3e27-4937-9806-82811df03c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-32d62ccb-3e27-4937-9806-82811df03c6c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:45.126374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:45.128444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:45.130029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:45.130029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:45.130029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:45.130029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:45.130029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:45.130029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:45.130029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:45.130029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:45.130029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:45.130029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:45.130029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 20:54:45.130029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:45.130029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 466/930] 10.222.0.17 () {56 vars in 1120 bytes} [Fri Aug 19 20:54:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:45.139455 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d62ccb-3e27-4937-9806-82811df03c6c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:45.230684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b011a-7fa5-441d-9ee8-df1c17b76a1d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:45.271359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa54467-8e88-41cf-8d1d-0c87dc39c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:45.272008 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa54467-8e88-41cf-8d1d-0c87dc39c617 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:45.272302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa54467-8e88-41cf-8d1d-0c87dc39c617 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:45.272566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa54467-8e88-41cf-8d1d-0c87dc39c617 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:45.273189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa54467-8e88-41cf-8d1d-0c87dc39c617 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:45.274622 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa54467-8e88-41cf-8d1d-0c87dc39c617 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-eaa54467-8e88-41cf-8d1d-0c87dc39c617 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:45.285395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:45.287453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 20:54:45.288525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:45.291248 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 465/931] 10.222.0.17 () {56 vars in 1132 bytes} [Fri Aug 19 20:54:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:45.293841 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa54467-8e88-41cf-8d1d-0c87dc39c617 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:45.336340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d62ccb-3e27-4937-9806-82811df03c6c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:45.396135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99994775-e51e-4d37-9214-17989119b412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:45.396766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99994775-e51e-4d37-9214-17989119b412 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:45.397043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99994775-e51e-4d37-9214-17989119b412 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:45.397350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99994775-e51e-4d37-9214-17989119b412 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:45.397854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:45.398051 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99994775-e51e-4d37-9214-17989119b412 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:45.398328 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99994775-e51e-4d37-9214-17989119b412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:45.399775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99994775-e51e-4d37-9214-17989119b412 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:45.414778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 467/932] 10.222.0.17 () {56 vars in 1115 bytes} [Fri Aug 19 20:54:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:45.416163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99994775-e51e-4d37-9214-17989119b412 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:45.441572 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa54467-8e88-41cf-8d1d-0c87dc39c617 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:45.488351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337620b-92e1-4383-a981-120b771124bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:45.489669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337620b-92e1-4383-a981-120b771124bc None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:45.489920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337620b-92e1-4383-a981-120b771124bc None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:45.490422 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337620b-92e1-4383-a981-120b771124bc None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:45.491679 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337620b-92e1-4383-a981-120b771124bc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:45.492206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337620b-92e1-4383-a981-120b771124bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:45.494889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337620b-92e1-4383-a981-120b771124bc None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:45.498625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:45.504615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 466/933] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Aug 19 20:54:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:45.506289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337620b-92e1-4383-a981-120b771124bc None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:45.595247 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99994775-e51e-4d37-9214-17989119b412 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:45.653714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5eb5-8278-4eca-9d07-fb7f3169d0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:45.654816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5eb5-8278-4eca-9d07-fb7f3169d0cc None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:45.655297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5eb5-8278-4eca-9d07-fb7f3169d0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:45.655892 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5eb5-8278-4eca-9d07-fb7f3169d0cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:45.656806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba5eb5-8278-4eca-9d07-fb7f3169d0cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:45.659272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba5eb5-8278-4eca-9d07-fb7f3169d0cc None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-04ba5eb5-8278-4eca-9d07-fb7f3169d0cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:45.674484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:45.675752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:45.676612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:45.677345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337620b-92e1-4383-a981-120b771124bc None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:45.677766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 468/934] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Aug 19 20:54:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:45.678298 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5eb5-8278-4eca-9d07-fb7f3169d0cc None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:45.741183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56450cc0-22d8-451b-a920-652be565e91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:45.742704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56450cc0-22d8-451b-a920-652be565e91d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:45.743519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56450cc0-22d8-451b-a920-652be565e91d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:45.744267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56450cc0-22d8-451b-a920-652be565e91d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:45.750289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:45.766990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56450cc0-22d8-451b-a920-652be565e91d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:45.772272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56450cc0-22d8-451b-a920-652be565e91d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-56450cc0-22d8-451b-a920-652be565e91d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:45.790970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:45.792613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:45.793733 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:45.793733 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:45.793733 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:45.793733 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 467/935] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:45.793733 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56450cc0-22d8-451b-a920-652be565e91d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:45.869572 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5eb5-8278-4eca-9d07-fb7f3169d0cc None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:45.890307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:45.943128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56450cc0-22d8-451b-a920-652be565e91d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:45.947503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386b793-90bf-494a-8cff-f4b8be957c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:45.948481 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386b793-90bf-494a-8cff-f4b8be957c68 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:45.949943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386b793-90bf-494a-8cff-f4b8be957c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:45.950658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386b793-90bf-494a-8cff-f4b8be957c68 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:45.951852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386b793-90bf-494a-8cff-f4b8be957c68 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:45.952397 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386b793-90bf-494a-8cff-f4b8be957c68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:45.954971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386b793-90bf-494a-8cff-f4b8be957c68 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:45.968049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 469/936] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Aug 19 20:54:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:45.968049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386b793-90bf-494a-8cff-f4b8be957c68 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:45.991066 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef493f37-52cf-478d-b05f-4617464487a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:45.991704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef493f37-52cf-478d-b05f-4617464487a5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:45.991985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef493f37-52cf-478d-b05f-4617464487a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:45.992262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef493f37-52cf-478d-b05f-4617464487a5 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:45.992934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef493f37-52cf-478d-b05f-4617464487a5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:45.993219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef493f37-52cf-478d-b05f-4617464487a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:45.994637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef493f37-52cf-478d-b05f-4617464487a5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:46.009088 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 468/937] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Aug 19 20:54:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:46.009088 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef493f37-52cf-478d-b05f-4617464487a5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:46.106949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:46.153834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386b793-90bf-494a-8cff-f4b8be957c68 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:46.201643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef493f37-52cf-478d-b05f-4617464487a5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:46.216148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680bcc4-d546-4fbf-91cc-683ab0dd880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:46.217208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680bcc4-d546-4fbf-91cc-683ab0dd880f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:46.217747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680bcc4-d546-4fbf-91cc-683ab0dd880f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:46.218240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680bcc4-d546-4fbf-91cc-683ab0dd880f None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:46.219081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680bcc4-d546-4fbf-91cc-683ab0dd880f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:46.219667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680bcc4-d546-4fbf-91cc-683ab0dd880f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:46.221951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680bcc4-d546-4fbf-91cc-683ab0dd880f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:46.249102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 470/938] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:46.249102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680bcc4-d546-4fbf-91cc-683ab0dd880f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:46.267091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559ee5b-a84a-420c-9351-6c5b7c4c9896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:46.267828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ee5b-a84a-420c-9351-6c5b7c4c9896 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:46.268309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ee5b-a84a-420c-9351-6c5b7c4c9896 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:46.268797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ee5b-a84a-420c-9351-6c5b7c4c9896 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:46.270028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559ee5b-a84a-420c-9351-6c5b7c4c9896 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:46.272239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559ee5b-a84a-420c-9351-6c5b7c4c9896 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:46.281568 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:46.302105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 469/939] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 20:54:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:54:46.302993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559ee5b-a84a-420c-9351-6c5b7c4c9896 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:46.397685 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680bcc4-d546-4fbf-91cc-683ab0dd880f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:46.448776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d78034-9ef8-4fdb-8769-4546dbdc58c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:46.449738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d78034-9ef8-4fdb-8769-4546dbdc58c4 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:46.450312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d78034-9ef8-4fdb-8769-4546dbdc58c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:46.450698 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d78034-9ef8-4fdb-8769-4546dbdc58c4 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:46.451502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d78034-9ef8-4fdb-8769-4546dbdc58c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:46.451949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d78034-9ef8-4fdb-8769-4546dbdc58c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:46.453446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d78034-9ef8-4fdb-8769-4546dbdc58c4 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:46.457155 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559ee5b-a84a-420c-9351-6c5b7c4c9896 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:46.459850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 471/940] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Aug 19 20:54:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:46.461382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09989e5c-2d9b-4127-818d-6c2da3420589 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:46.461726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09989e5c-2d9b-4127-818d-6c2da3420589 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:46.462060 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09989e5c-2d9b-4127-818d-6c2da3420589 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:46.463701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 472/941] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:46.471789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabc595-8d01-4fa0-b106-5c688c4ca936 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:46.472197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabc595-8d01-4fa0-b106-5c688c4ca936 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:46.472492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabc595-8d01-4fa0-b106-5c688c4ca936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:46.476478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:46.502463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ccabc595-8d01-4fa0-b106-5c688c4ca936 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:46.503856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ccabc595-8d01-4fa0-b106-5c688c4ca936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:46.518369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441f118-d740-41a3-b713-72c6db7d4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:46.519210 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441f118-d740-41a3-b713-72c6db7d4d66 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:46.519564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441f118-d740-41a3-b713-72c6db7d4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:46.519908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441f118-d740-41a3-b713-72c6db7d4d66 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:46.530396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441f118-d740-41a3-b713-72c6db7d4d66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:46.532359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441f118-d740-41a3-b713-72c6db7d4d66 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-7441f118-d740-41a3-b713-72c6db7d4d66 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:46.550583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:46.552667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:46.555059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:46.555059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:46.555059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:46.555059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:46.555059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:46.555059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:46.555059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:46.555059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:46.555059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 20:54:46.555059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:46.555059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 470/942] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Aug 19 20:54:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:46.555059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441f118-d740-41a3-b713-72c6db7d4d66 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:46.611187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 473/943] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:54:46.612520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabc595-8d01-4fa0-b106-5c688c4ca936 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:46.647519 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:46.733182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441f118-d740-41a3-b713-72c6db7d4d66 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:46.781100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47005319-392f-4840-b794-61bf6aa68bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:46.782207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47005319-392f-4840-b794-61bf6aa68bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:46.782615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47005319-392f-4840-b794-61bf6aa68bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:46.783073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47005319-392f-4840-b794-61bf6aa68bb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:46.784358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47005319-392f-4840-b794-61bf6aa68bb7 None admin] RBAC: Adding query filter params (interface=public, service_id=b2f248abf8a34687bebb36424c9af618, region_id=RegionOne) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:46.784877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47005319-392f-4840-b794-61bf6aa68bb7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:46.787412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47005319-392f-4840-b794-61bf6aa68bb7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:46.788829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabc595-8d01-4fa0-b106-5c688c4ca936 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:46.798097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 471/944] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Aug 19 20:54:46 2022] GET /identity/v3/endpoints?service_id=b2f248abf8a34687bebb36424c9af618&interface=public®ion_id=RegionOne => generated 194 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:46.803383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47005319-392f-4840-b794-61bf6aa68bb7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:46.831928 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762eeef-0c40-4928-99f5-d8c35d4d4396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:46.832969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762eeef-0c40-4928-99f5-d8c35d4d4396 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:46.833451 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762eeef-0c40-4928-99f5-d8c35d4d4396 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:46.833978 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762eeef-0c40-4928-99f5-d8c35d4d4396 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:46.835105 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762eeef-0c40-4928-99f5-d8c35d4d4396 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:46.835658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762eeef-0c40-4928-99f5-d8c35d4d4396 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:46.837448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762eeef-0c40-4928-99f5-d8c35d4d4396 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:46.842468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:46.863373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 474/945] 10.222.0.17 () {56 vars in 1149 bytes} [Fri Aug 19 20:54:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:46.873485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762eeef-0c40-4928-99f5-d8c35d4d4396 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:46.928123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47005319-392f-4840-b794-61bf6aa68bb7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:46.974729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89574e00-08e6-4c3a-a21d-2bc563d3e557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:46.975444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574e00-08e6-4c3a-a21d-2bc563d3e557 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:46.975728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574e00-08e6-4c3a-a21d-2bc563d3e557 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:46.976013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574e00-08e6-4c3a-a21d-2bc563d3e557 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:46.976691 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89574e00-08e6-4c3a-a21d-2bc563d3e557 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:46.978112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89574e00-08e6-4c3a-a21d-2bc563d3e557 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:46.991299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 472/946] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Aug 19 20:54:46 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 20:54:47.058490 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:47.102027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762eeef-0c40-4928-99f5-d8c35d4d4396 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:47.145174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89574e00-08e6-4c3a-a21d-2bc563d3e557 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:47.180112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25285747-9c56-4e50-8978-8d78056dc026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:47.181224 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25285747-9c56-4e50-8978-8d78056dc026 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:47.182386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25285747-9c56-4e50-8978-8d78056dc026 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:47.182386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25285747-9c56-4e50-8978-8d78056dc026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:47.207656 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25285747-9c56-4e50-8978-8d78056dc026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:47.209744 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25285747-9c56-4e50-8978-8d78056dc026 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-25285747-9c56-4e50-8978-8d78056dc026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:47.229150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:47.230262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:47.231730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:47.231730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:47.231730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:47.231730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 475/947] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:47.239732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25285747-9c56-4e50-8978-8d78056dc026 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:47.333954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:47.345289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89574e00-08e6-4c3a-a21d-2bc563d3e557 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:47.414618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d79c2-8f86-4b7d-bc5a-896739dc69b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:47.415745 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d79c2-8f86-4b7d-bc5a-896739dc69b6 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:47.416238 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d79c2-8f86-4b7d-bc5a-896739dc69b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:47.416756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d79c2-8f86-4b7d-bc5a-896739dc69b6 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:47.418148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d79c2-8f86-4b7d-bc5a-896739dc69b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:47.420982 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d79c2-8f86-4b7d-bc5a-896739dc69b6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:47.425898 dv-cinder-852209-6-smb devstack@keystone.service[81641]: WARNING keystone.server.flask.common [None req-969d79c2-8f86-4b7d-bc5a-896739dc69b6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 20:54:47.429966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25285747-9c56-4e50-8978-8d78056dc026 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:47.449769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.sql.core [None req-969d79c2-8f86-4b7d-bc5a-896739dc69b6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 20:54:47.449769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 20:54:47.449769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [parameters: {'user_id': '8c4117abfb66413db371e7fcaef87246', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 20:54:47.449769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81641) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-969d79c2-8f86-4b7d-bc5a-896739dc69b6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application conn.query(q) Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application result.read() Aug 19 20:54:47.486302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 20:54:47.488397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application next(self.gen) Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application yield resource Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application next(self.gen) Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise self.value Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application session.commit() Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 20:54:47.490710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self.session.flush() Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application compat.raise_( Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 20:54:47.492950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 20:54:47.495076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application conn.query(q) Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application result.read() Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 20:54:47.499495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [parameters: {'user_id': '8c4117abfb66413db371e7fcaef87246', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:47.503178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 20:54:47.508629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 20:54:47.512182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 20:54:47.512182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 20:54:47.512182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 20:54:47.512182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 20:54:47.512182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 20:54:47.512182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:47.512182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 473/948] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Aug 19 20:54:47 2022] POST /identity/v3/users => generated 160 bytes in 344 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:47.512182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d79c2-8f86-4b7d-bc5a-896739dc69b6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:47.516664 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:47.526387 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1c343-f96e-4785-9fbd-f96e1a25e3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:47.528018 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1c343-f96e-4785-9fbd-f96e1a25e3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:47.528931 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1c343-f96e-4785-9fbd-f96e1a25e3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:47.529747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1c343-f96e-4785-9fbd-f96e1a25e3f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:47.531225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1c343-f96e-4785-9fbd-f96e1a25e3f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:47.532126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1c343-f96e-4785-9fbd-f96e1a25e3f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:47.535054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1c343-f96e-4785-9fbd-f96e1a25e3f3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:47.560235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 476/949] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:47.569925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1c343-f96e-4785-9fbd-f96e1a25e3f3 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:47.713292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d79c2-8f86-4b7d-bc5a-896739dc69b6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:47.755272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86a67b-d397-44b4-84be-dd966ebb7167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:47.756867 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86a67b-d397-44b4-84be-dd966ebb7167 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:47.757278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86a67b-d397-44b4-84be-dd966ebb7167 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:47.757712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86a67b-d397-44b4-84be-dd966ebb7167 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:47.767536 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86a67b-d397-44b4-84be-dd966ebb7167 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:47.769568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86a67b-d397-44b4-84be-dd966ebb7167 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-6b86a67b-d397-44b4-84be-dd966ebb7167 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:47.783427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:47.784765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:47.785983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:47.785983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:47.785983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:47.785983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:47.785983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:47.785983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:47.785983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:47.785983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:47.785983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 20:54:47.785983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:47.790179 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 474/950] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:54:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:47.799167 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86a67b-d397-44b4-84be-dd966ebb7167 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:47.801568 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1c343-f96e-4785-9fbd-f96e1a25e3f3 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:47.823593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:47.873051 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3bd6e-5dd4-421b-87a4-4d503684544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:47.873715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3bd6e-5dd4-421b-87a4-4d503684544f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:47.874010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3bd6e-5dd4-421b-87a4-4d503684544f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:47.874365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3bd6e-5dd4-421b-87a4-4d503684544f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:47.883267 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3bd6e-5dd4-421b-87a4-4d503684544f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:47.884752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3bd6e-5dd4-421b-87a4-4d503684544f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-2fc3bd6e-5dd4-421b-87a4-4d503684544f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:47.901141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:47.903067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:47.904792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:47.904792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:47.904792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:47.904792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:47.904792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:47.904792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:47.904792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:47.904792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:47.904792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 477/951] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:47.912841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3bd6e-5dd4-421b-87a4-4d503684544f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:48.008279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86a67b-d397-44b4-84be-dd966ebb7167 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:48.048304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:48.091878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c16bd-316c-4bc9-ba2d-03b5bc335f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:48.093486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c16bd-316c-4bc9-ba2d-03b5bc335f77 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:48.094306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c16bd-316c-4bc9-ba2d-03b5bc335f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:48.095168 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c16bd-316c-4bc9-ba2d-03b5bc335f77 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:48.097861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c16bd-316c-4bc9-ba2d-03b5bc335f77 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:48.098822 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c16bd-316c-4bc9-ba2d-03b5bc335f77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:48.103243 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c16bd-316c-4bc9-ba2d-03b5bc335f77 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:48.141820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3bd6e-5dd4-421b-87a4-4d503684544f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:48.200842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 475/952] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Aug 19 20:54:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:48.213235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe80f2b-72f4-41b8-8648-cb294e2ba251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:48.215381 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe80f2b-72f4-41b8-8648-cb294e2ba251 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:48.216118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe80f2b-72f4-41b8-8648-cb294e2ba251 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:48.216866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe80f2b-72f4-41b8-8648-cb294e2ba251 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:48.218563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe80f2b-72f4-41b8-8648-cb294e2ba251 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:48.219412 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe80f2b-72f4-41b8-8648-cb294e2ba251 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:48.222459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe80f2b-72f4-41b8-8648-cb294e2ba251 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:48.258863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 478/953] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:48.264576 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c16bd-316c-4bc9-ba2d-03b5bc335f77 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:48.428643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:48.471377 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c16bd-316c-4bc9-ba2d-03b5bc335f77 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:48.552189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6477d6d-aedb-40cc-a8a4-6c3228f00185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:48.553265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477d6d-aedb-40cc-a8a4-6c3228f00185 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:48.553767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477d6d-aedb-40cc-a8a4-6c3228f00185 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:48.554251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477d6d-aedb-40cc-a8a4-6c3228f00185 None admin] PATH_INFO: `/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/b9f8b86c01084a09bb8eac50eddfa0a1/roles/2acaf26ecd8a4392aac8a20d15f672ad` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:48.558166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6477d6d-aedb-40cc-a8a4-6c3228f00185 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1defe14eddd4b28ac969adb3d504c7a, user_id=b9f8b86c01084a09bb8eac50eddfa0a1, role_id=2acaf26ecd8a4392aac8a20d15f672ad)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:48.562036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6477d6d-aedb-40cc-a8a4-6c3228f00185 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:48.563265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8eabe1-3be1-44c8-ac82-9a97d247f650 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:48.563565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8eabe1-3be1-44c8-ac82-9a97d247f650 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:48.563828 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8eabe1-3be1-44c8-ac82-9a97d247f650 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:48.565470 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 479/954] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:54:48.570989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389118f9-2372-41c8-b1ef-3094b7f248bb None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:48.571262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389118f9-2372-41c8-b1ef-3094b7f248bb None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:48.571532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389118f9-2372-41c8-b1ef-3094b7f248bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:48.588512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 476/955] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:54:48 2022] PUT /identity/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/b9f8b86c01084a09bb8eac50eddfa0a1/roles/2acaf26ecd8a4392aac8a20d15f672ad => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:54:48.591418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-389118f9-2372-41c8-b1ef-3094b7f248bb None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:48.592683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-389118f9-2372-41c8-b1ef-3094b7f248bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:48.686670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 480/956] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:49.192770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6477d6d-aedb-40cc-a8a4-6c3228f00185 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:49.285375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b7871-f4f9-457a-9989-64642712a2cd None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:49.286474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b7871-f4f9-457a-9989-64642712a2cd None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:49.287003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b7871-f4f9-457a-9989-64642712a2cd None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:49.289342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 481/957] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:49.299648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56551ba-2020-4c57-a382-2fbc90ec7454 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:49.300193 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56551ba-2020-4c57-a382-2fbc90ec7454 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:49.300720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56551ba-2020-4c57-a382-2fbc90ec7454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:49.329340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-f56551ba-2020-4c57-a382-2fbc90ec7454 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:49.331421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f56551ba-2020-4c57-a382-2fbc90ec7454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:49.378540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6477d6d-aedb-40cc-a8a4-6c3228f00185 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:49.379639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:49.419337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 482/958] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:54:49.448086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af476cf-0251-483f-b1fb-458aba6f8f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:49.449640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af476cf-0251-483f-b1fb-458aba6f8f4f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:49.450351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af476cf-0251-483f-b1fb-458aba6f8f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:49.451035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af476cf-0251-483f-b1fb-458aba6f8f4f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:49.452130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af476cf-0251-483f-b1fb-458aba6f8f4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:49.454699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af476cf-0251-483f-b1fb-458aba6f8f4f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:49.459956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-6af476cf-0251-483f-b1fb-458aba6f8f4f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:49.474892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:49.476221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 20:54:49.477124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:49.482929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 477/959] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:49.486722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56551ba-2020-4c57-a382-2fbc90ec7454 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:49.643083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56551ba-2020-4c57-a382-2fbc90ec7454 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:49.703074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5e340-ae32-4a4e-ae59-379f76a381a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:49.704099 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5e340-ae32-4a4e-ae59-379f76a381a1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:49.704577 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5e340-ae32-4a4e-ae59-379f76a381a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:49.705062 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5e340-ae32-4a4e-ae59-379f76a381a1 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:49.706228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5e340-ae32-4a4e-ae59-379f76a381a1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:49.706670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5e340-ae32-4a4e-ae59-379f76a381a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:49.709245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5e340-ae32-4a4e-ae59-379f76a381a1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:49.722632 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 483/960] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Aug 19 20:54:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:49.724025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af476cf-0251-483f-b1fb-458aba6f8f4f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:49.907191 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af476cf-0251-483f-b1fb-458aba6f8f4f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:49.910986 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5e340-ae32-4a4e-ae59-379f76a381a1 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:49.968596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78e1ae-1e0a-4a23-a33d-e08276df2633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:49.969459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78e1ae-1e0a-4a23-a33d-e08276df2633 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:49.969901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78e1ae-1e0a-4a23-a33d-e08276df2633 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:49.970337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78e1ae-1e0a-4a23-a33d-e08276df2633 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:49.971404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78e1ae-1e0a-4a23-a33d-e08276df2633 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:49.971876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78e1ae-1e0a-4a23-a33d-e08276df2633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:49.974167 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78e1ae-1e0a-4a23-a33d-e08276df2633 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:49.980154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:49.982356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 478/961] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Aug 19 20:54:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:50.111154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5e340-ae32-4a4e-ae59-379f76a381a1 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:50.176599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d8737-1dee-4805-8b3e-9ea724071ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:50.177603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d8737-1dee-4805-8b3e-9ea724071ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:50.178040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d8737-1dee-4805-8b3e-9ea724071ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:50.178479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d8737-1dee-4805-8b3e-9ea724071ec7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:50.179511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d8737-1dee-4805-8b3e-9ea724071ec7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:50.181947 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d8737-1dee-4805-8b3e-9ea724071ec7 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-c76d8737-1dee-4805-8b3e-9ea724071ec7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:50.198797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:50.200468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:50.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 484/962] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Aug 19 20:54:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:50.210445 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78e1ae-1e0a-4a23-a33d-e08276df2633 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:50.300958 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:50.351045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78e1ae-1e0a-4a23-a33d-e08276df2633 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:50.392731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41cc89-5486-422e-b3f4-e4d00fcd4205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:50.393363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41cc89-5486-422e-b3f4-e4d00fcd4205 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:50.393643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41cc89-5486-422e-b3f4-e4d00fcd4205 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:50.393918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41cc89-5486-422e-b3f4-e4d00fcd4205 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:50.394567 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41cc89-5486-422e-b3f4-e4d00fcd4205 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:50.394903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41cc89-5486-422e-b3f4-e4d00fcd4205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:50.396285 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41cc89-5486-422e-b3f4-e4d00fcd4205 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:50.403419 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 479/963] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Aug 19 20:54:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:50.410038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d8737-1dee-4805-8b3e-9ea724071ec7 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:50.593629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:50.597441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d8737-1dee-4805-8b3e-9ea724071ec7 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:50.646107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230dfe1-fea5-4773-b379-d754eda4aa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:50.646752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230dfe1-fea5-4773-b379-d754eda4aa7d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:50.647034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230dfe1-fea5-4773-b379-d754eda4aa7d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:50.647304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230dfe1-fea5-4773-b379-d754eda4aa7d None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:50.647942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230dfe1-fea5-4773-b379-d754eda4aa7d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:50.648241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230dfe1-fea5-4773-b379-d754eda4aa7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:50.649611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230dfe1-fea5-4773-b379-d754eda4aa7d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:50.656512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 485/964] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Aug 19 20:54:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:50.663159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41cc89-5486-422e-b3f4-e4d00fcd4205 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:50.810107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41cc89-5486-422e-b3f4-e4d00fcd4205 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:50.843344 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:50.854414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58287ce2-033f-4aa8-bd88-12c8a13ffd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:50.856970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58287ce2-033f-4aa8-bd88-12c8a13ffd8a None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:50.857260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58287ce2-033f-4aa8-bd88-12c8a13ffd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:50.857530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58287ce2-033f-4aa8-bd88-12c8a13ffd8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:50.858227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58287ce2-033f-4aa8-bd88-12c8a13ffd8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:50.859718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58287ce2-033f-4aa8-bd88-12c8a13ffd8a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:50.895202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 480/965] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 20:54:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 20:54:51.308687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455b7a7-95dc-40b4-9fe9-f6c24a9899b9 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:51.308995 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455b7a7-95dc-40b4-9fe9-f6c24a9899b9 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:51.309297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455b7a7-95dc-40b4-9fe9-f6c24a9899b9 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:51.310884 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 486/966] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:54:51.317583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8ff0d-1c45-4692-8be4-518d8d7df35a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:51.318119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8ff0d-1c45-4692-8be4-518d8d7df35a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:51.318600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8ff0d-1c45-4692-8be4-518d8d7df35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:51.349804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b6d8ff0d-1c45-4692-8be4-518d8d7df35a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:51.352350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b6d8ff0d-1c45-4692-8be4-518d8d7df35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:51.500771 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 481/967] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:51.995668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455b7a7-95dc-40b4-9fe9-f6c24a9899b9 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:52.200098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455b7a7-95dc-40b4-9fe9-f6c24a9899b9 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:52.265586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96005536-e593-44a3-a23f-ad03e5d84b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:52.266677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96005536-e593-44a3-a23f-ad03e5d84b0c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:52.267238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96005536-e593-44a3-a23f-ad03e5d84b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:52.267650 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96005536-e593-44a3-a23f-ad03e5d84b0c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:52.270084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36145ce-e54a-45c1-a05d-bb54b7117f3f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:52.270605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36145ce-e54a-45c1-a05d-bb54b7117f3f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:52.271123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36145ce-e54a-45c1-a05d-bb54b7117f3f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:52.273871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 482/968] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:52.280184 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f1c9-6907-4b9e-a4c7-97151931cb90 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:52.280642 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f1c9-6907-4b9e-a4c7-97151931cb90 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:52.281065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f1c9-6907-4b9e-a4c7-97151931cb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:52.296604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96005536-e593-44a3-a23f-ad03e5d84b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:54:52.303678 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-bdd8f1c9-6907-4b9e-a4c7-97151931cb90 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:52.305122 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bdd8f1c9-6907-4b9e-a4c7-97151931cb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-96005536-e593-44a3-a23f-ad03e5d84b0c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:54:52.306976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:52.308287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:52.309372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:52.309372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:52.309372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:52.309372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:52.309372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:54:52.309372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:54:52.309372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:54:52.309372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:54:52.309372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:54:52.309372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:54:52.309372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 20:54:52.309372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:52.310709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 487/969] 10.222.0.17 () {56 vars in 1120 bytes} [Fri Aug 19 20:54:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:52.316812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96005536-e593-44a3-a23f-ad03e5d84b0c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:52.350349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:52.417912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 483/970] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:54:52.503266 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96005536-e593-44a3-a23f-ad03e5d84b0c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:52.568414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffa151-0cc0-4c45-afd9-a183f5a69ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:52.569475 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa151-0cc0-4c45-afd9-a183f5a69ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:52.569971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa151-0cc0-4c45-afd9-a183f5a69ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:52.570441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa151-0cc0-4c45-afd9-a183f5a69ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:52.571698 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffa151-0cc0-4c45-afd9-a183f5a69ce2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:52.572245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffa151-0cc0-4c45-afd9-a183f5a69ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:52.575501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffa151-0cc0-4c45-afd9-a183f5a69ce2 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:52.595349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 488/971] 10.222.0.17 () {56 vars in 1115 bytes} [Fri Aug 19 20:54:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:52.604443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f1c9-6907-4b9e-a4c7-97151931cb90 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:52.687979 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:52.724503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffa151-0cc0-4c45-afd9-a183f5a69ce2 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:52.807450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f1c9-6907-4b9e-a4c7-97151931cb90 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:52.856223 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48af5f-c088-4abd-90b8-4ecab715747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:52.857269 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48af5f-c088-4abd-90b8-4ecab715747d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:52.857735 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48af5f-c088-4abd-90b8-4ecab715747d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:52.858197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48af5f-c088-4abd-90b8-4ecab715747d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:52.879821 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48af5f-c088-4abd-90b8-4ecab715747d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:52.882427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48af5f-c088-4abd-90b8-4ecab715747d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:52.885346 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:52.909180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffa151-0cc0-4c45-afd9-a183f5a69ce2 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-be48af5f-c088-4abd-90b8-4ecab715747d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:52.917095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:52.920393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:52.922172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:52.922172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:52.922172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:52.922172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 484/972] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:52.926985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48af5f-c088-4abd-90b8-4ecab715747d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:52.972167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2e9bc-1fd0-4dfb-9229-da2375edc75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:52.972789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2e9bc-1fd0-4dfb-9229-da2375edc75e None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:52.973069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2e9bc-1fd0-4dfb-9229-da2375edc75e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:52.973343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2e9bc-1fd0-4dfb-9229-da2375edc75e None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:52.973997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2e9bc-1fd0-4dfb-9229-da2375edc75e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:52.975442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2e9bc-1fd0-4dfb-9229-da2375edc75e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:53.006878 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 489/973] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:54:52 2022] POST /identity/v3/services => generated 242 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 20:54:53.017836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc92e9-3e86-4dbd-bb5f-64b50ae1de8a None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:53.018146 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc92e9-3e86-4dbd-bb5f-64b50ae1de8a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:53.018392 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc92e9-3e86-4dbd-bb5f-64b50ae1de8a None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:53.019847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 490/974] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:54:53.026280 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164af67-738c-433c-8a2a-9009a14a335f None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:53.026479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164af67-738c-433c-8a2a-9009a14a335f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:53.026794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164af67-738c-433c-8a2a-9009a14a335f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:53.048354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7164af67-738c-433c-8a2a-9009a14a335f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:53.049679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7164af67-738c-433c-8a2a-9009a14a335f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:53.096112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:53.114957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48af5f-c088-4abd-90b8-4ecab715747d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:53.168484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 491/975] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:54:53.172549 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb8293-fdc5-41d3-a579-74bf08da24ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:53.173193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb8293-fdc5-41d3-a579-74bf08da24ba None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:53.173472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb8293-fdc5-41d3-a579-74bf08da24ba None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:53.173799 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb8293-fdc5-41d3-a579-74bf08da24ba None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:53.174501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb8293-fdc5-41d3-a579-74bf08da24ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:53.175030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb8293-fdc5-41d3-a579-74bf08da24ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:53.176356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb8293-fdc5-41d3-a579-74bf08da24ba None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:53.200456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 485/976] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:53.203160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164af67-738c-433c-8a2a-9009a14a335f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:53.313415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:53.394197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164af67-738c-433c-8a2a-9009a14a335f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:53.443723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664cdcb-4a57-4360-9594-4d304a118664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:53.444546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664cdcb-4a57-4360-9594-4d304a118664 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:53.444966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664cdcb-4a57-4360-9594-4d304a118664 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:53.445385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664cdcb-4a57-4360-9594-4d304a118664 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:53.456219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664cdcb-4a57-4360-9594-4d304a118664 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:53.457696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664cdcb-4a57-4360-9594-4d304a118664 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-2664cdcb-4a57-4360-9594-4d304a118664 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:54:53.476542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:53.478459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:53.480893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:53.480893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:53.480893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:54:53.480893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:54:53.480893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:54:53.480893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:54:53.480893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:54:53.480893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:54:53.480893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 20:54:53.480893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:53.483081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 492/977] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Aug 19 20:54:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:53.487736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb8293-fdc5-41d3-a579-74bf08da24ba None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:53.549604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664cdcb-4a57-4360-9594-4d304a118664 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:53.642882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb8293-fdc5-41d3-a579-74bf08da24ba None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:53.695429 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664cdcb-4a57-4360-9594-4d304a118664 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:53.719687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e6719-929b-436c-854f-d8ee5fec8170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:53.720667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e6719-929b-436c-854f-d8ee5fec8170 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:53.721119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e6719-929b-436c-854f-d8ee5fec8170 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:53.721553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e6719-929b-436c-854f-d8ee5fec8170 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:53.723181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e6719-929b-436c-854f-d8ee5fec8170 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:53.723726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e6719-929b-436c-854f-d8ee5fec8170 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:53.726408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e6719-929b-436c-854f-d8ee5fec8170 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:53.738132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:53.754109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3d4b0-07c4-4d06-806b-3d9e256525e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:53.755732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3d4b0-07c4-4d06-806b-3d9e256525e4 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:53.756911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3d4b0-07c4-4d06-806b-3d9e256525e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:53.757702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3d4b0-07c4-4d06-806b-3d9e256525e4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:53.759181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3d4b0-07c4-4d06-806b-3d9e256525e4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:53.762127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3d4b0-07c4-4d06-806b-3d9e256525e4 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:53.776589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 486/978] 10.222.0.17 () {56 vars in 1149 bytes} [Fri Aug 19 20:54:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:53.778533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e6719-929b-436c-854f-d8ee5fec8170 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-a8b3d4b0-07c4-4d06-806b-3d9e256525e4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:53.781335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:53.782416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:53.783361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:53.784116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 493/979] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Aug 19 20:54:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:53.792119 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3d4b0-07c4-4d06-806b-3d9e256525e4 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:53.801111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:53.960628 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e6719-929b-436c-854f-d8ee5fec8170 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:53.983370 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3d4b0-07c4-4d06-806b-3d9e256525e4 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:54.006784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c9f84-6a18-4027-b633-ec42ff8204cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:54.006784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9f84-6a18-4027-b633-ec42ff8204cd None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:54.006784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9f84-6a18-4027-b633-ec42ff8204cd None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:54.007373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9f84-6a18-4027-b633-ec42ff8204cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:54.032353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcf389-dce1-4f4a-a99d-d015894db3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:54.033385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcf389-dce1-4f4a-a99d-d015894db3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:54.033780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcf389-dce1-4f4a-a99d-d015894db3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:54.034232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcf389-dce1-4f4a-a99d-d015894db3d7 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:54.035120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcf389-dce1-4f4a-a99d-d015894db3d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:54.035565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcf389-dce1-4f4a-a99d-d015894db3d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:54.037249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcf389-dce1-4f4a-a99d-d015894db3d7 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:54.049529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 494/980] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Aug 19 20:54:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:54.051229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcf389-dce1-4f4a-a99d-d015894db3d7 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:54.094555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c9f84-6a18-4027-b633-ec42ff8204cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:54.096915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c9f84-6a18-4027-b633-ec42ff8204cd None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:54.112457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:54.133918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:54.194391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcf389-dce1-4f4a-a99d-d015894db3d7 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:54.229124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 487/981] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:54:53 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:54:54.235483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c9f84-6a18-4027-b633-ec42ff8204cd None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:54.240944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48498a6b-d5d6-4624-b51b-fc57e95d4d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:54.241982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48498a6b-d5d6-4624-b51b-fc57e95d4d19 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:54.242491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48498a6b-d5d6-4624-b51b-fc57e95d4d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:54.243032 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48498a6b-d5d6-4624-b51b-fc57e95d4d19 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:54.243890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48498a6b-d5d6-4624-b51b-fc57e95d4d19 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:54.244640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48498a6b-d5d6-4624-b51b-fc57e95d4d19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:54.247203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48498a6b-d5d6-4624-b51b-fc57e95d4d19 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:54.264966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 495/982] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Aug 19 20:54:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:54.266548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48498a6b-d5d6-4624-b51b-fc57e95d4d19 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:54.359529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c9f84-6a18-4027-b633-ec42ff8204cd None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:54.375989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:54.416107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f471d-0bcf-47d0-b3c8-3ccdf24270d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:54.416370 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48498a6b-d5d6-4624-b51b-fc57e95d4d19 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:54.417099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f471d-0bcf-47d0-b3c8-3ccdf24270d6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:54.417543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f471d-0bcf-47d0-b3c8-3ccdf24270d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:54.418526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f471d-0bcf-47d0-b3c8-3ccdf24270d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:54.436762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f471d-0bcf-47d0-b3c8-3ccdf24270d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:54.439342 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f471d-0bcf-47d0-b3c8-3ccdf24270d6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:54.457478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-299f471d-0bcf-47d0-b3c8-3ccdf24270d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:54:54.463282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:54.464318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:54:54.465371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:54:54.465371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:54:54.465371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:54.465554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 488/983] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:54:54.471997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f471d-0bcf-47d0-b3c8-3ccdf24270d6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:54.478958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a61a7e-9ecb-4073-a0cc-0f285b8536fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:54.479665 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a61a7e-9ecb-4073-a0cc-0f285b8536fc None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:54.479848 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a61a7e-9ecb-4073-a0cc-0f285b8536fc None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:54.480712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a61a7e-9ecb-4073-a0cc-0f285b8536fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:54.481584 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a61a7e-9ecb-4073-a0cc-0f285b8536fc None admin] RBAC: Adding query filter params (interface=admin, service_id=b2f248abf8a34687bebb36424c9af618, region_id=RegionOne) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:54.481899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a61a7e-9ecb-4073-a0cc-0f285b8536fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:54.483413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a61a7e-9ecb-4073-a0cc-0f285b8536fc None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:54.490007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 496/984] 10.222.0.17 () {56 vars in 1249 bytes} [Fri Aug 19 20:54:54 2022] GET /identity/v3/endpoints?service_id=b2f248abf8a34687bebb36424c9af618&interface=admin®ion_id=RegionOne => generated 193 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:54.496690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a61a7e-9ecb-4073-a0cc-0f285b8536fc None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:54.616041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f471d-0bcf-47d0-b3c8-3ccdf24270d6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:54.621528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a61a7e-9ecb-4073-a0cc-0f285b8536fc None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:54.659426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83386630-b2b3-4a48-afd1-2fd7300cfe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:54.659739 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99a288-9f93-4686-8e5a-a46ae36dcc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:54.660195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83386630-b2b3-4a48-afd1-2fd7300cfe25 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:54.660362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99a288-9f93-4686-8e5a-a46ae36dcc1b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:54.660495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83386630-b2b3-4a48-afd1-2fd7300cfe25 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:54.660581 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99a288-9f93-4686-8e5a-a46ae36dcc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:54.660654 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83386630-b2b3-4a48-afd1-2fd7300cfe25 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:54.660896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99a288-9f93-4686-8e5a-a46ae36dcc1b None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:54.661276 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83386630-b2b3-4a48-afd1-2fd7300cfe25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:54.661448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99a288-9f93-4686-8e5a-a46ae36dcc1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:54.661595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83386630-b2b3-4a48-afd1-2fd7300cfe25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:54.662830 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99a288-9f93-4686-8e5a-a46ae36dcc1b None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:54.663021 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83386630-b2b3-4a48-afd1-2fd7300cfe25 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:54.670675 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 497/985] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Aug 19 20:54:54 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 20:54:54.686181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 489/986] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:54.687569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99a288-9f93-4686-8e5a-a46ae36dcc1b None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:54.757677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:54.858380 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99a288-9f93-4686-8e5a-a46ae36dcc1b None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:54.895996 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947cf6c-8630-4d33-b450-d1bc48cb6d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:54.896646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947cf6c-8630-4d33-b450-d1bc48cb6d8c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:54.896929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947cf6c-8630-4d33-b450-d1bc48cb6d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:54.897204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947cf6c-8630-4d33-b450-d1bc48cb6d8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:54.905048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947cf6c-8630-4d33-b450-d1bc48cb6d8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:54.906478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947cf6c-8630-4d33-b450-d1bc48cb6d8c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-a947cf6c-8630-4d33-b450-d1bc48cb6d8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:54:54.918463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:54.919521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:54.920489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:54:54.920489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:54:54.920489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:54:54.920489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:54:54.920489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:54:54.920489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:54:54.920489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:54:54.920489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:54.920489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 498/987] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:54.925821 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83386630-b2b3-4a48-afd1-2fd7300cfe25 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:54.953610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:55.045567 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83386630-b2b3-4a48-afd1-2fd7300cfe25 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:55.083273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b804264-5956-44d9-96a2-12189438631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:55.083908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b804264-5956-44d9-96a2-12189438631e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:55.084195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b804264-5956-44d9-96a2-12189438631e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:55.084471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b804264-5956-44d9-96a2-12189438631e None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:55.085190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b804264-5956-44d9-96a2-12189438631e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:55.085503 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b804264-5956-44d9-96a2-12189438631e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:55.086991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b804264-5956-44d9-96a2-12189438631e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:55.106520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 490/988] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:54:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:55.108101 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947cf6c-8630-4d33-b450-d1bc48cb6d8c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:55.222718 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947cf6c-8630-4d33-b450-d1bc48cb6d8c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:55.236883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:55.260817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aae41-6e5a-4e75-abfc-5ee764a2d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:55.262004 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aae41-6e5a-4e75-abfc-5ee764a2d54f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:55.262297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aae41-6e5a-4e75-abfc-5ee764a2d54f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:55.262565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aae41-6e5a-4e75-abfc-5ee764a2d54f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:55.263359 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aae41-6e5a-4e75-abfc-5ee764a2d54f None admin] RBAC: Adding query filter params (role.id=2acaf26ecd8a4392aac8a20d15f672ad, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=b9f8b86c01084a09bb8eac50eddfa0a1) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:55.263678 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aae41-6e5a-4e75-abfc-5ee764a2d54f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:55.265164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aae41-6e5a-4e75-abfc-5ee764a2d54f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:55.278812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 499/989] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:54:55 2022] GET /identity/v3/role_assignments?user.id=b9f8b86c01084a09bb8eac50eddfa0a1&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=2acaf26ecd8a4392aac8a20d15f672ad => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:56.166973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38cdb1-2dff-427a-8c36-4e9dca41e5fc None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:56.168347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38cdb1-2dff-427a-8c36-4e9dca41e5fc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:56.168347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38cdb1-2dff-427a-8c36-4e9dca41e5fc None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:56.170048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 491/990] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:54:56.177188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ece9c5-92d0-4337-b952-a0401e274f5c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:56.177720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ece9c5-92d0-4337-b952-a0401e274f5c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:56.178127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ece9c5-92d0-4337-b952-a0401e274f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:56.210681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-29ece9c5-92d0-4337-b952-a0401e274f5c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:56.212885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-29ece9c5-92d0-4337-b952-a0401e274f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:56.338770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 500/991] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:54:56.811096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38cdb1-2dff-427a-8c36-4e9dca41e5fc None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:56.906628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78914cf-8042-4ac7-a80f-baf937bdf7ab None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:56.906968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78914cf-8042-4ac7-a80f-baf937bdf7ab None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:56.907251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78914cf-8042-4ac7-a80f-baf937bdf7ab None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:56.908876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 501/992] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:54:56.914572 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2353a5-a20e-4708-9d23-2dd60e13c631 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:56.914905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2353a5-a20e-4708-9d23-2dd60e13c631 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:56.915193 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2353a5-a20e-4708-9d23-2dd60e13c631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:56.935456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-5b2353a5-a20e-4708-9d23-2dd60e13c631 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:56.936704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5b2353a5-a20e-4708-9d23-2dd60e13c631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:56.968776 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:56.993634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38cdb1-2dff-427a-8c36-4e9dca41e5fc None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:57.059896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 502/993] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:54:57.065220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ab25-c65d-4005-a63c-8114ebbd48ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:57.066170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ab25-c65d-4005-a63c-8114ebbd48ab None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:57.066622 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ab25-c65d-4005-a63c-8114ebbd48ab None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:57.067130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ab25-c65d-4005-a63c-8114ebbd48ab None admin] PATH_INFO: `/v3/services/compute` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:57.068129 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ab25-c65d-4005-a63c-8114ebbd48ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:57.070447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ab25-c65d-4005-a63c-8114ebbd48ab None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-c953ab25-c65d-4005-a63c-8114ebbd48ab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:57.085656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:57.087101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:57.094340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 492/994] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:54:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:57.097882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2353a5-a20e-4708-9d23-2dd60e13c631 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:57.165542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:57.265355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2353a5-a20e-4708-9d23-2dd60e13c631 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:57.317600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260315c-bb82-47a8-b7dc-b213060e21ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:57.318332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260315c-bb82-47a8-b7dc-b213060e21ef None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:57.318682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260315c-bb82-47a8-b7dc-b213060e21ef None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:57.318990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260315c-bb82-47a8-b7dc-b213060e21ef None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:57.319715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260315c-bb82-47a8-b7dc-b213060e21ef None admin] RBAC: Adding query filter params (name=compute) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:57.320017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260315c-bb82-47a8-b7dc-b213060e21ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:57.321616 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260315c-bb82-47a8-b7dc-b213060e21ef None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:57.335411 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 503/995] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Aug 19 20:54:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:57.335634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ab25-c65d-4005-a63c-8114ebbd48ab None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:57.341231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260315c-bb82-47a8-b7dc-b213060e21ef None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:57.472695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ab25-c65d-4005-a63c-8114ebbd48ab None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:57.473519 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:57.476837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260315c-bb82-47a8-b7dc-b213060e21ef None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:57.520068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1db2f-8624-41a7-bc9d-346662a0b821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:57.520725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1db2f-8624-41a7-bc9d-346662a0b821 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:57.521009 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1db2f-8624-41a7-bc9d-346662a0b821 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:57.521286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1db2f-8624-41a7-bc9d-346662a0b821 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:57.521707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d6947-3c11-45d2-8aaf-7dc31433ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:57.521907 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1db2f-8624-41a7-bc9d-346662a0b821 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:57.522445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d6947-3c11-45d2-8aaf-7dc31433ebe7 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:57.522872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d6947-3c11-45d2-8aaf-7dc31433ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:57.523335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1db2f-8624-41a7-bc9d-346662a0b821 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:57.523433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d6947-3c11-45d2-8aaf-7dc31433ebe7 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:57.524523 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d6947-3c11-45d2-8aaf-7dc31433ebe7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:57.525071 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d6947-3c11-45d2-8aaf-7dc31433ebe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:57.528373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d6947-3c11-45d2-8aaf-7dc31433ebe7 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-4bd1db2f-8624-41a7-bc9d-346662a0b821 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:57.533351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:57.534390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:54:57.535272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 493/996] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Aug 19 20:54:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:57.536085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f59e-d529-4ee2-9d2f-2807dc082d9b None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:57.536447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f59e-d529-4ee2-9d2f-2807dc082d9b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:57.536447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f59e-d529-4ee2-9d2f-2807dc082d9b None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:57.537782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 494/997] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:54:57.538958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 504/998] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Aug 19 20:54:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:57.543043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80f59e-d529-4ee2-9d2f-2807dc082d9b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:57.545592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d3ca0-3b9e-45b1-9351-f7f12b7ec093 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:57.546392 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d3ca0-3b9e-45b1-9351-f7f12b7ec093 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:57.546941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d3ca0-3b9e-45b1-9351-f7f12b7ec093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:57.556812 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:57.576949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-d39d3ca0-3b9e-45b1-9351-f7f12b7ec093 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:54:57.578989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d39d3ca0-3b9e-45b1-9351-f7f12b7ec093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:54:57.661423 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80f59e-d529-4ee2-9d2f-2807dc082d9b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:57.670441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 505/999] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:54:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:54:57.671210 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d3ca0-3b9e-45b1-9351-f7f12b7ec093 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:57.708442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d856f6b-0716-423e-8144-f827f3d5c4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:57.709029 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d856f6b-0716-423e-8144-f827f3d5c4ff None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:57.709344 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d856f6b-0716-423e-8144-f827f3d5c4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:57.709683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d856f6b-0716-423e-8144-f827f3d5c4ff None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:57.710382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d856f6b-0716-423e-8144-f827f3d5c4ff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:57.710936 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d856f6b-0716-423e-8144-f827f3d5c4ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:57.712728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d856f6b-0716-423e-8144-f827f3d5c4ff None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:57.719373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 495/1000] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Aug 19 20:54:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:57.724899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d856f6b-0716-423e-8144-f827f3d5c4ff None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:57.786543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:57.794662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d3ca0-3b9e-45b1-9351-f7f12b7ec093 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:57.828311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:57.850442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede1a66-d89e-4681-a3ce-f12c9fbdb590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:57.851560 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede1a66-d89e-4681-a3ce-f12c9fbdb590 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:57.852084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede1a66-d89e-4681-a3ce-f12c9fbdb590 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:57.852592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede1a66-d89e-4681-a3ce-f12c9fbdb590 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:57.853925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede1a66-d89e-4681-a3ce-f12c9fbdb590 None admin] RBAC: Adding query filter params (interface=public, service_id=ace6154330974a6a9753d646b51c1df7, region_id=RegionOne) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:57.854446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede1a66-d89e-4681-a3ce-f12c9fbdb590 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:57.857202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede1a66-d89e-4681-a3ce-f12c9fbdb590 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:57.860364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d856f6b-0716-423e-8144-f827f3d5c4ff None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:57.869000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 506/1001] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Aug 19 20:54:57 2022] GET /identity/v3/endpoints?service_id=ace6154330974a6a9753d646b51c1df7&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:54:57.879770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede1a66-d89e-4681-a3ce-f12c9fbdb590 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:57.906363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896be390-e4ac-47f4-9163-361e3a4b0eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:57.907031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896be390-e4ac-47f4-9163-361e3a4b0eaa None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:57.907308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896be390-e4ac-47f4-9163-361e3a4b0eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:57.907593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896be390-e4ac-47f4-9163-361e3a4b0eaa None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:57.908249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896be390-e4ac-47f4-9163-361e3a4b0eaa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:57.908557 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896be390-e4ac-47f4-9163-361e3a4b0eaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:57.909940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896be390-e4ac-47f4-9163-361e3a4b0eaa None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:57.918796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 496/1002] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Aug 19 20:54:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:57.924360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896be390-e4ac-47f4-9163-361e3a4b0eaa None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:58.033212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede1a66-d89e-4681-a3ce-f12c9fbdb590 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:58.040253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896be390-e4ac-47f4-9163-361e3a4b0eaa None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:58.072656 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22f6b7-371e-408a-b736-6892ac210a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:58.073291 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22f6b7-371e-408a-b736-6892ac210a7a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:58.073574 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22f6b7-371e-408a-b736-6892ac210a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:58.074461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22f6b7-371e-408a-b736-6892ac210a7a None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:58.075311 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22f6b7-371e-408a-b736-6892ac210a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:58.076719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22f6b7-371e-408a-b736-6892ac210a7a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:58.084048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 507/1003] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Aug 19 20:54:57 2022] GET /identity/v3/services => generated 1727 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 20:54:58.085250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22f6b7-371e-408a-b736-6892ac210a7a None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:58.119553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073d360-accd-4a88-8864-6e333fef079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:58.120326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d360-accd-4a88-8864-6e333fef079d None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:58.120613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d360-accd-4a88-8864-6e333fef079d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:58.121600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d360-accd-4a88-8864-6e333fef079d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:58.122644 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073d360-accd-4a88-8864-6e333fef079d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:58.124527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073d360-accd-4a88-8864-6e333fef079d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:58.133536 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:58.138810 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:58.148449 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 497/1004] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 20:54:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 20:54:58.262952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22f6b7-371e-408a-b736-6892ac210a7a None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:58.324955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415df3df-cdd3-482d-af88-8248c974225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:58.325883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415df3df-cdd3-482d-af88-8248c974225c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:58.326063 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415df3df-cdd3-482d-af88-8248c974225c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:58.326214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415df3df-cdd3-482d-af88-8248c974225c None admin] PATH_INFO: `/v3/services/image` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:58.326786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415df3df-cdd3-482d-af88-8248c974225c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:58.328353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415df3df-cdd3-482d-af88-8248c974225c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-415df3df-cdd3-482d-af88-8248c974225c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:54:58.338183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:54:58.339851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:54:58.341518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 508/1005] 10.222.0.17 () {56 vars in 1105 bytes} [Fri Aug 19 20:54:58 2022] GET /identity/v3/services/image => generated 86 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:54:58.347954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073d360-accd-4a88-8864-6e333fef079d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:58.489530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073d360-accd-4a88-8864-6e333fef079d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:58.527036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4948f-d257-4d54-833d-a03b0d379297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:58.527987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4948f-d257-4d54-833d-a03b0d379297 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:58.528423 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4948f-d257-4d54-833d-a03b0d379297 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:58.528838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4948f-d257-4d54-833d-a03b0d379297 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:58.529889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4948f-d257-4d54-833d-a03b0d379297 None admin] RBAC: Adding query filter params (name=image) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:58.530373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4948f-d257-4d54-833d-a03b0d379297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:58.532531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4948f-d257-4d54-833d-a03b0d379297 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:58.538345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 498/1006] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:54:58.544423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415df3df-cdd3-482d-af88-8248c974225c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:54:58.650898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:54:58.676415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415df3df-cdd3-482d-af88-8248c974225c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:54:58.721354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff9f8-f454-4de0-8f96-58405e304a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:54:58.722370 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff9f8-f454-4de0-8f96-58405e304a78 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:54:58.722894 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff9f8-f454-4de0-8f96-58405e304a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:54:58.723378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff9f8-f454-4de0-8f96-58405e304a78 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:54:58.724238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff9f8-f454-4de0-8f96-58405e304a78 None admin] RBAC: Adding query filter params (type=image) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:54:58.724751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff9f8-f454-4de0-8f96-58405e304a78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:54:58.726333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff9f8-f454-4de0-8f96-58405e304a78 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:54:58.733065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 509/1007] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:54:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:00.118922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483492e7-a19f-4a1b-b06c-3e7b032a8db8 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:00.119714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483492e7-a19f-4a1b-b06c-3e7b032a8db8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:00.119714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483492e7-a19f-4a1b-b06c-3e7b032a8db8 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:00.121509 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 499/1008] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:55:00.126914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc792c-35dc-4c2b-a6ff-e4830e51591b None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:00.127690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc792c-35dc-4c2b-a6ff-e4830e51591b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:00.127690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc792c-35dc-4c2b-a6ff-e4830e51591b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:00.146692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-45bc792c-35dc-4c2b-a6ff-e4830e51591b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:00.147938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-45bc792c-35dc-4c2b-a6ff-e4830e51591b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:00.213928 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de1da-8af3-40cd-bf1a-3b2367cabdcd None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:00.214252 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de1da-8af3-40cd-bf1a-3b2367cabdcd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:00.214546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de1da-8af3-40cd-bf1a-3b2367cabdcd None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:00.216526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 500/1009] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:55:00.225339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03d317-f264-4112-bea5-dfaaaa182229 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:00.225775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03d317-f264-4112-bea5-dfaaaa182229 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:00.226146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03d317-f264-4112-bea5-dfaaaa182229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:00.233229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 510/1010] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:00.248465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ec03d317-f264-4112-bea5-dfaaaa182229 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:00.249689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ec03d317-f264-4112-bea5-dfaaaa182229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:00.318601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:00.334790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 501/1011] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:00.507335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc792c-35dc-4c2b-a6ff-e4830e51591b None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:00.596500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:00.625099 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc792c-35dc-4c2b-a6ff-e4830e51591b None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:00.671529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1cbd2-1a8d-4b74-8241-a6ab59a4e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:00.672175 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1cbd2-1a8d-4b74-8241-a6ab59a4e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:00.672455 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1cbd2-1a8d-4b74-8241-a6ab59a4e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:00.672732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1cbd2-1a8d-4b74-8241-a6ab59a4e8b6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:00.673324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1cbd2-1a8d-4b74-8241-a6ab59a4e8b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:00.674690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1cbd2-1a8d-4b74-8241-a6ab59a4e8b6 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-c2b1cbd2-1a8d-4b74-8241-a6ab59a4e8b6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:00.684641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:00.686673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:00.688448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 511/1012] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:55:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:00.692112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03d317-f264-4112-bea5-dfaaaa182229 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:00.703199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1cbd2-1a8d-4b74-8241-a6ab59a4e8b6 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:00.821085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03d317-f264-4112-bea5-dfaaaa182229 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:00.823304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1cbd2-1a8d-4b74-8241-a6ab59a4e8b6 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:00.860978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eef44-2cec-4241-a174-fe010e1b0994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:00.861626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eef44-2cec-4241-a174-fe010e1b0994 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:00.861910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eef44-2cec-4241-a174-fe010e1b0994 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:00.862067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f754d7-02f7-4551-a7b1-72d1feff6eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:00.862218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eef44-2cec-4241-a174-fe010e1b0994 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:00.862553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f754d7-02f7-4551-a7b1-72d1feff6eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:00.862872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f754d7-02f7-4551-a7b1-72d1feff6eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:00.863011 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74eef44-2cec-4241-a174-fe010e1b0994 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:00.863239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f754d7-02f7-4551-a7b1-72d1feff6eb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:00.863379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74eef44-2cec-4241-a174-fe010e1b0994 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:00.864403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f754d7-02f7-4551-a7b1-72d1feff6eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:00.864704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74eef44-2cec-4241-a174-fe010e1b0994 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:00.865836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f754d7-02f7-4551-a7b1-72d1feff6eb4 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:00.867507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 512/1013] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:00.868709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187949c-087d-4631-9d96-8f9f81945b70 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:00.868991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187949c-087d-4631-9d96-8f9f81945b70 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:00.869270 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187949c-087d-4631-9d96-8f9f81945b70 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:00.870427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 502/1014] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Aug 19 20:55:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:00.876667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 513/1015] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:00.876667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187949c-087d-4631-9d96-8f9f81945b70 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:00.876903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eef44-2cec-4241-a174-fe010e1b0994 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:00.889900 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:00.939351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:00.985399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187949c-087d-4631-9d96-8f9f81945b70 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:00.990267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eef44-2cec-4241-a174-fe010e1b0994 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:01.023850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea0146-e3f6-4360-86e8-73fe842c33ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:01.024372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea0146-e3f6-4360-86e8-73fe842c33ad None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:01.024648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea0146-e3f6-4360-86e8-73fe842c33ad None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:01.024921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea0146-e3f6-4360-86e8-73fe842c33ad None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:01.025562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea0146-e3f6-4360-86e8-73fe842c33ad None admin] RBAC: Adding query filter params (type=compute) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:01.025871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea0146-e3f6-4360-86e8-73fe842c33ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:01.027360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f93a3-e0ac-4b7b-9be5-a30a7a5706ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:01.027603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea0146-e3f6-4360-86e8-73fe842c33ad None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:01.027983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f93a3-e0ac-4b7b-9be5-a30a7a5706ed None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:01.028268 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f93a3-e0ac-4b7b-9be5-a30a7a5706ed None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:01.028538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f93a3-e0ac-4b7b-9be5-a30a7a5706ed None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:01.029193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f93a3-e0ac-4b7b-9be5-a30a7a5706ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:01.030613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f93a3-e0ac-4b7b-9be5-a30a7a5706ed None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:01.033007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 514/1016] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Aug 19 20:55:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:01.034253 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8895b11-5403-4acc-a242-ad3410239539 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:01.034540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8895b11-5403-4acc-a242-ad3410239539 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:01.034848 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8895b11-5403-4acc-a242-ad3410239539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:01.054427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-c8895b11-5403-4acc-a242-ad3410239539 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:01.055947 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c8895b11-5403-4acc-a242-ad3410239539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:01.066911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 503/1017] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:55:00 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:55:01.067736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f93a3-e0ac-4b7b-9be5-a30a7a5706ed None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:01.156063 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 515/1018] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:01 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:01.216369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f93a3-e0ac-4b7b-9be5-a30a7a5706ed None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:01.226942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:01.261920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecc7b5-542c-400a-beba-0dc7f6ac9df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:01.263341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecc7b5-542c-400a-beba-0dc7f6ac9df1 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:01.264543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecc7b5-542c-400a-beba-0dc7f6ac9df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:01.264871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecc7b5-542c-400a-beba-0dc7f6ac9df1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:01.265586 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecc7b5-542c-400a-beba-0dc7f6ac9df1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:01.267056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecc7b5-542c-400a-beba-0dc7f6ac9df1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:01.291579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 504/1019] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 20:55:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:55:01.590288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8895b11-5403-4acc-a242-ad3410239539 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:01.593023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:01.727270 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8895b11-5403-4acc-a242-ad3410239539 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:01.780005 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f79c4-f4ca-4f71-9047-32bccc7bde47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:01.780630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f79c4-f4ca-4f71-9047-32bccc7bde47 None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:01.780911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f79c4-f4ca-4f71-9047-32bccc7bde47 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:01.781184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f79c4-f4ca-4f71-9047-32bccc7bde47 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:01.781841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f79c4-f4ca-4f71-9047-32bccc7bde47 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:01.783338 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f79c4-f4ca-4f71-9047-32bccc7bde47 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:01.806784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 516/1020] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:55:01 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 20:55:03.890107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f2003-f6e8-4c61-be90-6e03e8775a31 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:03.890942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f2003-f6e8-4c61-be90-6e03e8775a31 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:03.891222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f2003-f6e8-4c61-be90-6e03e8775a31 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:03.893720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 505/1021] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:03.903140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c2b1-d1c1-4300-9e20-b5930ee0eec8 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:03.903919 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c2b1-d1c1-4300-9e20-b5930ee0eec8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:03.904237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c2b1-d1c1-4300-9e20-b5930ee0eec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:03.918072 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8c263-925b-4cba-b3ad-6db63386842b None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:03.918072 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8c263-925b-4cba-b3ad-6db63386842b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:03.918072 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8c263-925b-4cba-b3ad-6db63386842b None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:03.919962 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 506/1022] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:55:03.925460 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a60d7-4182-45e9-bb38-b8db9b9b2577 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:03.925742 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a60d7-4182-45e9-bb38-b8db9b9b2577 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:03.926119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a60d7-4182-45e9-bb38-b8db9b9b2577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:03.936417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-1765c2b1-d1c1-4300-9e20-b5930ee0eec8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:03.938628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1765c2b1-d1c1-4300-9e20-b5930ee0eec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:03.946098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e97a60d7-4182-45e9-bb38-b8db9b9b2577 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:03.948042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e97a60d7-4182-45e9-bb38-b8db9b9b2577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:04.044746 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:04.057118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 507/1023] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:55:04.076455 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 517/1024] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:04.476904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e9fcc-8e4c-46a3-878c-ec715eab39ba None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:04.477333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e9fcc-8e4c-46a3-878c-ec715eab39ba None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:04.477533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e9fcc-8e4c-46a3-878c-ec715eab39ba None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:04.479115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 508/1025] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:55:04.486633 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6553a-fbaa-468b-a370-7b637ad92cd3 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:04.487224 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6553a-fbaa-468b-a370-7b637ad92cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:04.487645 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6553a-fbaa-468b-a370-7b637ad92cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:04.519481 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-dcc6553a-fbaa-468b-a370-7b637ad92cd3 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:04.521454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-dcc6553a-fbaa-468b-a370-7b637ad92cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:04.544148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e9fcc-8e4c-46a3-878c-ec715eab39ba None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:04.637141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 518/1026] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:55:04.638330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6553a-fbaa-468b-a370-7b637ad92cd3 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:04.671877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:04.693115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e9fcc-8e4c-46a3-878c-ec715eab39ba None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:04.752566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1902f-126a-4a00-bbf1-1d2e21be4093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:04.753212 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1902f-126a-4a00-bbf1-1d2e21be4093 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:04.753550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1902f-126a-4a00-bbf1-1d2e21be4093 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:04.753845 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1902f-126a-4a00-bbf1-1d2e21be4093 None admin] PATH_INFO: `/v3/services/image` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:04.754520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1902f-126a-4a00-bbf1-1d2e21be4093 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:04.756051 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1902f-126a-4a00-bbf1-1d2e21be4093 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-2bf1902f-126a-4a00-bbf1-1d2e21be4093 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:04.766720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:04.768611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 20:55:04.770246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:04.773983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 509/1027] 10.222.0.17 () {56 vars in 1105 bytes} [Fri Aug 19 20:55:04 2022] GET /identity/v3/services/image => generated 86 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:04.774227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1902f-126a-4a00-bbf1-1d2e21be4093 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:04.832182 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6553a-fbaa-468b-a370-7b637ad92cd3 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:04.869281 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:04.891533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331a544-776e-40f0-a5ae-836c17b0e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:04.892187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331a544-776e-40f0-a5ae-836c17b0e85c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:04.892469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331a544-776e-40f0-a5ae-836c17b0e85c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:04.892752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331a544-776e-40f0-a5ae-836c17b0e85c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:04.893950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331a544-776e-40f0-a5ae-836c17b0e85c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:04.895445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331a544-776e-40f0-a5ae-836c17b0e85c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:04.897367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 519/1028] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:04.903565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331a544-776e-40f0-a5ae-836c17b0e85c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:04.914046 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1902f-126a-4a00-bbf1-1d2e21be4093 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:04.957893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fb165-2751-4256-83f8-3a15ec5629a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:04.958526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fb165-2751-4256-83f8-3a15ec5629a8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:04.958858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fb165-2751-4256-83f8-3a15ec5629a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:04.959527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fb165-2751-4256-83f8-3a15ec5629a8 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:04.960189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fb165-2751-4256-83f8-3a15ec5629a8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:04.960664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fb165-2751-4256-83f8-3a15ec5629a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:04.962204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fb165-2751-4256-83f8-3a15ec5629a8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:04.970968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 510/1029] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:04.976769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fb165-2751-4256-83f8-3a15ec5629a8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:05.000804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:05.088459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331a544-776e-40f0-a5ae-836c17b0e85c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:05.129790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fb165-2751-4256-83f8-3a15ec5629a8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:05.143616 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399c183-82c6-4e04-9ac5-542b2aa40ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:05.144580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399c183-82c6-4e04-9ac5-542b2aa40ca7 None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:05.145021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399c183-82c6-4e04-9ac5-542b2aa40ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:05.145471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399c183-82c6-4e04-9ac5-542b2aa40ca7 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:05.146593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399c183-82c6-4e04-9ac5-542b2aa40ca7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:05.148946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399c183-82c6-4e04-9ac5-542b2aa40ca7 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:05.181617 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 520/1030] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:55:04 2022] POST /identity/v3/users => generated 285 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 20:55:05.188631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399c183-82c6-4e04-9ac5-542b2aa40ca7 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:05.190223 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75b768-d3f1-41e7-a957-5770d1da8e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:05.190962 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75b768-d3f1-41e7-a957-5770d1da8e1f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:05.191282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75b768-d3f1-41e7-a957-5770d1da8e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:05.191596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75b768-d3f1-41e7-a957-5770d1da8e1f None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:05.192316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75b768-d3f1-41e7-a957-5770d1da8e1f None admin] RBAC: Adding query filter params (type=image) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:05.192686 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75b768-d3f1-41e7-a957-5770d1da8e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:05.194222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75b768-d3f1-41e7-a957-5770d1da8e1f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:05.204339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 511/1031] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:05.216900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75b768-d3f1-41e7-a957-5770d1da8e1f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:05.263118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:05.357874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:05.377839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399c183-82c6-4e04-9ac5-542b2aa40ca7 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:05.381881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75b768-d3f1-41e7-a957-5770d1da8e1f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:05.433834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31eba84-6c7c-4d35-9ed4-9409798b68bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:05.434626 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eba84-6c7c-4d35-9ed4-9409798b68bf None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:05.435065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eba84-6c7c-4d35-9ed4-9409798b68bf None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:05.435525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eba84-6c7c-4d35-9ed4-9409798b68bf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:05.440214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2a09a-9851-49d4-af0e-4ac0a8151851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:05.441267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2a09a-9851-49d4-af0e-4ac0a8151851 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:05.441779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2a09a-9851-49d4-af0e-4ac0a8151851 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:05.442282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2a09a-9851-49d4-af0e-4ac0a8151851 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:05.443701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2a09a-9851-49d4-af0e-4ac0a8151851 None admin] RBAC: Adding query filter params (interface=public, service_id=ef2cd81e0004450e84eb88225c85ed81, region_id=RegionOne) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:05.444269 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2a09a-9851-49d4-af0e-4ac0a8151851 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:05.447110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2a09a-9851-49d4-af0e-4ac0a8151851 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:05.451503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31eba84-6c7c-4d35-9ed4-9409798b68bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-a31eba84-6c7c-4d35-9ed4-9409798b68bf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:55:05.458152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:05.460017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:05.462038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:05.462038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:05.462038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:05.462038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:05.462038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:55:05.462038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:55:05.462038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:55:05.462038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:55:05.462038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:55:05.462038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:55:05.462038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 20:55:05.462038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:05.462874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 512/1032] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Aug 19 20:55:05 2022] GET /identity/v3/endpoints?service_id=ef2cd81e0004450e84eb88225c85ed81&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:05.463019 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 521/1033] 10.222.0.17 () {56 vars in 1120 bytes} [Fri Aug 19 20:55:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:05.468507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2a09a-9851-49d4-af0e-4ac0a8151851 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:05.469458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31eba84-6c7c-4d35-9ed4-9409798b68bf None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:05.610480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31eba84-6c7c-4d35-9ed4-9409798b68bf None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:05.612389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:05.621442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2a09a-9851-49d4-af0e-4ac0a8151851 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:05.662906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc004d-88e6-4b42-9877-f09be0674337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:05.663533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc004d-88e6-4b42-9877-f09be0674337 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:05.663819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc004d-88e6-4b42-9877-f09be0674337 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:05.664093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc004d-88e6-4b42-9877-f09be0674337 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:05.664773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc004d-88e6-4b42-9877-f09be0674337 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:05.664881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e0a61-bb9f-4feb-9f62-ee7ab3397cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:05.665081 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc004d-88e6-4b42-9877-f09be0674337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:05.665843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e0a61-bb9f-4feb-9f62-ee7ab3397cda None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:05.666288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e0a61-bb9f-4feb-9f62-ee7ab3397cda None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:05.666529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc004d-88e6-4b42-9877-f09be0674337 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:05.666624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e0a61-bb9f-4feb-9f62-ee7ab3397cda None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:05.668296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e0a61-bb9f-4feb-9f62-ee7ab3397cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:05.670882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e0a61-bb9f-4feb-9f62-ee7ab3397cda None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:05.684687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 513/1034] 10.222.0.17 () {56 vars in 1115 bytes} [Fri Aug 19 20:55:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:05.684901 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 522/1035] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Aug 19 20:55:05 2022] GET /identity/v3/services => generated 1957 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 20:55:05.687340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc004d-88e6-4b42-9877-f09be0674337 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:05.708697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:05.881379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc004d-88e6-4b42-9877-f09be0674337 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:05.943802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b59c7f-c9a2-498c-b9fd-20521130a06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:05.944908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b59c7f-c9a2-498c-b9fd-20521130a06d None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:05.945406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b59c7f-c9a2-498c-b9fd-20521130a06d None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:05.945890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b59c7f-c9a2-498c-b9fd-20521130a06d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:05.966273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b59c7f-c9a2-498c-b9fd-20521130a06d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:05.969109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b59c7f-c9a2-498c-b9fd-20521130a06d None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-b1b59c7f-c9a2-498c-b9fd-20521130a06d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:55:05.997883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:05.999224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:55:06.000166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:55:06.000166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:06.000166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:06.005395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 514/1036] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:06.008254 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e0a61-bb9f-4feb-9f62-ee7ab3397cda None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:06.197213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e0a61-bb9f-4feb-9f62-ee7ab3397cda None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:06.249697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e61b6-ad52-40a1-acc6-1f709678915c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:06.250312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e61b6-ad52-40a1-acc6-1f709678915c None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:06.250599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e61b6-ad52-40a1-acc6-1f709678915c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:06.250908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e61b6-ad52-40a1-acc6-1f709678915c None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:06.251545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e61b6-ad52-40a1-acc6-1f709678915c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:06.251844 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e61b6-ad52-40a1-acc6-1f709678915c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:06.253214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e61b6-ad52-40a1-acc6-1f709678915c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:06.268250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 523/1037] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:06.274550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b59c7f-c9a2-498c-b9fd-20521130a06d None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:06.390293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:06.469884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b59c7f-c9a2-498c-b9fd-20521130a06d None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:06.544105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88552910-192f-48c1-9281-89c249bc4f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:06.544756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88552910-192f-48c1-9281-89c249bc4f46 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:06.545027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88552910-192f-48c1-9281-89c249bc4f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:06.545307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88552910-192f-48c1-9281-89c249bc4f46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:06.555203 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88552910-192f-48c1-9281-89c249bc4f46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:06.556674 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88552910-192f-48c1-9281-89c249bc4f46 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-88552910-192f-48c1-9281-89c249bc4f46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:55:06.570128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:06.579981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:06.581959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:06.581959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:06.581959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:55:06.581959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:55:06.581959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:55:06.581959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:55:06.581959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:55:06.581959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:55:06.581959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:55:06.581959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:06.581959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 515/1038] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Aug 19 20:55:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:55:06.586566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e61b6-ad52-40a1-acc6-1f709678915c None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:06.640969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:06.729395 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e61b6-ad52-40a1-acc6-1f709678915c None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:06.786003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87516be6-97ed-4420-bf83-e51265d14189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:06.786621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87516be6-97ed-4420-bf83-e51265d14189 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:06.786936 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87516be6-97ed-4420-bf83-e51265d14189 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:06.787189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87516be6-97ed-4420-bf83-e51265d14189 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:06.787941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87516be6-97ed-4420-bf83-e51265d14189 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:06.788250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87516be6-97ed-4420-bf83-e51265d14189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:06.789693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87516be6-97ed-4420-bf83-e51265d14189 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:06.818785 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 524/1039] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Aug 19 20:55:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:06.822918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88552910-192f-48c1-9281-89c249bc4f46 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:07.000659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88552910-192f-48c1-9281-89c249bc4f46 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:07.030164 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:07.049828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f1219-2bba-4798-97d0-bdb57e66d47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:07.050454 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f1219-2bba-4798-97d0-bdb57e66d47c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:07.050798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f1219-2bba-4798-97d0-bdb57e66d47c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:07.051058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f1219-2bba-4798-97d0-bdb57e66d47c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:07.132244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f1219-2bba-4798-97d0-bdb57e66d47c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:07.133785 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f1219-2bba-4798-97d0-bdb57e66d47c None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:07.284884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 516/1040] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:55:06 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:55:07.292221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87516be6-97ed-4420-bf83-e51265d14189 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:07.463371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:07.495680 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87516be6-97ed-4420-bf83-e51265d14189 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:07.565048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a44de-97e6-4a2d-8497-8bb1ac2dfc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:07.566204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a44de-97e6-4a2d-8497-8bb1ac2dfc05 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:07.566705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a44de-97e6-4a2d-8497-8bb1ac2dfc05 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:07.567241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a44de-97e6-4a2d-8497-8bb1ac2dfc05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:07.587583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a44de-97e6-4a2d-8497-8bb1ac2dfc05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:07.591610 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a44de-97e6-4a2d-8497-8bb1ac2dfc05 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-440a44de-97e6-4a2d-8497-8bb1ac2dfc05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:55:07.621751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:07.631365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:55:07.633160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:55:07.633160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:07.633160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:07.633160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 525/1041] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:07.633400 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f1219-2bba-4798-97d0-bdb57e66d47c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:07.676339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:07.695566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ddb7-3f21-437b-aa60-69d338304031 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:07.696019 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ddb7-3f21-437b-aa60-69d338304031 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:07.696427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ddb7-3f21-437b-aa60-69d338304031 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:07.699229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 526/1042] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:07.707422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619484c-a6aa-4174-82ec-18953d950da3 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:07.707874 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619484c-a6aa-4174-82ec-18953d950da3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:07.708330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619484c-a6aa-4174-82ec-18953d950da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:07.737888 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-6619484c-a6aa-4174-82ec-18953d950da3 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:07.741940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6619484c-a6aa-4174-82ec-18953d950da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:07.829461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f1219-2bba-4798-97d0-bdb57e66d47c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:07.871191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 527/1043] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:55:07.896346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dffb1-8ca8-4298-88c5-56e5de977090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:07.897308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dffb1-8ca8-4298-88c5-56e5de977090 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:07.897607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dffb1-8ca8-4298-88c5-56e5de977090 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:07.898001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dffb1-8ca8-4298-88c5-56e5de977090 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:07.898704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dffb1-8ca8-4298-88c5-56e5de977090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:07.899137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dffb1-8ca8-4298-88c5-56e5de977090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:07.900897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dffb1-8ca8-4298-88c5-56e5de977090 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:07.918266 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 517/1044] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:07.925239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619484c-a6aa-4174-82ec-18953d950da3 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:08.005150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:08.035393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e34ab-be77-4bd2-ba21-bee2eff2372d None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:08.035950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e34ab-be77-4bd2-ba21-bee2eff2372d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:08.036211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e34ab-be77-4bd2-ba21-bee2eff2372d None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:08.038209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 518/1045] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:08.044517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143d445-3ec4-4f4a-b42b-454df3db5594 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:08.044776 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143d445-3ec4-4f4a-b42b-454df3db5594 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:08.045062 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143d445-3ec4-4f4a-b42b-454df3db5594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:08.061974 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619484c-a6aa-4174-82ec-18953d950da3 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:08.068950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4143d445-3ec4-4f4a-b42b-454df3db5594 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:08.070333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4143d445-3ec4-4f4a-b42b-454df3db5594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:08.106568 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc08c4-d28d-46f4-8f8f-d49aff96f4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:08.107126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc08c4-d28d-46f4-8f8f-d49aff96f4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:08.107410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc08c4-d28d-46f4-8f8f-d49aff96f4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:08.107682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc08c4-d28d-46f4-8f8f-d49aff96f4b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:08.117016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc08c4-d28d-46f4-8f8f-d49aff96f4b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:08.119821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc08c4-d28d-46f4-8f8f-d49aff96f4b0 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-89fc08c4-d28d-46f4-8f8f-d49aff96f4b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:55:08.141835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:08.142972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:08.144493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:55:08.144493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:55:08.144493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:55:08.144493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:55:08.144493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:55:08.144493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:55:08.144493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:55:08.144493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:08.144493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 528/1046] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:55:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:08.151586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc08c4-d28d-46f4-8f8f-d49aff96f4b0 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:08.177251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 519/1047] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:55:08.178555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143d445-3ec4-4f4a-b42b-454df3db5594 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:08.199101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:08.271493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc08c4-d28d-46f4-8f8f-d49aff96f4b0 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:08.314421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:08.329596 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb53581-cb50-4a34-835f-a2c8e879e098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:08.330515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53581-cb50-4a34-835f-a2c8e879e098 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:08.330985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53581-cb50-4a34-835f-a2c8e879e098 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:08.331391 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143d445-3ec4-4f4a-b42b-454df3db5594 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:08.331552 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53581-cb50-4a34-835f-a2c8e879e098 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:08.332484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb53581-cb50-4a34-835f-a2c8e879e098 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:08.333302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb53581-cb50-4a34-835f-a2c8e879e098 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:08.336525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb53581-cb50-4a34-835f-a2c8e879e098 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:08.357812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 529/1048] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:55:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:08.364089 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb53581-cb50-4a34-835f-a2c8e879e098 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:08.387302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7931386-239a-48ee-9a9e-770b0b3a5666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:08.388071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7931386-239a-48ee-9a9e-770b0b3a5666 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:08.388459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7931386-239a-48ee-9a9e-770b0b3a5666 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:08.388906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7931386-239a-48ee-9a9e-770b0b3a5666 None admin] PATH_INFO: `/v3/services/image` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:08.389562 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7931386-239a-48ee-9a9e-770b0b3a5666 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:08.391299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7931386-239a-48ee-9a9e-770b0b3a5666 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-d7931386-239a-48ee-9a9e-770b0b3a5666 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:08.401255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:08.404397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:08.406120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 520/1049] 10.222.0.17 () {56 vars in 1105 bytes} [Fri Aug 19 20:55:08 2022] GET /identity/v3/services/image => generated 86 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:08.410990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7931386-239a-48ee-9a9e-770b0b3a5666 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:08.489812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb53581-cb50-4a34-835f-a2c8e879e098 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:08.510942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:08.530773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6a0fe-9d8a-412a-b34d-aaac4eda9f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:08.531507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6a0fe-9d8a-412a-b34d-aaac4eda9f48 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:08.531964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6a0fe-9d8a-412a-b34d-aaac4eda9f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:08.532323 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6a0fe-9d8a-412a-b34d-aaac4eda9f48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:08.533412 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6a0fe-9d8a-412a-b34d-aaac4eda9f48 None admin] RBAC: Adding query filter params (role.id=2acaf26ecd8a4392aac8a20d15f672ad, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=83e51beb8d0e4219af906860ce906500) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:08.533921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6a0fe-9d8a-412a-b34d-aaac4eda9f48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:08.535622 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6a0fe-9d8a-412a-b34d-aaac4eda9f48 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:08.541870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7931386-239a-48ee-9a9e-770b0b3a5666 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:08.542049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 530/1050] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:55:08 2022] GET /identity/v3/role_assignments?user.id=83e51beb8d0e4219af906860ce906500&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=2acaf26ecd8a4392aac8a20d15f672ad => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:08.542918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6a0fe-9d8a-412a-b34d-aaac4eda9f48 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:08.589365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1b161-0741-4e42-ab07-a6a26ca379b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:08.590005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1b161-0741-4e42-ab07-a6a26ca379b7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:08.590285 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1b161-0741-4e42-ab07-a6a26ca379b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:08.590559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1b161-0741-4e42-ab07-a6a26ca379b7 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:08.591268 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1b161-0741-4e42-ab07-a6a26ca379b7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:08.591573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1b161-0741-4e42-ab07-a6a26ca379b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:08.593088 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1b161-0741-4e42-ab07-a6a26ca379b7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:08.606550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 521/1051] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:08.611699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:08.614160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1b161-0741-4e42-ab07-a6a26ca379b7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:08.708680 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6a0fe-9d8a-412a-b34d-aaac4eda9f48 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:08.765984 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aa9e8-9aeb-40e6-a6d5-b0859cbe68b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:08.767254 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aa9e8-9aeb-40e6-a6d5-b0859cbe68b8 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:08.767770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aa9e8-9aeb-40e6-a6d5-b0859cbe68b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:08.768276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aa9e8-9aeb-40e6-a6d5-b0859cbe68b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:08.776024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1b161-0741-4e42-ab07-a6a26ca379b7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:08.788087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65aa9e8-9aeb-40e6-a6d5-b0859cbe68b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-a65aa9e8-9aeb-40e6-a6d5-b0859cbe68b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:55:08.797935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:08.800064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:08.801563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:08.801563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:08.801563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:08.801563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:08.801563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:55:08.801563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:55:08.801563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:55:08.801563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:55:08.801563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:55:08.801563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:55:08.801563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:55:08.801563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:08.801563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 531/1052] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:55:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:08.811562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aa9e8-9aeb-40e6-a6d5-b0859cbe68b8 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:08.821725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231185e-da08-4b2b-881b-47b1f1abe4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:08.822414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231185e-da08-4b2b-881b-47b1f1abe4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:08.822693 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231185e-da08-4b2b-881b-47b1f1abe4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:08.823056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231185e-da08-4b2b-881b-47b1f1abe4d8 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:08.824573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231185e-da08-4b2b-881b-47b1f1abe4d8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:08.824961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231185e-da08-4b2b-881b-47b1f1abe4d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:08.826820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231185e-da08-4b2b-881b-47b1f1abe4d8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:08.833322 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 522/1053] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:08.839040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231185e-da08-4b2b-881b-47b1f1abe4d8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:08.842986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:08.940937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aa9e8-9aeb-40e6-a6d5-b0859cbe68b8 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:08.959932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:08.975280 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231185e-da08-4b2b-881b-47b1f1abe4d8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:09.001209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcaea8-bdcc-4f04-bae9-e92e1bc418af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:09.002263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcaea8-bdcc-4f04-bae9-e92e1bc418af None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:09.002770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcaea8-bdcc-4f04-bae9-e92e1bc418af None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:09.003258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcaea8-bdcc-4f04-bae9-e92e1bc418af None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:09.004467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcaea8-bdcc-4f04-bae9-e92e1bc418af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:09.005017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcaea8-bdcc-4f04-bae9-e92e1bc418af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:09.007787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcaea8-bdcc-4f04-bae9-e92e1bc418af None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:09.020224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5bd84-ffa5-470c-897a-d22ec14c41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:09.020843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5bd84-ffa5-470c-897a-d22ec14c41c9 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:09.021117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5bd84-ffa5-470c-897a-d22ec14c41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:09.021393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5bd84-ffa5-470c-897a-d22ec14c41c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:09.022063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5bd84-ffa5-470c-897a-d22ec14c41c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:09.023516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5bd84-ffa5-470c-897a-d22ec14c41c9 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:09.026112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 532/1054] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:55:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:09.032544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcaea8-bdcc-4f04-bae9-e92e1bc418af None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:09.062778 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 523/1055] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 20:55:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:55:09.186576 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcaea8-bdcc-4f04-bae9-e92e1bc418af None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:09.238711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ad43-00da-4921-891f-25fc6fc602b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:09.239334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ad43-00da-4921-891f-25fc6fc602b3 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:09.239669 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ad43-00da-4921-891f-25fc6fc602b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:09.239951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ad43-00da-4921-891f-25fc6fc602b3 None admin] PATH_INFO: `/v3/users/61e4ae42741545cda05f3f063bff65dd` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:09.259413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5ad43-00da-4921-891f-25fc6fc602b3 None admin] RBAC: Authorizing `identity:get_user(user_id=61e4ae42741545cda05f3f063bff65dd)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:09.260859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5ad43-00da-4921-891f-25fc6fc602b3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:09.264040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 533/1056] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:55:09 2022] GET /identity/v3/users/61e4ae42741545cda05f3f063bff65dd => generated 285 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:09.272716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5bd84-ffa5-470c-897a-d22ec14c41c9 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:09.346939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:09.424960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5bd84-ffa5-470c-897a-d22ec14c41c9 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:09.484147 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3628523-bbc7-4000-90b4-89733531fd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:09.485232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3628523-bbc7-4000-90b4-89733531fd20 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:09.485749 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3628523-bbc7-4000-90b4-89733531fd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:09.486253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3628523-bbc7-4000-90b4-89733531fd20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:09.571987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3628523-bbc7-4000-90b4-89733531fd20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:09.573365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3628523-bbc7-4000-90b4-89733531fd20 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:09.675369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:09.738207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 524/1057] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:55:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:55:09.740366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ad43-00da-4921-891f-25fc6fc602b3 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:09.783852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:09.868230 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ad43-00da-4921-891f-25fc6fc602b3 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:09.905649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821354f-696c-43f7-b33d-2ca057c29885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:09.906316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821354f-696c-43f7-b33d-2ca057c29885 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:09.906680 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821354f-696c-43f7-b33d-2ca057c29885 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:09.906985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821354f-696c-43f7-b33d-2ca057c29885 None admin] PATH_INFO: `/v3/projects/31eb80c4838e407392953e0200746ac1` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:09.908179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821354f-696c-43f7-b33d-2ca057c29885 None admin] RBAC: Authorizing `identity:get_project(project_id=31eb80c4838e407392953e0200746ac1)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:09.909603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821354f-696c-43f7-b33d-2ca057c29885 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:09.919048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 534/1058] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:55:09 2022] GET /identity/v3/projects/31eb80c4838e407392953e0200746ac1 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:09.922927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3628523-bbc7-4000-90b4-89733531fd20 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:10.111650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3628523-bbc7-4000-90b4-89733531fd20 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:10.158652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274487b-3207-43c8-8c76-73ca9c70e69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:10.159707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274487b-3207-43c8-8c76-73ca9c70e69f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:10.160202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274487b-3207-43c8-8c76-73ca9c70e69f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:10.160711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274487b-3207-43c8-8c76-73ca9c70e69f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:10.162133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274487b-3207-43c8-8c76-73ca9c70e69f None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=31eb80c4838e407392953e0200746ac1, user.id=61e4ae42741545cda05f3f063bff65dd) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:10.162699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274487b-3207-43c8-8c76-73ca9c70e69f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:10.165584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274487b-3207-43c8-8c76-73ca9c70e69f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:10.175949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 525/1059] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:55:09 2022] GET /identity/v3/role_assignments?user.id=61e4ae42741545cda05f3f063bff65dd&scope.project.id=31eb80c4838e407392953e0200746ac1&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:10.641286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d234-eb81-47a7-9e69-46c2678a8552 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:10.641690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d234-eb81-47a7-9e69-46c2678a8552 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:10.641880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d234-eb81-47a7-9e69-46c2678a8552 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:10.643550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 535/1060] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:55:10.649580 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a01377-ff02-4ebd-ab4b-2efd31a272fc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:10.649946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a01377-ff02-4ebd-ab4b-2efd31a272fc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:10.650133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a01377-ff02-4ebd-ab4b-2efd31a272fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:10.671595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-44a01377-ff02-4ebd-ab4b-2efd31a272fc None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:10.673228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-44a01377-ff02-4ebd-ab4b-2efd31a272fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:10.698137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:10.790784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 526/1061] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:11.164123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375d234-eb81-47a7-9e69-46c2678a8552 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:11.241736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc090c-be56-4b97-a0f5-7b145318b58a None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:11.242552 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc090c-be56-4b97-a0f5-7b145318b58a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:11.242552 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc090c-be56-4b97-a0f5-7b145318b58a None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:11.243947 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 527/1062] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:11.249642 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83524c-71f5-4e90-8274-d2fd72461d7c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:11.250022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83524c-71f5-4e90-8274-d2fd72461d7c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:11.250187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83524c-71f5-4e90-8274-d2fd72461d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:11.269871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5a83524c-71f5-4e90-8274-d2fd72461d7c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:11.271237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5a83524c-71f5-4e90-8274-d2fd72461d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:11.281490 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:11.291163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375d234-eb81-47a7-9e69-46c2678a8552 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:11.344363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ab342-a3b4-4bcb-b5dc-cf4ab873045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:11.345453 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ab342-a3b4-4bcb-b5dc-cf4ab873045b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:11.345967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ab342-a3b4-4bcb-b5dc-cf4ab873045b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:11.346483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ab342-a3b4-4bcb-b5dc-cf4ab873045b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:11.347566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 528/1063] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:55:11.373367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ab342-a3b4-4bcb-b5dc-cf4ab873045b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-b20ab342-a3b4-4bcb-b5dc-cf4ab873045b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:55:11.383562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:11.385376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:11.388319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:11.388319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:11.388319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:11.388319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:11.388319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:55:11.388319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:55:11.388319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:55:11.388319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:55:11.388319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:55:11.388319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:55:11.388319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 20:55:11.388319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:11.390693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 536/1064] 10.222.0.17 () {56 vars in 1120 bytes} [Fri Aug 19 20:55:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:55:11.397396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83524c-71f5-4e90-8274-d2fd72461d7c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:11.507865 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:11.532485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83524c-71f5-4e90-8274-d2fd72461d7c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:11.575056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f16b4-bc1a-4ffa-bb7a-bf0a50fdbe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:11.575884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f16b4-bc1a-4ffa-bb7a-bf0a50fdbe26 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:11.576297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f16b4-bc1a-4ffa-bb7a-bf0a50fdbe26 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:11.576704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f16b4-bc1a-4ffa-bb7a-bf0a50fdbe26 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:11.577559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f16b4-bc1a-4ffa-bb7a-bf0a50fdbe26 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:11.577990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f16b4-bc1a-4ffa-bb7a-bf0a50fdbe26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:11.579590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f16b4-bc1a-4ffa-bb7a-bf0a50fdbe26 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:11.596358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 529/1065] 10.222.0.17 () {56 vars in 1115 bytes} [Fri Aug 19 20:55:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:11.598421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ab342-a3b4-4bcb-b5dc-cf4ab873045b None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:11.631163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f16b4-bc1a-4ffa-bb7a-bf0a50fdbe26 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:11.783358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f16b4-bc1a-4ffa-bb7a-bf0a50fdbe26 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:11.795064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ab342-a3b4-4bcb-b5dc-cf4ab873045b None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:11.832045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559dad9-6b0b-4296-96f8-20f68e04bc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:11.832673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559dad9-6b0b-4296-96f8-20f68e04bc1e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:11.832959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559dad9-6b0b-4296-96f8-20f68e04bc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:11.833244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559dad9-6b0b-4296-96f8-20f68e04bc1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:11.850893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea64359-cc6f-465a-8ede-1bb3c0045ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:11.851822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea64359-cc6f-465a-8ede-1bb3c0045ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:11.852241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea64359-cc6f-465a-8ede-1bb3c0045ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:11.852697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea64359-cc6f-465a-8ede-1bb3c0045ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:11.853934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:11.868761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea64359-cc6f-465a-8ede-1bb3c0045ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:11.871412 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea64359-cc6f-465a-8ede-1bb3c0045ba8 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-fea64359-cc6f-465a-8ede-1bb3c0045ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:55:11.889619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:11.891413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:55:11.892393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:55:11.892393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:11.892393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:11.892393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 537/1066] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:55:11.897171 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea64359-cc6f-465a-8ede-1bb3c0045ba8 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:11.908268 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:11.936198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559dad9-6b0b-4296-96f8-20f68e04bc1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:11.938417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559dad9-6b0b-4296-96f8-20f68e04bc1e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:12.022327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea64359-cc6f-465a-8ede-1bb3c0045ba8 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:12.069096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c485f1-4460-4f96-8b8a-efc02d304bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:12.070009 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c485f1-4460-4f96-8b8a-efc02d304bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:12.070451 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c485f1-4460-4f96-8b8a-efc02d304bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:12.070941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c485f1-4460-4f96-8b8a-efc02d304bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:12.072232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c485f1-4460-4f96-8b8a-efc02d304bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:12.072367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c485f1-4460-4f96-8b8a-efc02d304bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:12.074908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c485f1-4460-4f96-8b8a-efc02d304bd5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:12.095220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 530/1067] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:55:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 20:55:12.095503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 538/1068] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:12.099426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559dad9-6b0b-4296-96f8-20f68e04bc1e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:12.101183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c485f1-4460-4f96-8b8a-efc02d304bd5 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:12.160664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:12.202871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:12.226484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559dad9-6b0b-4296-96f8-20f68e04bc1e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:12.266268 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c485f1-4460-4f96-8b8a-efc02d304bd5 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:12.280148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58d119-34c8-4f8f-a828-a9559ebc2f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:12.281236 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58d119-34c8-4f8f-a828-a9559ebc2f9a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:12.281702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58d119-34c8-4f8f-a828-a9559ebc2f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:12.282203 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58d119-34c8-4f8f-a828-a9559ebc2f9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:12.302529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58d119-34c8-4f8f-a828-a9559ebc2f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:12.304170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fae30-7c0f-4b5c-b250-026d9a349abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:12.304824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fae30-7c0f-4b5c-b250-026d9a349abb None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:12.305108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fae30-7c0f-4b5c-b250-026d9a349abb None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:12.305343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58d119-34c8-4f8f-a828-a9559ebc2f9a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:12.305440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fae30-7c0f-4b5c-b250-026d9a349abb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:12.313981 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3fae30-7c0f-4b5c-b250-026d9a349abb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:12.315488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3fae30-7c0f-4b5c-b250-026d9a349abb None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-4f3fae30-7c0f-4b5c-b250-026d9a349abb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:55:12.328759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:12.334993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:12.336064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:12.336064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:12.336064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:55:12.336064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:55:12.336064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:55:12.336064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:55:12.336064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:55:12.336064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:55:12.336064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:55:12.336064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:12.336064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 539/1069] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Aug 19 20:55:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:55:12.336064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fae30-7c0f-4b5c-b250-026d9a349abb None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-6e58d119-34c8-4f8f-a828-a9559ebc2f9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:55:12.336726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:12.337592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:55:12.338507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:55:12.338507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:12.338507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:12.340005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 531/1070] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:55:12.350132 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58d119-34c8-4f8f-a828-a9559ebc2f9a None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:12.462767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fae30-7c0f-4b5c-b250-026d9a349abb None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:12.499856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:12.507393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:12.513280 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f905080-581e-4db7-9f30-597b8e40f629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:12.514082 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f905080-581e-4db7-9f30-597b8e40f629 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:12.514493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f905080-581e-4db7-9f30-597b8e40f629 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:12.514939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f905080-581e-4db7-9f30-597b8e40f629 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:12.515100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58d119-34c8-4f8f-a828-a9559ebc2f9a None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:12.515912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f905080-581e-4db7-9f30-597b8e40f629 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:12.516369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f905080-581e-4db7-9f30-597b8e40f629 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:12.518478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f905080-581e-4db7-9f30-597b8e40f629 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:12.550362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 540/1071] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Aug 19 20:55:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:12.551902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f905080-581e-4db7-9f30-597b8e40f629 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:12.576013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23b487-0ef9-4e92-8eb0-7229b6be4024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:12.576982 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23b487-0ef9-4e92-8eb0-7229b6be4024 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:12.577443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23b487-0ef9-4e92-8eb0-7229b6be4024 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:12.577894 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23b487-0ef9-4e92-8eb0-7229b6be4024 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:12.578716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23b487-0ef9-4e92-8eb0-7229b6be4024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:12.579302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23b487-0ef9-4e92-8eb0-7229b6be4024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:12.581624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23b487-0ef9-4e92-8eb0-7229b6be4024 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:12.600787 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 532/1072] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:12.602101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc0d8-d0a4-41b2-88c1-8af17dcc18c4 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:12.602402 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc0d8-d0a4-41b2-88c1-8af17dcc18c4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:12.602688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc0d8-d0a4-41b2-88c1-8af17dcc18c4 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:12.604235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 533/1073] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:12.615615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbf0bf-0488-4dd0-a96b-d25a37f6c36e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:12.616064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbf0bf-0488-4dd0-a96b-d25a37f6c36e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:12.616509 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbf0bf-0488-4dd0-a96b-d25a37f6c36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:12.645256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-17fbf0bf-0488-4dd0-a96b-d25a37f6c36e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:12.647132 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-17fbf0bf-0488-4dd0-a96b-d25a37f6c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:12.707903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f905080-581e-4db7-9f30-597b8e40f629 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:12.736058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 534/1074] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:55:12.766791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb284a3-3eb0-4294-801f-d18e22408aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:12.767251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb284a3-3eb0-4294-801f-d18e22408aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:12.769142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb284a3-3eb0-4294-801f-d18e22408aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:12.769142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb284a3-3eb0-4294-801f-d18e22408aa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:12.786907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb284a3-3eb0-4294-801f-d18e22408aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:12.789043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb284a3-3eb0-4294-801f-d18e22408aa5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-6fb284a3-3eb0-4294-801f-d18e22408aa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:55:12.812274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:12.814098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:55:12.816095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:55:12.816095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:12.816095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:12.816095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 541/1075] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:12.821945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbf0bf-0488-4dd0-a96b-d25a37f6c36e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:12.957529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:12.982878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbf0bf-0488-4dd0-a96b-d25a37f6c36e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:13.034862 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60318095-d469-4f52-a95a-a0b6f7c93dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:13.035606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60318095-d469-4f52-a95a-a0b6f7c93dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:13.035950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60318095-d469-4f52-a95a-a0b6f7c93dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:13.036291 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60318095-d469-4f52-a95a-a0b6f7c93dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:13.037020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60318095-d469-4f52-a95a-a0b6f7c93dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:13.037385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60318095-d469-4f52-a95a-a0b6f7c93dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:13.038888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60318095-d469-4f52-a95a-a0b6f7c93dd8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:13.052181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 535/1076] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:13.058769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb284a3-3eb0-4294-801f-d18e22408aa5 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:13.077256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60318095-d469-4f52-a95a-a0b6f7c93dd8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:13.098496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:13.178813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb284a3-3eb0-4294-801f-d18e22408aa5 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:13.215050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60318095-d469-4f52-a95a-a0b6f7c93dd8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:13.222052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aef9d8-3be6-4830-a5d8-916b7e960a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:13.223211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef9d8-3be6-4830-a5d8-916b7e960a42 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:13.223553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef9d8-3be6-4830-a5d8-916b7e960a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:13.223834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef9d8-3be6-4830-a5d8-916b7e960a42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:13.235067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aef9d8-3be6-4830-a5d8-916b7e960a42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:13.236575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aef9d8-3be6-4830-a5d8-916b7e960a42 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-92aef9d8-3be6-4830-a5d8-916b7e960a42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:55:13.251156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:13.253102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:13.255008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:55:13.255008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:55:13.255008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:55:13.255008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:55:13.255008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:55:13.255008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:55:13.255008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:55:13.255008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:13.255008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 542/1077] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:55:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:55:13.259442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aef9d8-3be6-4830-a5d8-916b7e960a42 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:13.263525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ba7a3-17b0-4ece-bee1-60cd3299aabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:13.264191 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba7a3-17b0-4ece-bee1-60cd3299aabd None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:13.264499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba7a3-17b0-4ece-bee1-60cd3299aabd None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:13.264774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba7a3-17b0-4ece-bee1-60cd3299aabd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:13.280358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ba7a3-17b0-4ece-bee1-60cd3299aabd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-fd1ba7a3-17b0-4ece-bee1-60cd3299aabd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:55:13.285568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:13.287247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:13.288187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:13.288187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:13.288187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:13.288187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:13.288187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:55:13.288187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:55:13.288187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:55:13.288187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:55:13.288187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:55:13.288187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:55:13.288187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:55:13.288187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:13.288187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 536/1078] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:55:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:13.293876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ba7a3-17b0-4ece-bee1-60cd3299aabd None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:13.304545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:13.422780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:13.431113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aef9d8-3be6-4830-a5d8-916b7e960a42 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:13.444559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ba7a3-17b0-4ece-bee1-60cd3299aabd None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:13.488876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662fb3d-6f48-491e-88b9-d831f5aab2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:13.489431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662fb3d-6f48-491e-88b9-d831f5aab2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:13.489750 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662fb3d-6f48-491e-88b9-d831f5aab2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:13.490067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662fb3d-6f48-491e-88b9-d831f5aab2b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:13.490844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662fb3d-6f48-491e-88b9-d831f5aab2b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:13.491191 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662fb3d-6f48-491e-88b9-d831f5aab2b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:13.492668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662fb3d-6f48-491e-88b9-d831f5aab2b2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:13.496192 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb058c-2b57-4b1e-8c95-830109ba49c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:13.497456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb058c-2b57-4b1e-8c95-830109ba49c1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:13.497958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb058c-2b57-4b1e-8c95-830109ba49c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:13.498464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb058c-2b57-4b1e-8c95-830109ba49c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:13.499808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb058c-2b57-4b1e-8c95-830109ba49c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:13.500337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb058c-2b57-4b1e-8c95-830109ba49c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:13.502962 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb058c-2b57-4b1e-8c95-830109ba49c1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:13.503623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 537/1079] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:55:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:13.510129 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662fb3d-6f48-491e-88b9-d831f5aab2b2 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:13.527332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 543/1080] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:55:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:13.534451 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb058c-2b57-4b1e-8c95-830109ba49c1 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:13.596425 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:13.642584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662fb3d-6f48-491e-88b9-d831f5aab2b2 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:13.666183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb058c-2b57-4b1e-8c95-830109ba49c1 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:13.682518 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dddc16-7924-462d-9b9f-6a1c5d7ba469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:13.683826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dddc16-7924-462d-9b9f-6a1c5d7ba469 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:13.684143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dddc16-7924-462d-9b9f-6a1c5d7ba469 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:13.684455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dddc16-7924-462d-9b9f-6a1c5d7ba469 None admin] PATH_INFO: `/v3/users/61e4ae42741545cda05f3f063bff65dd` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:13.685701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dddc16-7924-462d-9b9f-6a1c5d7ba469 None admin] RBAC: Authorizing `identity:get_user(user_id=61e4ae42741545cda05f3f063bff65dd)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:13.687217 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dddc16-7924-462d-9b9f-6a1c5d7ba469 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:13.688893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 538/1081] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:55:13 2022] GET /identity/v3/users/61e4ae42741545cda05f3f063bff65dd => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:13.695490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dddc16-7924-462d-9b9f-6a1c5d7ba469 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:13.710726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6159b0-6c73-4aa5-ba4c-ac51ce0c6ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:13.712993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6159b0-6c73-4aa5-ba4c-ac51ce0c6ae3 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:13.713321 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6159b0-6c73-4aa5-ba4c-ac51ce0c6ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:13.713691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6159b0-6c73-4aa5-ba4c-ac51ce0c6ae3 None admin] PATH_INFO: `/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/83e51beb8d0e4219af906860ce906500/roles/2acaf26ecd8a4392aac8a20d15f672ad` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:13.717673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6159b0-6c73-4aa5-ba4c-ac51ce0c6ae3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1defe14eddd4b28ac969adb3d504c7a, user_id=83e51beb8d0e4219af906860ce906500, role_id=2acaf26ecd8a4392aac8a20d15f672ad)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:13.721677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6159b0-6c73-4aa5-ba4c-ac51ce0c6ae3 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:13.744584 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 544/1082] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:55:13 2022] PUT /identity/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/83e51beb8d0e4219af906860ce906500/roles/2acaf26ecd8a4392aac8a20d15f672ad => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 20:55:13.841146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dddc16-7924-462d-9b9f-6a1c5d7ba469 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:13.884930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25b4df-9763-41ee-9717-41c19e3c2adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:13.885640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25b4df-9763-41ee-9717-41c19e3c2adb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:13.885975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25b4df-9763-41ee-9717-41c19e3c2adb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:13.886268 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25b4df-9763-41ee-9717-41c19e3c2adb None admin] PATH_INFO: `/v3/projects/31eb80c4838e407392953e0200746ac1` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:13.887673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25b4df-9763-41ee-9717-41c19e3c2adb None admin] RBAC: Authorizing `identity:get_project(project_id=31eb80c4838e407392953e0200746ac1)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:13.889197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25b4df-9763-41ee-9717-41c19e3c2adb None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:13.891036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 539/1083] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:55:13 2022] GET /identity/v3/projects/31eb80c4838e407392953e0200746ac1 => generated 311 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:13.897295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6159b0-6c73-4aa5-ba4c-ac51ce0c6ae3 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:13.926831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:14.025434 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6159b0-6c73-4aa5-ba4c-ac51ce0c6ae3 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:14.067629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f1432-2e30-4aee-8ca3-525d27c45aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:14.068461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f1432-2e30-4aee-8ca3-525d27c45aac None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:14.068828 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f1432-2e30-4aee-8ca3-525d27c45aac None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:14.069203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f1432-2e30-4aee-8ca3-525d27c45aac None admin] PATH_INFO: `/v3/projects/31eb80c4838e407392953e0200746ac1/users/61e4ae42741545cda05f3f063bff65dd/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:14.071388 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f1432-2e30-4aee-8ca3-525d27c45aac None admin] RBAC: Authorizing `identity:create_grant(project_id=31eb80c4838e407392953e0200746ac1, user_id=61e4ae42741545cda05f3f063bff65dd, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:14.072923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f1432-2e30-4aee-8ca3-525d27c45aac None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:14.093422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 545/1084] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:55:13 2022] PUT /identity/v3/projects/31eb80c4838e407392953e0200746ac1/users/61e4ae42741545cda05f3f063bff65dd/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:55:15.731006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d20e-88cc-4c02-87c2-19bfbe7e244e None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:15.731575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d20e-88cc-4c02-87c2-19bfbe7e244e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:15.731772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d20e-88cc-4c02-87c2-19bfbe7e244e None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:15.733244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 540/1085] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:15.741252 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c66ba-62e4-438c-90b9-a736a5640e96 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:15.742124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c66ba-62e4-438c-90b9-a736a5640e96 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:15.742124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c66ba-62e4-438c-90b9-a736a5640e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:15.764842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-d83c66ba-62e4-438c-90b9-a736a5640e96 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:15.765526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d83c66ba-62e4-438c-90b9-a736a5640e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:15.860258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 546/1086] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:16.137559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2d20e-88cc-4c02-87c2-19bfbe7e244e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:16.141913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:16.218048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103465f-5e3d-48df-b6c9-8a4032ed1372 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:16.218460 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103465f-5e3d-48df-b6c9-8a4032ed1372 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:16.218890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103465f-5e3d-48df-b6c9-8a4032ed1372 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:16.220349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 547/1087] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:55:16.228055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf7f87-cbbe-4ae3-b30a-718991544ced None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:16.228553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf7f87-cbbe-4ae3-b30a-718991544ced None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:16.229054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf7f87-cbbe-4ae3-b30a-718991544ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:16.251605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:16.256034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2d20e-88cc-4c02-87c2-19bfbe7e244e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:16.259211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ccbf7f87-cbbe-4ae3-b30a-718991544ced None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:16.261511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ccbf7f87-cbbe-4ae3-b30a-718991544ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:16.299201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c535de-0ab1-4397-a35d-23df6fef7954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:16.299908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c535de-0ab1-4397-a35d-23df6fef7954 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:16.300222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c535de-0ab1-4397-a35d-23df6fef7954 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:16.300532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c535de-0ab1-4397-a35d-23df6fef7954 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:16.312888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c535de-0ab1-4397-a35d-23df6fef7954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-f7c535de-0ab1-4397-a35d-23df6fef7954 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:55:16.317726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:16.318909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:16.321118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:16.321118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:16.321118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:16.321118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:16.321118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:55:16.321118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:55:16.321118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:55:16.321118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:55:16.321118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:55:16.321118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:55:16.321118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 20:55:16.321118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:16.321118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 541/1088] 10.222.0.17 () {56 vars in 1120 bytes} [Fri Aug 19 20:55:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:16.325812 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c535de-0ab1-4397-a35d-23df6fef7954 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:16.341850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 548/1089] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:55:16.393267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:16.439102 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c535de-0ab1-4397-a35d-23df6fef7954 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:16.479056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bf820-3c85-45c1-bdde-81eaa387690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:16.480348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bf820-3c85-45c1-bdde-81eaa387690e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:16.480844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bf820-3c85-45c1-bdde-81eaa387690e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:16.481242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bf820-3c85-45c1-bdde-81eaa387690e None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:16.482058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bf820-3c85-45c1-bdde-81eaa387690e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:16.482488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bf820-3c85-45c1-bdde-81eaa387690e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:16.485183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bf820-3c85-45c1-bdde-81eaa387690e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:16.501142 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 542/1090] 10.222.0.17 () {56 vars in 1115 bytes} [Fri Aug 19 20:55:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:16.502329 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf7f87-cbbe-4ae3-b30a-718991544ced None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:16.611992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf7f87-cbbe-4ae3-b30a-718991544ced None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:16.621705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bf820-3c85-45c1-bdde-81eaa387690e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:16.649943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a523f-ff06-43ab-b31e-40ac21d362da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:16.650494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a523f-ff06-43ab-b31e-40ac21d362da None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:16.650807 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a523f-ff06-43ab-b31e-40ac21d362da None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:16.651087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a523f-ff06-43ab-b31e-40ac21d362da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:16.655866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:16.664419 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a523f-ff06-43ab-b31e-40ac21d362da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:16.665885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a523f-ff06-43ab-b31e-40ac21d362da None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-046a523f-ff06-43ab-b31e-40ac21d362da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:55:16.682027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:16.683825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:55:16.684816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:55:16.684816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:16.684816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:16.684816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 549/1091] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:16.690191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a523f-ff06-43ab-b31e-40ac21d362da None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:16.768987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bf820-3c85-45c1-bdde-81eaa387690e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:16.797823 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:16.811313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae457246-bd89-4bdf-96ec-01a1c56e36ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:16.812004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae457246-bd89-4bdf-96ec-01a1c56e36ab None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:16.812295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae457246-bd89-4bdf-96ec-01a1c56e36ab None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:16.812593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae457246-bd89-4bdf-96ec-01a1c56e36ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:16.825560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae457246-bd89-4bdf-96ec-01a1c56e36ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ae457246-bd89-4bdf-96ec-01a1c56e36ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:55:16.830868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:16.832893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:16.834666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:16.834666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:16.834666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:16.834666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:16.834666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:55:16.834666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:55:16.834666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:55:16.834666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:55:16.834666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:55:16.834666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:55:16.834666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:55:16.834666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:16.836164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a523f-ff06-43ab-b31e-40ac21d362da None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:16.837336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 543/1092] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:55:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:55:16.838220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae457246-bd89-4bdf-96ec-01a1c56e36ab None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:16.874508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68178a73-b219-4dab-adf5-cc6e0637ca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:16.875150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68178a73-b219-4dab-adf5-cc6e0637ca64 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:16.875521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68178a73-b219-4dab-adf5-cc6e0637ca64 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:16.875801 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68178a73-b219-4dab-adf5-cc6e0637ca64 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:16.876719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68178a73-b219-4dab-adf5-cc6e0637ca64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:16.877056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68178a73-b219-4dab-adf5-cc6e0637ca64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:16.879000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68178a73-b219-4dab-adf5-cc6e0637ca64 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:16.893498 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 550/1093] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:16.899231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68178a73-b219-4dab-adf5-cc6e0637ca64 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:16.959425 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae457246-bd89-4bdf-96ec-01a1c56e36ab None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:16.970543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:17.002809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aea069-91d8-4dcf-91e9-5c515fbefaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:17.003465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aea069-91d8-4dcf-91e9-5c515fbefaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:17.003742 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aea069-91d8-4dcf-91e9-5c515fbefaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:17.004013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aea069-91d8-4dcf-91e9-5c515fbefaf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:17.004686 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aea069-91d8-4dcf-91e9-5c515fbefaf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:17.004988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aea069-91d8-4dcf-91e9-5c515fbefaf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:17.006441 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aea069-91d8-4dcf-91e9-5c515fbefaf8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:17.016686 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 544/1094] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:55:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:17.023200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aea069-91d8-4dcf-91e9-5c515fbefaf8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:17.029145 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68178a73-b219-4dab-adf5-cc6e0637ca64 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:17.070653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37758343-1a6e-4647-99ed-e4b00d111e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:17.071425 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37758343-1a6e-4647-99ed-e4b00d111e5f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:17.071807 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37758343-1a6e-4647-99ed-e4b00d111e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:17.072178 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37758343-1a6e-4647-99ed-e4b00d111e5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:17.081434 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37758343-1a6e-4647-99ed-e4b00d111e5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:17.082906 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37758343-1a6e-4647-99ed-e4b00d111e5f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:17.091759 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-37758343-1a6e-4647-99ed-e4b00d111e5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:55:17.096126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:17.097283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:17.098502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:17.098502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:17.098502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:55:17.098502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:55:17.098502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:55:17.098502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:55:17.098502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:55:17.098502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:55:17.098502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 20:55:17.098502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:17.098502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 551/1095] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Aug 19 20:55:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:55:17.104013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37758343-1a6e-4647-99ed-e4b00d111e5f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:17.156337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aea069-91d8-4dcf-91e9-5c515fbefaf8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:17.203988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a139ca-4f60-4894-9c95-8305c6747619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:17.204634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a139ca-4f60-4894-9c95-8305c6747619 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:17.204920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a139ca-4f60-4894-9c95-8305c6747619 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:17.205197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a139ca-4f60-4894-9c95-8305c6747619 None admin] PATH_INFO: `/v3/users/61e4ae42741545cda05f3f063bff65dd` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:17.206362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a139ca-4f60-4894-9c95-8305c6747619 None admin] RBAC: Authorizing `identity:get_user(user_id=61e4ae42741545cda05f3f063bff65dd)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:17.207863 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a139ca-4f60-4894-9c95-8305c6747619 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:17.209786 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 545/1096] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:55:17 2022] GET /identity/v3/users/61e4ae42741545cda05f3f063bff65dd => generated 285 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:17.216077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a139ca-4f60-4894-9c95-8305c6747619 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:17.227688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37758343-1a6e-4647-99ed-e4b00d111e5f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:17.241560 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:17.270866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cd940-03ca-4272-89b3-0c814b707ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:17.271482 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cd940-03ca-4272-89b3-0c814b707ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:17.271760 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cd940-03ca-4272-89b3-0c814b707ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:17.272032 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cd940-03ca-4272-89b3-0c814b707ec5 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:17.272896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cd940-03ca-4272-89b3-0c814b707ec5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:17.273109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cd940-03ca-4272-89b3-0c814b707ec5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:17.274563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cd940-03ca-4272-89b3-0c814b707ec5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:17.296660 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 552/1097] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Aug 19 20:55:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:17.302626 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cd940-03ca-4272-89b3-0c814b707ec5 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:17.336660 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a139ca-4f60-4894-9c95-8305c6747619 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:17.354287 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:17.384839 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6beafa-029b-4a04-a2e6-58e2fbf353a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:17.385467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6beafa-029b-4a04-a2e6-58e2fbf353a8 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:17.385751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6beafa-029b-4a04-a2e6-58e2fbf353a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:17.386614 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6beafa-029b-4a04-a2e6-58e2fbf353a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:17.423424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cd940-03ca-4272-89b3-0c814b707ec5 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:17.462494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18752aad-72ab-42ff-9c77-4d5682a94c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:17.463373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18752aad-72ab-42ff-9c77-4d5682a94c62 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:17.463778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18752aad-72ab-42ff-9c77-4d5682a94c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:17.464087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18752aad-72ab-42ff-9c77-4d5682a94c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:17.464426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6beafa-029b-4a04-a2e6-58e2fbf353a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:17.465923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6beafa-029b-4a04-a2e6-58e2fbf353a8 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:17.507705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:17.548356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18752aad-72ab-42ff-9c77-4d5682a94c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:17.549842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18752aad-72ab-42ff-9c77-4d5682a94c62 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:17.585440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 546/1098] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:55:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 20:55:17.591860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6beafa-029b-4a04-a2e6-58e2fbf353a8 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:17.611542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:17.677802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 553/1099] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:55:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 20:55:17.686006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18752aad-72ab-42ff-9c77-4d5682a94c62 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:17.723104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6beafa-029b-4a04-a2e6-58e2fbf353a8 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:17.765220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:17.773473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc1f1b-f5ca-4280-8273-44bdc5408392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:17.774141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc1f1b-f5ca-4280-8273-44bdc5408392 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:17.774416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc1f1b-f5ca-4280-8273-44bdc5408392 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:17.774692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc1f1b-f5ca-4280-8273-44bdc5408392 None admin] PATH_INFO: `/v3/projects/31eb80c4838e407392953e0200746ac1` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:17.775889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc1f1b-f5ca-4280-8273-44bdc5408392 None admin] RBAC: Authorizing `identity:get_project(project_id=31eb80c4838e407392953e0200746ac1)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:17.778109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc1f1b-f5ca-4280-8273-44bdc5408392 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:17.780016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 547/1100] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:55:17 2022] GET /identity/v3/projects/31eb80c4838e407392953e0200746ac1 => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:17.786077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc1f1b-f5ca-4280-8273-44bdc5408392 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:17.809882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18752aad-72ab-42ff-9c77-4d5682a94c62 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:17.846246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdef212-21e0-4aa5-b24b-e2d7e1bc842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:17.847096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdef212-21e0-4aa5-b24b-e2d7e1bc842b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:17.847225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdef212-21e0-4aa5-b24b-e2d7e1bc842b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:17.847443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdef212-21e0-4aa5-b24b-e2d7e1bc842b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:17.858858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdef212-21e0-4aa5-b24b-e2d7e1bc842b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:17.860350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdef212-21e0-4aa5-b24b-e2d7e1bc842b None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-bbdef212-21e0-4aa5-b24b-e2d7e1bc842b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:55:17.876474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:17.877762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:55:17.878929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:55:17.878929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:55:17.878929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:17.878929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 554/1101] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:55:17.883697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdef212-21e0-4aa5-b24b-e2d7e1bc842b None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:17.891264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:17.910410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc1f1b-f5ca-4280-8273-44bdc5408392 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:17.955696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55aa04-59ac-408a-9868-b4533f58e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:17.956498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55aa04-59ac-408a-9868-b4533f58e9db None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:17.956874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55aa04-59ac-408a-9868-b4533f58e9db None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:17.957235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55aa04-59ac-408a-9868-b4533f58e9db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:17.958085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55aa04-59ac-408a-9868-b4533f58e9db None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=31eb80c4838e407392953e0200746ac1, user.id=61e4ae42741545cda05f3f063bff65dd) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:17.958482 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55aa04-59ac-408a-9868-b4533f58e9db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:17.960064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55aa04-59ac-408a-9868-b4533f58e9db None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:17.970688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 548/1102] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:55:17 2022] GET /identity/v3/role_assignments?user.id=61e4ae42741545cda05f3f063bff65dd&scope.project.id=31eb80c4838e407392953e0200746ac1&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:18.020088 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdef212-21e0-4aa5-b24b-e2d7e1bc842b None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:18.045445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:18.069465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd07f6-93c1-4178-8c18-6ad640c06f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:18.070098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd07f6-93c1-4178-8c18-6ad640c06f7a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:18.070442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd07f6-93c1-4178-8c18-6ad640c06f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:18.070720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd07f6-93c1-4178-8c18-6ad640c06f7a None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:18.071439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd07f6-93c1-4178-8c18-6ad640c06f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:18.071746 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd07f6-93c1-4178-8c18-6ad640c06f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:18.073205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd07f6-93c1-4178-8c18-6ad640c06f7a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:18.089870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 555/1103] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:18.096812 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55aa04-59ac-408a-9868-b4533f58e9db None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:18.236524 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55aa04-59ac-408a-9868-b4533f58e9db None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:18.276088 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387cae8-352e-47fb-843c-cc87bcc55cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:18.276695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387cae8-352e-47fb-843c-cc87bcc55cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:18.277286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387cae8-352e-47fb-843c-cc87bcc55cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:18.277460 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387cae8-352e-47fb-843c-cc87bcc55cc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:18.285360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387cae8-352e-47fb-843c-cc87bcc55cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:18.287046 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387cae8-352e-47fb-843c-cc87bcc55cc5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-d387cae8-352e-47fb-843c-cc87bcc55cc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:55:18.300751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:18.302796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:18.304469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:55:18.304469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:55:18.304469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:55:18.304469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:55:18.304469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:55:18.304469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:55:18.304469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:55:18.304469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:18.304469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 549/1104] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:55:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:55:18.312009 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd07f6-93c1-4178-8c18-6ad640c06f7a None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:18.428119 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd07f6-93c1-4178-8c18-6ad640c06f7a None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:18.472067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33363c-e22c-44f7-93fc-d3453a114eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:18.472769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33363c-e22c-44f7-93fc-d3453a114eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:18.473112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33363c-e22c-44f7-93fc-d3453a114eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:18.473463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33363c-e22c-44f7-93fc-d3453a114eb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:18.474245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33363c-e22c-44f7-93fc-d3453a114eb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:18.474611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33363c-e22c-44f7-93fc-d3453a114eb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:18.476209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33363c-e22c-44f7-93fc-d3453a114eb0 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:18.491064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 556/1105] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:55:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:18.499157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387cae8-352e-47fb-843c-cc87bcc55cc5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:18.513746 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:18.619848 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387cae8-352e-47fb-843c-cc87bcc55cc5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:18.663962 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329b6c4-761a-41bb-ab32-771ce45d167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:18.664576 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329b6c4-761a-41bb-ab32-771ce45d167a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:18.664856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329b6c4-761a-41bb-ab32-771ce45d167a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:18.665132 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329b6c4-761a-41bb-ab32-771ce45d167a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:18.665879 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329b6c4-761a-41bb-ab32-771ce45d167a None admin] RBAC: Adding query filter params (role.id=2acaf26ecd8a4392aac8a20d15f672ad, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=83e51beb8d0e4219af906860ce906500) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:18.666187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329b6c4-761a-41bb-ab32-771ce45d167a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:18.668277 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329b6c4-761a-41bb-ab32-771ce45d167a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:18.675107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 550/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:55:18 2022] GET /identity/v3/role_assignments?user.id=83e51beb8d0e4219af906860ce906500&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=2acaf26ecd8a4392aac8a20d15f672ad => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:20.059756 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce9c93-8a02-4163-8add-80f45f0e681e None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:20.060509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce9c93-8a02-4163-8add-80f45f0e681e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:20.060509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce9c93-8a02-4163-8add-80f45f0e681e None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:20.061764 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 557/1107] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:55:20.067650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80995e2-dd36-4b5e-b0b5-6b50ce86a78b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:20.068425 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80995e2-dd36-4b5e-b0b5-6b50ce86a78b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:20.068425 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80995e2-dd36-4b5e-b0b5-6b50ce86a78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:20.087683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c80995e2-dd36-4b5e-b0b5-6b50ce86a78b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:20.088882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c80995e2-dd36-4b5e-b0b5-6b50ce86a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:20.170773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 551/1108] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:55:20.657515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce9c93-8a02-4163-8add-80f45f0e681e None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:20.706565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:20.783200 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce9c93-8a02-4163-8add-80f45f0e681e None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:20.824272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9b95e-873f-4025-a123-a5b75940de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:20.824921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9b95e-873f-4025-a123-a5b75940de64 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:20.825201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9b95e-873f-4025-a123-a5b75940de64 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:20.825475 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9b95e-873f-4025-a123-a5b75940de64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:20.826677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9b95e-873f-4025-a123-a5b75940de64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:20.828142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9b95e-873f-4025-a123-a5b75940de64 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:20.829748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 558/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:20.835764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80995e2-dd36-4b5e-b0b5-6b50ce86a78b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:20.838038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:20.953694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80995e2-dd36-4b5e-b0b5-6b50ce86a78b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:20.996690 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5340b36-6940-48cc-9e03-98a46985ff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:20.997411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340b36-6940-48cc-9e03-98a46985ff58 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:20.997697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340b36-6940-48cc-9e03-98a46985ff58 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:20.997971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340b36-6940-48cc-9e03-98a46985ff58 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:20.998643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5340b36-6940-48cc-9e03-98a46985ff58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:21.000143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5340b36-6940-48cc-9e03-98a46985ff58 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:21.023389 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 552/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:55:20 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:55:23.059699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ca2a-4759-4516-a81a-8bf999de5333 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:23.060312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ca2a-4759-4516-a81a-8bf999de5333 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:23.060312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ca2a-4759-4516-a81a-8bf999de5333 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:23.061520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 559/1111] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:23.067382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239c2c-c811-4c8b-b878-a62ce4614f0f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:23.068244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239c2c-c811-4c8b-b878-a62ce4614f0f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:23.068423 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239c2c-c811-4c8b-b878-a62ce4614f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:23.087680 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d0239c2c-c811-4c8b-b878-a62ce4614f0f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:23.088908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d0239c2c-c811-4c8b-b878-a62ce4614f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:23.150157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:23.169300 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 553/1112] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:23.440603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480ca2a-4759-4516-a81a-8bf999de5333 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:23.569280 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480ca2a-4759-4516-a81a-8bf999de5333 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:23.577951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:23.607252 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf642c-217a-4253-9430-41a6c36fd9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:23.607898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf642c-217a-4253-9430-41a6c36fd9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:23.608181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf642c-217a-4253-9430-41a6c36fd9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:23.608460 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf642c-217a-4253-9430-41a6c36fd9e2 None admin] PATH_INFO: `/v3/roles/0fdbf18b17e545d9929e22ebddc1d5b7` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:23.609886 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf642c-217a-4253-9430-41a6c36fd9e2 None admin] RBAC: Authorizing `identity:get_role(role_id=0fdbf18b17e545d9929e22ebddc1d5b7)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:23.611290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf642c-217a-4253-9430-41a6c36fd9e2 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:23.612625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 560/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:55:23 2022] GET /identity/v3/roles/0fdbf18b17e545d9929e22ebddc1d5b7 => generated 223 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:23.622600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0239c2c-c811-4c8b-b878-a62ce4614f0f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:23.745268 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0239c2c-c811-4c8b-b878-a62ce4614f0f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:23.787341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35fd73-4677-4150-aace-864d73f5e0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:23.788005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35fd73-4677-4150-aace-864d73f5e0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:23.788286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35fd73-4677-4150-aace-864d73f5e0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:23.788560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35fd73-4677-4150-aace-864d73f5e0e3 None admin] PATH_INFO: `/v3/users/5c7fdfa05f7045b2a78e2a6369aae164` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:23.805527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35fd73-4677-4150-aace-864d73f5e0e3 None admin] RBAC: Authorizing `identity:get_user(user_id=5c7fdfa05f7045b2a78e2a6369aae164)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:23.807040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35fd73-4677-4150-aace-864d73f5e0e3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:23.808997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 554/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:55:23 2022] GET /identity/v3/users/5c7fdfa05f7045b2a78e2a6369aae164 => generated 286 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:23.815558 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf642c-217a-4253-9430-41a6c36fd9e2 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:23.938918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf642c-217a-4253-9430-41a6c36fd9e2 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:23.975118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6b8e-fc9e-4b25-ac62-9c92bbe4f397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:23.975738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6b8e-fc9e-4b25-ac62-9c92bbe4f397 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:23.976022 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6b8e-fc9e-4b25-ac62-9c92bbe4f397 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:23.976300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6b8e-fc9e-4b25-ac62-9c92bbe4f397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:24.025162 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:24.053179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6b8e-fc9e-4b25-ac62-9c92bbe4f397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:24.054700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6b8e-fc9e-4b25-ac62-9c92bbe4f397 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:24.169817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 561/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:55:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 20:55:24.176047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35fd73-4677-4150-aace-864d73f5e0e3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:24.228365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:24.291529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35fd73-4677-4150-aace-864d73f5e0e3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:24.345675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706ddd0-2627-49d5-bd16-13fdae4db7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:24.346685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706ddd0-2627-49d5-bd16-13fdae4db7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:24.347161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706ddd0-2627-49d5-bd16-13fdae4db7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:24.347592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706ddd0-2627-49d5-bd16-13fdae4db7b5 None admin] PATH_INFO: `/v3/projects/31eb80c4838e407392953e0200746ac1` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:24.349455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706ddd0-2627-49d5-bd16-13fdae4db7b5 None admin] RBAC: Authorizing `identity:get_project(project_id=31eb80c4838e407392953e0200746ac1)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:24.351959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706ddd0-2627-49d5-bd16-13fdae4db7b5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:24.355183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 555/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:55:24 2022] GET /identity/v3/projects/31eb80c4838e407392953e0200746ac1 => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:24.361714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6b8e-fc9e-4b25-ac62-9c92bbe4f397 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:24.450535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:24.478566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6b8e-fc9e-4b25-ac62-9c92bbe4f397 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:24.515070 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55911cd6-e7fa-4039-b2f5-5a1bf08b9209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:24.515688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911cd6-e7fa-4039-b2f5-5a1bf08b9209 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:24.515972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911cd6-e7fa-4039-b2f5-5a1bf08b9209 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:24.516247 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911cd6-e7fa-4039-b2f5-5a1bf08b9209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:24.516981 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55911cd6-e7fa-4039-b2f5-5a1bf08b9209 None admin] RBAC: Adding query filter params (role.id=0fdbf18b17e545d9929e22ebddc1d5b7, scope.project.id=31eb80c4838e407392953e0200746ac1, user.id=5c7fdfa05f7045b2a78e2a6369aae164) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:24.517290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55911cd6-e7fa-4039-b2f5-5a1bf08b9209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:24.518712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55911cd6-e7fa-4039-b2f5-5a1bf08b9209 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:24.524704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 562/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:55:24 2022] GET /identity/v3/role_assignments?user.id=5c7fdfa05f7045b2a78e2a6369aae164&scope.project.id=31eb80c4838e407392953e0200746ac1&role.id=0fdbf18b17e545d9929e22ebddc1d5b7 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:26.462251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb945f-25dc-432a-b10a-361b1749e39a None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:26.463013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb945f-25dc-432a-b10a-361b1749e39a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:26.463013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb945f-25dc-432a-b10a-361b1749e39a None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:26.464832 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 556/1118] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:26.471789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e9323-7b67-49e1-841c-3c916efafa5a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:26.472320 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e9323-7b67-49e1-841c-3c916efafa5a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:26.472767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e9323-7b67-49e1-841c-3c916efafa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:26.502683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-d37e9323-7b67-49e1-841c-3c916efafa5a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:26.504723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d37e9323-7b67-49e1-841c-3c916efafa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:26.589659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 563/1119] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:26.866246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb945f-25dc-432a-b10a-361b1749e39a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:26.980556 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb945f-25dc-432a-b10a-361b1749e39a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:26.997696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:27.020549 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f476-2036-4b5b-9c8f-d4f5d87e92ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:27.021096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f476-2036-4b5b-9c8f-d4f5d87e92ee None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:27.021373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f476-2036-4b5b-9c8f-d4f5d87e92ee None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:27.021643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f476-2036-4b5b-9c8f-d4f5d87e92ee None admin] PATH_INFO: `/v3/roles/0fdbf18b17e545d9929e22ebddc1d5b7` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:27.023069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1f476-2036-4b5b-9c8f-d4f5d87e92ee None admin] RBAC: Authorizing `identity:get_role(role_id=0fdbf18b17e545d9929e22ebddc1d5b7)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:27.024450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1f476-2036-4b5b-9c8f-d4f5d87e92ee None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:27.025808 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 557/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:55:26 2022] GET /identity/v3/roles/0fdbf18b17e545d9929e22ebddc1d5b7 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:27.032466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e9323-7b67-49e1-841c-3c916efafa5a None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:27.103290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:27.140083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e9323-7b67-49e1-841c-3c916efafa5a None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:27.176913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7f5bd-8345-4269-9151-1a805c3ff3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:27.177557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7f5bd-8345-4269-9151-1a805c3ff3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:27.177841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7f5bd-8345-4269-9151-1a805c3ff3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:27.178121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7f5bd-8345-4269-9151-1a805c3ff3c1 None admin] PATH_INFO: `/v3/users/5c7fdfa05f7045b2a78e2a6369aae164` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:27.179285 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7f5bd-8345-4269-9151-1a805c3ff3c1 None admin] RBAC: Authorizing `identity:get_user(user_id=5c7fdfa05f7045b2a78e2a6369aae164)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:27.180723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7f5bd-8345-4269-9151-1a805c3ff3c1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:27.182327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 564/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:55:27 2022] GET /identity/v3/users/5c7fdfa05f7045b2a78e2a6369aae164 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:27.191646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f476-2036-4b5b-9c8f-d4f5d87e92ee None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:27.300464 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f476-2036-4b5b-9c8f-d4f5d87e92ee None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:27.337151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd24d5f-4a6f-4118-b3b6-06b28105713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:27.337781 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd24d5f-4a6f-4118-b3b6-06b28105713e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:27.338063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd24d5f-4a6f-4118-b3b6-06b28105713e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:27.338333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd24d5f-4a6f-4118-b3b6-06b28105713e None admin] PATH_INFO: `/v3/projects/31eb80c4838e407392953e0200746ac1` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:27.339676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd24d5f-4a6f-4118-b3b6-06b28105713e None admin] RBAC: Authorizing `identity:get_project(project_id=31eb80c4838e407392953e0200746ac1)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:27.341398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd24d5f-4a6f-4118-b3b6-06b28105713e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:27.343111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 558/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:55:27 2022] GET /identity/v3/projects/31eb80c4838e407392953e0200746ac1 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:27.350864 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7f5bd-8345-4269-9151-1a805c3ff3c1 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:27.462418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7f5bd-8345-4269-9151-1a805c3ff3c1 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:27.501701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655cbca-67fc-40ac-a9bd-4594725377ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:27.502413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655cbca-67fc-40ac-a9bd-4594725377ba None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:27.502639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655cbca-67fc-40ac-a9bd-4594725377ba None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:27.502948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655cbca-67fc-40ac-a9bd-4594725377ba None admin] PATH_INFO: `/v3/projects/31eb80c4838e407392953e0200746ac1/users/5c7fdfa05f7045b2a78e2a6369aae164/roles/0fdbf18b17e545d9929e22ebddc1d5b7` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:27.505083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655cbca-67fc-40ac-a9bd-4594725377ba None admin] RBAC: Authorizing `identity:create_grant(project_id=31eb80c4838e407392953e0200746ac1, user_id=5c7fdfa05f7045b2a78e2a6369aae164, role_id=0fdbf18b17e545d9929e22ebddc1d5b7)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:27.506507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655cbca-67fc-40ac-a9bd-4594725377ba None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:27.510059 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:27.522662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 565/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:55:27 2022] PUT /identity/v3/projects/31eb80c4838e407392953e0200746ac1/users/5c7fdfa05f7045b2a78e2a6369aae164/roles/0fdbf18b17e545d9929e22ebddc1d5b7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:55:29.513063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb4e1-de9f-4fb2-b07b-03ba651f073b None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:29.513669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb4e1-de9f-4fb2-b07b-03ba651f073b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:29.513669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb4e1-de9f-4fb2-b07b-03ba651f073b None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:29.515238 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 559/1124] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:29.524471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17131c0-0449-4874-877f-cf77cb8a9de2 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:29.525013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17131c0-0449-4874-877f-cf77cb8a9de2 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:29.525186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17131c0-0449-4874-877f-cf77cb8a9de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:29.545893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-f17131c0-0449-4874-877f-cf77cb8a9de2 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:29.547144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f17131c0-0449-4874-877f-cf77cb8a9de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:29.619940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 566/1125] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:29.894709 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb4e1-de9f-4fb2-b07b-03ba651f073b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:29.953038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:30.014110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb4e1-de9f-4fb2-b07b-03ba651f073b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:30.056034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65076e3-f0ae-4079-a6b7-3d14ac58a8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:30.056608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65076e3-f0ae-4079-a6b7-3d14ac58a8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:30.056890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65076e3-f0ae-4079-a6b7-3d14ac58a8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:30.057163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65076e3-f0ae-4079-a6b7-3d14ac58a8a4 None admin] PATH_INFO: `/v3/roles/0fdbf18b17e545d9929e22ebddc1d5b7` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:30.059447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65076e3-f0ae-4079-a6b7-3d14ac58a8a4 None admin] RBAC: Authorizing `identity:get_role(role_id=0fdbf18b17e545d9929e22ebddc1d5b7)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:30.060852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65076e3-f0ae-4079-a6b7-3d14ac58a8a4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:30.062262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 560/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:55:29 2022] GET /identity/v3/roles/0fdbf18b17e545d9929e22ebddc1d5b7 => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:30.068842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17131c0-0449-4874-877f-cf77cb8a9de2 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:30.180640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17131c0-0449-4874-877f-cf77cb8a9de2 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:30.208361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:30.218910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e76e13-c08f-4336-b765-6ce6003c18f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:30.219612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e76e13-c08f-4336-b765-6ce6003c18f6 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:30.219939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e76e13-c08f-4336-b765-6ce6003c18f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:30.220261 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e76e13-c08f-4336-b765-6ce6003c18f6 None admin] PATH_INFO: `/v3/users/5c7fdfa05f7045b2a78e2a6369aae164` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:30.221504 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e76e13-c08f-4336-b765-6ce6003c18f6 None admin] RBAC: Authorizing `identity:get_user(user_id=5c7fdfa05f7045b2a78e2a6369aae164)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:30.223021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e76e13-c08f-4336-b765-6ce6003c18f6 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:30.224683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 567/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:55:30 2022] GET /identity/v3/users/5c7fdfa05f7045b2a78e2a6369aae164 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:30.230952 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65076e3-f0ae-4079-a6b7-3d14ac58a8a4 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:30.342127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65076e3-f0ae-4079-a6b7-3d14ac58a8a4 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:30.360911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:30.380243 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf95a4-42a6-4013-a911-4b4f470add2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:30.380859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf95a4-42a6-4013-a911-4b4f470add2b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:30.381141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf95a4-42a6-4013-a911-4b4f470add2b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:30.381420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf95a4-42a6-4013-a911-4b4f470add2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:30.453137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf95a4-42a6-4013-a911-4b4f470add2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:30.454597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf95a4-42a6-4013-a911-4b4f470add2b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:30.601186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 561/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:55:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 20:55:30.608024 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e76e13-c08f-4336-b765-6ce6003c18f6 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:30.721114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e76e13-c08f-4336-b765-6ce6003c18f6 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:30.759586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd752d-a91a-434c-b427-d6dfcea707b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:30.760236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd752d-a91a-434c-b427-d6dfcea707b0 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:30.760518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd752d-a91a-434c-b427-d6dfcea707b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:30.760788 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd752d-a91a-434c-b427-d6dfcea707b0 None admin] PATH_INFO: `/v3/projects/31eb80c4838e407392953e0200746ac1` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:30.762572 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd752d-a91a-434c-b427-d6dfcea707b0 None admin] RBAC: Authorizing `identity:get_project(project_id=31eb80c4838e407392953e0200746ac1)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:30.764056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd752d-a91a-434c-b427-d6dfcea707b0 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:30.765793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 568/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:55:30 2022] GET /identity/v3/projects/31eb80c4838e407392953e0200746ac1 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:30.773029 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf95a4-42a6-4013-a911-4b4f470add2b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:30.805963 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:30.963296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf95a4-42a6-4013-a911-4b4f470add2b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:31.025062 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0f43f-1fb9-4662-a5b0-43da33dd7e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:31.025734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0f43f-1fb9-4662-a5b0-43da33dd7e68 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:31.026018 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0f43f-1fb9-4662-a5b0-43da33dd7e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:31.026291 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0f43f-1fb9-4662-a5b0-43da33dd7e68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:31.027670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0f43f-1fb9-4662-a5b0-43da33dd7e68 None admin] RBAC: Adding query filter params (role.id=0fdbf18b17e545d9929e22ebddc1d5b7, scope.project.id=31eb80c4838e407392953e0200746ac1, user.id=5c7fdfa05f7045b2a78e2a6369aae164) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:31.027957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0f43f-1fb9-4662-a5b0-43da33dd7e68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:31.029622 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0f43f-1fb9-4662-a5b0-43da33dd7e68 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:31.036687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 562/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:55:30 2022] GET /identity/v3/role_assignments?user.id=5c7fdfa05f7045b2a78e2a6369aae164&scope.project.id=31eb80c4838e407392953e0200746ac1&role.id=0fdbf18b17e545d9929e22ebddc1d5b7 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:33.046157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa26352-0fba-4990-9927-9e2711b64603 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:33.046979 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa26352-0fba-4990-9927-9e2711b64603 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:33.046979 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa26352-0fba-4990-9927-9e2711b64603 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:33.048148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 569/1131] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:55:33.053988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac737a07-8131-4132-8405-4442220f9da8 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:33.054540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac737a07-8131-4132-8405-4442220f9da8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:33.054540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac737a07-8131-4132-8405-4442220f9da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:33.075026 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ac737a07-8131-4132-8405-4442220f9da8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:33.076240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ac737a07-8131-4132-8405-4442220f9da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:33.184729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 563/1132] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:55:33.456468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa26352-0fba-4990-9927-9e2711b64603 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:33.528030 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:33.570125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa26352-0fba-4990-9927-9e2711b64603 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:33.607938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18434781-79bf-4c0b-96d7-fe58783aa310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:33.608566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18434781-79bf-4c0b-96d7-fe58783aa310 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:33.608845 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18434781-79bf-4c0b-96d7-fe58783aa310 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:33.609117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18434781-79bf-4c0b-96d7-fe58783aa310 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:33.610260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18434781-79bf-4c0b-96d7-fe58783aa310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:33.611719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18434781-79bf-4c0b-96d7-fe58783aa310 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:33.613287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 570/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:33.619440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac737a07-8131-4132-8405-4442220f9da8 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:33.635178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:33.732064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac737a07-8131-4132-8405-4442220f9da8 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:33.771795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc1a6c-3814-4f60-be3c-24ba0f6d5ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:33.772742 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1a6c-3814-4f60-be3c-24ba0f6d5ad4 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:33.772742 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1a6c-3814-4f60-be3c-24ba0f6d5ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:33.772981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1a6c-3814-4f60-be3c-24ba0f6d5ad4 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:33.773594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc1a6c-3814-4f60-be3c-24ba0f6d5ad4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:33.775062 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc1a6c-3814-4f60-be3c-24ba0f6d5ad4 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:33.807206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 564/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:55:33 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 20:55:35.825715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fa4bd-1696-4452-a562-6949112cae77 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:35.826295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fa4bd-1696-4452-a562-6949112cae77 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:35.826295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fa4bd-1696-4452-a562-6949112cae77 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:35.827656 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 571/1135] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:35.833244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65b58c-bb7e-4a63-a301-238733150634 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:35.833694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65b58c-bb7e-4a63-a301-238733150634 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:35.833811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65b58c-bb7e-4a63-a301-238733150634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:35.852997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2f65b58c-bb7e-4a63-a301-238733150634 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:35.854221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2f65b58c-bb7e-4a63-a301-238733150634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:35.919346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:35.929128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 565/1136] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:36.206152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6fa4bd-1696-4452-a562-6949112cae77 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:36.326874 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6fa4bd-1696-4452-a562-6949112cae77 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:36.359035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:36.366185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b7175-7858-4382-82cf-01064bf21f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:36.366860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b7175-7858-4382-82cf-01064bf21f1d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:36.367187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b7175-7858-4382-82cf-01064bf21f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:36.367401 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b7175-7858-4382-82cf-01064bf21f1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:36.368559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b7175-7858-4382-82cf-01064bf21f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:36.369983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b7175-7858-4382-82cf-01064bf21f1d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:36.371690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 572/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:55:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:36.377843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65b58c-bb7e-4a63-a301-238733150634 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:36.484692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65b58c-bb7e-4a63-a301-238733150634 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:36.520683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0085c-ea78-4b43-bd80-15f614d2f4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:36.521303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0085c-ea78-4b43-bd80-15f614d2f4b5 None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:36.521588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0085c-ea78-4b43-bd80-15f614d2f4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:36.521865 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0085c-ea78-4b43-bd80-15f614d2f4b5 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:36.522534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0085c-ea78-4b43-bd80-15f614d2f4b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:36.523999 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0085c-ea78-4b43-bd80-15f614d2f4b5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:36.549220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 566/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:55:36 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:55:38.607265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c7505-0b69-4e53-b16a-1b58a59604c0 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:38.608099 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c7505-0b69-4e53-b16a-1b58a59604c0 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:38.608251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c7505-0b69-4e53-b16a-1b58a59604c0 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:38.609666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 573/1139] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:55:38.616044 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2e5d4-724b-4d32-b4a4-c216ce2553f1 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:38.621346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2e5d4-724b-4d32-b4a4-c216ce2553f1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:38.621945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2e5d4-724b-4d32-b4a4-c216ce2553f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:38.643076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c3a2e5d4-724b-4d32-b4a4-c216ce2553f1 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:38.644312 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c3a2e5d4-724b-4d32-b4a4-c216ce2553f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:38.697881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:38.723902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 567/1140] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:55:39.004466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c7505-0b69-4e53-b16a-1b58a59604c0 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:39.125407 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c7505-0b69-4e53-b16a-1b58a59604c0 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:39.163883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff703412-be6c-4750-add0-274d27b75a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:39.164532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff703412-be6c-4750-add0-274d27b75a2d None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:39.164817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff703412-be6c-4750-add0-274d27b75a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:39.165096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff703412-be6c-4750-add0-274d27b75a2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:39.177496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff703412-be6c-4750-add0-274d27b75a2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-ff703412-be6c-4750-add0-274d27b75a2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:55:39.182315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:39.184463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:39.186223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:39.186223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:39.186223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:39.186223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:39.186223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:55:39.186223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:55:39.186223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:55:39.186223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:55:39.186223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:55:39.186223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:55:39.186223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:55:39.186223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:39.186223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 574/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:55:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:39.193986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2e5d4-724b-4d32-b4a4-c216ce2553f1 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:39.318393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2e5d4-724b-4d32-b4a4-c216ce2553f1 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:39.357747 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2424a1-91bd-4359-aa8c-3e68adbdc3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:39.358373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2424a1-91bd-4359-aa8c-3e68adbdc3eb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:39.358661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2424a1-91bd-4359-aa8c-3e68adbdc3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:39.358969 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2424a1-91bd-4359-aa8c-3e68adbdc3eb None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:39.359660 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2424a1-91bd-4359-aa8c-3e68adbdc3eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:39.359969 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2424a1-91bd-4359-aa8c-3e68adbdc3eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:39.361378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2424a1-91bd-4359-aa8c-3e68adbdc3eb None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:39.371204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 568/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:55:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:39.377465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff703412-be6c-4750-add0-274d27b75a2d None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:39.447182 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:39.492604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff703412-be6c-4750-add0-274d27b75a2d None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:39.531171 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d05897-cc3e-400c-bcd6-8d1fab307308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:39.531806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d05897-cc3e-400c-bcd6-8d1fab307308 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:39.532086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d05897-cc3e-400c-bcd6-8d1fab307308 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:39.532358 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d05897-cc3e-400c-bcd6-8d1fab307308 None admin] PATH_INFO: `/v3/users/2d65070e36304e64baff587372a9ab80` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:39.546942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d05897-cc3e-400c-bcd6-8d1fab307308 None admin] RBAC: Authorizing `identity:get_user(user_id=2d65070e36304e64baff587372a9ab80)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:39.548390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d05897-cc3e-400c-bcd6-8d1fab307308 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:39.550095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 575/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:55:39 2022] GET /identity/v3/users/2d65070e36304e64baff587372a9ab80 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:39.557067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2424a1-91bd-4359-aa8c-3e68adbdc3eb None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:39.606905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:39.671275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2424a1-91bd-4359-aa8c-3e68adbdc3eb None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:39.715511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680afd3-b716-466b-bd53-2dc10e8c0fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:39.716260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680afd3-b716-466b-bd53-2dc10e8c0fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:39.716634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680afd3-b716-466b-bd53-2dc10e8c0fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:39.717002 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680afd3-b716-466b-bd53-2dc10e8c0fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:39.790130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680afd3-b716-466b-bd53-2dc10e8c0fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:39.791618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680afd3-b716-466b-bd53-2dc10e8c0fe3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:39.838249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:39.902321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 569/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:55:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:55:39.909222 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d05897-cc3e-400c-bcd6-8d1fab307308 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:40.086433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d05897-cc3e-400c-bcd6-8d1fab307308 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:40.115234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:40.136310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266e3ab-3e29-42d3-8a88-3993c3e5de23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:40.136966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266e3ab-3e29-42d3-8a88-3993c3e5de23 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:40.137246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266e3ab-3e29-42d3-8a88-3993c3e5de23 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:40.137526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266e3ab-3e29-42d3-8a88-3993c3e5de23 None admin] PATH_INFO: `/v3/projects/50a750b9b89446aa9866b245a2936131` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:40.138714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266e3ab-3e29-42d3-8a88-3993c3e5de23 None admin] RBAC: Authorizing `identity:get_project(project_id=50a750b9b89446aa9866b245a2936131)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:40.140181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266e3ab-3e29-42d3-8a88-3993c3e5de23 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:40.141842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 576/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:55:39 2022] GET /identity/v3/projects/50a750b9b89446aa9866b245a2936131 => generated 311 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:40.148285 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680afd3-b716-466b-bd53-2dc10e8c0fe3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:40.256599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680afd3-b716-466b-bd53-2dc10e8c0fe3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:40.295583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8213a55-5a16-4a1d-8206-4162eff6e1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:40.296194 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8213a55-5a16-4a1d-8206-4162eff6e1ad None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:40.296474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8213a55-5a16-4a1d-8206-4162eff6e1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:40.296745 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8213a55-5a16-4a1d-8206-4162eff6e1ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:40.297469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8213a55-5a16-4a1d-8206-4162eff6e1ad None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=50a750b9b89446aa9866b245a2936131, user.id=2d65070e36304e64baff587372a9ab80) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:40.297773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8213a55-5a16-4a1d-8206-4162eff6e1ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:40.299229 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8213a55-5a16-4a1d-8206-4162eff6e1ad None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:40.305076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 570/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:55:40 2022] GET /identity/v3/role_assignments?user.id=2d65070e36304e64baff587372a9ab80&scope.project.id=50a750b9b89446aa9866b245a2936131&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:42.343018 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22446db7-221e-4524-a60b-6d33c7f41da1 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:42.343618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22446db7-221e-4524-a60b-6d33c7f41da1 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:42.343618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22446db7-221e-4524-a60b-6d33c7f41da1 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:42.345022 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 577/1147] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:42.350711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc8d45-48bd-4674-baed-d7659d897782 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:42.351236 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc8d45-48bd-4674-baed-d7659d897782 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:42.351367 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc8d45-48bd-4674-baed-d7659d897782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:42.364725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:42.371175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d2dc8d45-48bd-4674-baed-d7659d897782 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:42.372382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d2dc8d45-48bd-4674-baed-d7659d897782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:42.480625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 571/1148] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:42.751835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22446db7-221e-4524-a60b-6d33c7f41da1 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:42.858345 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22446db7-221e-4524-a60b-6d33c7f41da1 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:42.896124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4208bc-63e0-4649-a8d0-64fa1c978362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:42.896762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4208bc-63e0-4649-a8d0-64fa1c978362 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:42.897051 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4208bc-63e0-4649-a8d0-64fa1c978362 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:42.897324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4208bc-63e0-4649-a8d0-64fa1c978362 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:42.909204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4208bc-63e0-4649-a8d0-64fa1c978362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-3a4208bc-63e0-4649-a8d0-64fa1c978362 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:55:42.913970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:42.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:42.916400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:42.916400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:42.916400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:42.916400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:42.916400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:55:42.916400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:55:42.916400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:55:42.916400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:55:42.916400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:55:42.916400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:55:42.916400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:55:42.916400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:42.916400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 578/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:55:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:42.921621 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc8d45-48bd-4674-baed-d7659d897782 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:43.052845 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc8d45-48bd-4674-baed-d7659d897782 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:43.097587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209f5f-f38f-45be-b79b-188120a45491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:43.098224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209f5f-f38f-45be-b79b-188120a45491 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:43.098511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209f5f-f38f-45be-b79b-188120a45491 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:43.098814 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209f5f-f38f-45be-b79b-188120a45491 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:43.099536 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2209f5f-f38f-45be-b79b-188120a45491 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:43.099846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2209f5f-f38f-45be-b79b-188120a45491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:43.101304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2209f5f-f38f-45be-b79b-188120a45491 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:43.104085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:43.111894 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 572/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:55:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:43.118256 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4208bc-63e0-4649-a8d0-64fa1c978362 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:43.168649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:43.228352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4208bc-63e0-4649-a8d0-64fa1c978362 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:43.265517 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05838efe-1c49-43ec-bfd8-7e5989d044af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:43.266156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05838efe-1c49-43ec-bfd8-7e5989d044af None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:43.266448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05838efe-1c49-43ec-bfd8-7e5989d044af None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:43.266729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05838efe-1c49-43ec-bfd8-7e5989d044af None admin] PATH_INFO: `/v3/users/2d65070e36304e64baff587372a9ab80` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:43.267914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05838efe-1c49-43ec-bfd8-7e5989d044af None admin] RBAC: Authorizing `identity:get_user(user_id=2d65070e36304e64baff587372a9ab80)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:43.269389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05838efe-1c49-43ec-bfd8-7e5989d044af None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:43.270992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 579/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:55:43 2022] GET /identity/v3/users/2d65070e36304e64baff587372a9ab80 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:43.277828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209f5f-f38f-45be-b79b-188120a45491 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:43.387303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209f5f-f38f-45be-b79b-188120a45491 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:43.424042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c86ce-037e-41b9-8ca0-879b3d0eddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:43.424683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c86ce-037e-41b9-8ca0-879b3d0eddc2 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:43.424961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c86ce-037e-41b9-8ca0-879b3d0eddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:43.425233 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c86ce-037e-41b9-8ca0-879b3d0eddc2 None admin] PATH_INFO: `/v3/projects/50a750b9b89446aa9866b245a2936131` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:43.426383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c86ce-037e-41b9-8ca0-879b3d0eddc2 None admin] RBAC: Authorizing `identity:get_project(project_id=50a750b9b89446aa9866b245a2936131)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:43.427845 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c86ce-037e-41b9-8ca0-879b3d0eddc2 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:43.429480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 573/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:55:43 2022] GET /identity/v3/projects/50a750b9b89446aa9866b245a2936131 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:43.439573 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05838efe-1c49-43ec-bfd8-7e5989d044af None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:43.562008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05838efe-1c49-43ec-bfd8-7e5989d044af None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:43.576320 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:43.599148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb5c35-df3b-4b2b-bbd0-ec7843ad31c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:43.599848 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb5c35-df3b-4b2b-bbd0-ec7843ad31c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:43.600134 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb5c35-df3b-4b2b-bbd0-ec7843ad31c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:43.600417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb5c35-df3b-4b2b-bbd0-ec7843ad31c0 None admin] PATH_INFO: `/v3/projects/50a750b9b89446aa9866b245a2936131/users/2d65070e36304e64baff587372a9ab80/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:43.602412 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb5c35-df3b-4b2b-bbd0-ec7843ad31c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=50a750b9b89446aa9866b245a2936131, user_id=2d65070e36304e64baff587372a9ab80, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:43.603892 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb5c35-df3b-4b2b-bbd0-ec7843ad31c0 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:43.619565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 580/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:55:43 2022] PUT /identity/v3/projects/50a750b9b89446aa9866b245a2936131/users/2d65070e36304e64baff587372a9ab80/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:55:45.644022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05cf70-24e4-4de0-aefd-6a1ca3cdcd3d None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:45.644575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05cf70-24e4-4de0-aefd-6a1ca3cdcd3d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:45.644575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05cf70-24e4-4de0-aefd-6a1ca3cdcd3d None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:45.646176 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 574/1154] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:55:45.652590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e93389-5639-4405-8d3c-00656c63a94f None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:45.653163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e93389-5639-4405-8d3c-00656c63a94f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:45.653163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e93389-5639-4405-8d3c-00656c63a94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:45.673771 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-71e93389-5639-4405-8d3c-00656c63a94f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:45.675041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-71e93389-5639-4405-8d3c-00656c63a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:45.751780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 581/1155] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:46.027786 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05cf70-24e4-4de0-aefd-6a1ca3cdcd3d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:46.103242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:46.141490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05cf70-24e4-4de0-aefd-6a1ca3cdcd3d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:46.177677 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df533a84-d54a-424b-ac01-0bc084f77158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:46.178382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df533a84-d54a-424b-ac01-0bc084f77158 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:46.178710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df533a84-d54a-424b-ac01-0bc084f77158 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:46.179066 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df533a84-d54a-424b-ac01-0bc084f77158 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:46.190379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df533a84-d54a-424b-ac01-0bc084f77158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-df533a84-d54a-424b-ac01-0bc084f77158 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:55:46.195141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:46.196949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:46.199433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:46.199433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:46.199433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:46.199433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:46.199433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:55:46.199433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:55:46.199433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:55:46.199433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:55:46.199433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:55:46.199433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:55:46.199433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:55:46.199433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:55:46.199433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 575/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:55:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:46.204893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e93389-5639-4405-8d3c-00656c63a94f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:46.315472 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e93389-5639-4405-8d3c-00656c63a94f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:46.317077 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:46.358124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08d053-87a8-402e-ac90-221c7dad652f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:46.358766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08d053-87a8-402e-ac90-221c7dad652f None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:46.359058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08d053-87a8-402e-ac90-221c7dad652f None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:46.359334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08d053-87a8-402e-ac90-221c7dad652f None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:46.360010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08d053-87a8-402e-ac90-221c7dad652f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:46.360315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08d053-87a8-402e-ac90-221c7dad652f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:46.361682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08d053-87a8-402e-ac90-221c7dad652f None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:46.371151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 582/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:55:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:46.377142 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df533a84-d54a-424b-ac01-0bc084f77158 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:46.487188 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df533a84-d54a-424b-ac01-0bc084f77158 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:46.515599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:46.525345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2d5c9-f5cd-4c74-b8d9-288b369571fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:46.526024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2d5c9-f5cd-4c74-b8d9-288b369571fe None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:46.526465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2d5c9-f5cd-4c74-b8d9-288b369571fe None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:46.527418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2d5c9-f5cd-4c74-b8d9-288b369571fe None admin] PATH_INFO: `/v3/users/2d65070e36304e64baff587372a9ab80` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:46.528689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2d5c9-f5cd-4c74-b8d9-288b369571fe None admin] RBAC: Authorizing `identity:get_user(user_id=2d65070e36304e64baff587372a9ab80)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:46.530171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2d5c9-f5cd-4c74-b8d9-288b369571fe None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:46.531874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 576/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:55:46 2022] GET /identity/v3/users/2d65070e36304e64baff587372a9ab80 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:46.538089 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08d053-87a8-402e-ac90-221c7dad652f None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:46.658268 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08d053-87a8-402e-ac90-221c7dad652f None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:46.696899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081279f-15fd-4f4a-8953-a48e193a8632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:46.697512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081279f-15fd-4f4a-8953-a48e193a8632 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:46.697793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081279f-15fd-4f4a-8953-a48e193a8632 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:46.698065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081279f-15fd-4f4a-8953-a48e193a8632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:46.734351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:46.778359 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081279f-15fd-4f4a-8953-a48e193a8632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:46.779850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081279f-15fd-4f4a-8953-a48e193a8632 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:46.887771 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 583/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:55:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:55:46.893995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2d5c9-f5cd-4c74-b8d9-288b369571fe None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:47.010278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2d5c9-f5cd-4c74-b8d9-288b369571fe None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:47.049000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16680346-5449-4b7d-ac97-7d90d83ab044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:47.049645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16680346-5449-4b7d-ac97-7d90d83ab044 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:47.049928 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16680346-5449-4b7d-ac97-7d90d83ab044 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:47.050207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16680346-5449-4b7d-ac97-7d90d83ab044 None admin] PATH_INFO: `/v3/projects/50a750b9b89446aa9866b245a2936131` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:47.051378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16680346-5449-4b7d-ac97-7d90d83ab044 None admin] RBAC: Authorizing `identity:get_project(project_id=50a750b9b89446aa9866b245a2936131)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:47.052815 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16680346-5449-4b7d-ac97-7d90d83ab044 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:47.054471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 577/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:55:46 2022] GET /identity/v3/projects/50a750b9b89446aa9866b245a2936131 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:47.062223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081279f-15fd-4f4a-8953-a48e193a8632 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:47.134835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:47.176639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081279f-15fd-4f4a-8953-a48e193a8632 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:47.213177 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cb69d-e728-48d9-a5d2-b470629f4212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:47.213854 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cb69d-e728-48d9-a5d2-b470629f4212 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:47.214144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cb69d-e728-48d9-a5d2-b470629f4212 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:47.214421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cb69d-e728-48d9-a5d2-b470629f4212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:47.215196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cb69d-e728-48d9-a5d2-b470629f4212 None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=50a750b9b89446aa9866b245a2936131, user.id=2d65070e36304e64baff587372a9ab80) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:47.215511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cb69d-e728-48d9-a5d2-b470629f4212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:47.216976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cb69d-e728-48d9-a5d2-b470629f4212 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:47.223525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 584/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:55:47 2022] GET /identity/v3/role_assignments?user.id=2d65070e36304e64baff587372a9ab80&scope.project.id=50a750b9b89446aa9866b245a2936131&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:49.205325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010df8-62cb-4d55-bdd8-cb4a3abf1cec None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:49.205927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010df8-62cb-4d55-bdd8-cb4a3abf1cec None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:49.205927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010df8-62cb-4d55-bdd8-cb4a3abf1cec None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:49.207252 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 578/1162] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:49.212880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913c7d1-d220-49d4-b812-d4a7570851cd None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:49.213391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913c7d1-d220-49d4-b812-d4a7570851cd None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:49.213524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913c7d1-d220-49d4-b812-d4a7570851cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:49.231813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7913c7d1-d220-49d4-b812-d4a7570851cd None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:49.233041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7913c7d1-d220-49d4-b812-d4a7570851cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:49.306850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 585/1163] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:49.575724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19010df8-62cb-4d55-bdd8-cb4a3abf1cec None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:49.644814 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:49.689071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19010df8-62cb-4d55-bdd8-cb4a3abf1cec None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:49.725285 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0c80a-05fb-4c1c-900d-484327d31de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:49.725899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0c80a-05fb-4c1c-900d-484327d31de5 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:49.726181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0c80a-05fb-4c1c-900d-484327d31de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:49.726455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0c80a-05fb-4c1c-900d-484327d31de5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:49.806527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0c80a-05fb-4c1c-900d-484327d31de5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:49.808597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0c80a-05fb-4c1c-900d-484327d31de5 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:49.881491 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:49.937523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 579/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:55:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:55:49.943756 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913c7d1-d220-49d4-b812-d4a7570851cd None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:50.027392 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:50.079938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913c7d1-d220-49d4-b812-d4a7570851cd None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:50.114694 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c771e7-98db-4815-a3a9-523d306dd2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:50.115363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c771e7-98db-4815-a3a9-523d306dd2dc None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:50.115645 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c771e7-98db-4815-a3a9-523d306dd2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:50.115919 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c771e7-98db-4815-a3a9-523d306dd2dc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:50.123668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c771e7-98db-4815-a3a9-523d306dd2dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:50.125122 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c771e7-98db-4815-a3a9-523d306dd2dc None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-a9c771e7-98db-4815-a3a9-523d306dd2dc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:55:50.143083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:55:50.145212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:55:50.147113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 586/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Aug 19 20:55:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:55:50.152351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0c80a-05fb-4c1c-900d-484327d31de5 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:50.263571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0c80a-05fb-4c1c-900d-484327d31de5 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:50.300234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf111b5-5ee6-4d60-a849-0dca3299031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:50.300844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf111b5-5ee6-4d60-a849-0dca3299031e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:50.301126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf111b5-5ee6-4d60-a849-0dca3299031e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:50.301400 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf111b5-5ee6-4d60-a849-0dca3299031e None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:50.302052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf111b5-5ee6-4d60-a849-0dca3299031e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:55:50.302355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf111b5-5ee6-4d60-a849-0dca3299031e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:50.303846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf111b5-5ee6-4d60-a849-0dca3299031e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:50.312435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 580/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Fri Aug 19 20:55:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:52.264366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36f44-4a85-4ca7-bb41-35de730db3c6 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:52.264910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36f44-4a85-4ca7-bb41-35de730db3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:52.265002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36f44-4a85-4ca7-bb41-35de730db3c6 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:52.266409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 587/1167] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:55:52.272134 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a6d08-2098-44fc-a5fa-63ee6e56ddfb None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:52.272621 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a6d08-2098-44fc-a5fa-63ee6e56ddfb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:52.272773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a6d08-2098-44fc-a5fa-63ee6e56ddfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:52.292994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-641a6d08-2098-44fc-a5fa-63ee6e56ddfb None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:52.294321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-641a6d08-2098-44fc-a5fa-63ee6e56ddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:52.318473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:52.369219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 581/1168] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:52.639988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36f44-4a85-4ca7-bb41-35de730db3c6 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:52.749544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36f44-4a85-4ca7-bb41-35de730db3c6 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:52.778201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:52.800217 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a892d-ea53-44da-8f2b-91f03323d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:52.800837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a892d-ea53-44da-8f2b-91f03323d23c None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:52.801126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a892d-ea53-44da-8f2b-91f03323d23c None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:52.801400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a892d-ea53-44da-8f2b-91f03323d23c None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:52.802084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a892d-ea53-44da-8f2b-91f03323d23c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:52.803475 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a892d-ea53-44da-8f2b-91f03323d23c None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:52.821260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 588/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Fri Aug 19 20:55:52 2022] POST /identity/v3/domains => generated 267 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 20:55:55.023920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d35419-0354-4b24-b1a5-056bd7d59d92 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:55.024521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d35419-0354-4b24-b1a5-056bd7d59d92 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:55.024521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d35419-0354-4b24-b1a5-056bd7d59d92 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:55.025712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 582/1170] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:55:55.031938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ca70a-eec7-4595-84fc-09ddea7ed362 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:55.032494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ca70a-eec7-4595-84fc-09ddea7ed362 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:55.032494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ca70a-eec7-4595-84fc-09ddea7ed362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:55.052253 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e96ca70a-eec7-4595-84fc-09ddea7ed362 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:55.053486 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e96ca70a-eec7-4595-84fc-09ddea7ed362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:55.129022 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 589/1171] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:55:55.407315 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d35419-0354-4b24-b1a5-056bd7d59d92 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:55.519384 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d35419-0354-4b24-b1a5-056bd7d59d92 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:55.556723 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877dddc-3a4c-4c66-9e80-9b110669dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:55.557369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877dddc-3a4c-4c66-9e80-9b110669dc48 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:55.558257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877dddc-3a4c-4c66-9e80-9b110669dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:55.558583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877dddc-3a4c-4c66-9e80-9b110669dc48 None admin] PATH_INFO: `/v3/domains/7ce8d00b831e463d841f920b5d7fbe12` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:55.570312 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877dddc-3a4c-4c66-9e80-9b110669dc48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7ce8d00b831e463d841f920b5d7fbe12)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:55.571817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877dddc-3a4c-4c66-9e80-9b110669dc48 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:55.574106 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 583/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Fri Aug 19 20:55:55 2022] GET /identity/v3/domains/7ce8d00b831e463d841f920b5d7fbe12 => generated 267 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:55:55.580743 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ca70a-eec7-4595-84fc-09ddea7ed362 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:55.689241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ca70a-eec7-4595-84fc-09ddea7ed362 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:55.699976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:55.728368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06437a-4739-4bf2-8875-f5fe2201ed7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:55.728992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06437a-4739-4bf2-8875-f5fe2201ed7e None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:55.729808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06437a-4739-4bf2-8875-f5fe2201ed7e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:55.730117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06437a-4739-4bf2-8875-f5fe2201ed7e None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:55.730821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06437a-4739-4bf2-8875-f5fe2201ed7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:55.732310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06437a-4739-4bf2-8875-f5fe2201ed7e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:55.762444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 590/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:55:55 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:55:57.816138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831110b-47b6-41e1-8dc3-19967081c152 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:57.816664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831110b-47b6-41e1-8dc3-19967081c152 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:57.816822 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831110b-47b6-41e1-8dc3-19967081c152 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:57.818263 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 584/1174] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:55:57.824498 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017cb0d-f0c6-4667-aee0-69b2040181c6 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:57.824996 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017cb0d-f0c6-4667-aee0-69b2040181c6 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:57.825150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017cb0d-f0c6-4667-aee0-69b2040181c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:57.843463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-a017cb0d-f0c6-4667-aee0-69b2040181c6 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:55:57.844740 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a017cb0d-f0c6-4667-aee0-69b2040181c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:55:57.920797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 591/1175] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:55:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:55:58.196502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831110b-47b6-41e1-8dc3-19967081c152 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:58.216977 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:58.309594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831110b-47b6-41e1-8dc3-19967081c152 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:58.346422 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a17faa-1111-48e7-9237-c72477429fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:58.347247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a17faa-1111-48e7-9237-c72477429fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:58.347575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a17faa-1111-48e7-9237-c72477429fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:58.347896 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a17faa-1111-48e7-9237-c72477429fc1 None admin] PATH_INFO: `/v3/domains/7ce8d00b831e463d841f920b5d7fbe12` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:58.349151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a17faa-1111-48e7-9237-c72477429fc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7ce8d00b831e463d841f920b5d7fbe12)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:58.350645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a17faa-1111-48e7-9237-c72477429fc1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:58.352352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 585/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Fri Aug 19 20:55:58 2022] GET /identity/v3/domains/7ce8d00b831e463d841f920b5d7fbe12 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:55:58.359109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017cb0d-f0c6-4667-aee0-69b2040181c6 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:55:58.459383 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:55:58.472886 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017cb0d-f0c6-4667-aee0-69b2040181c6 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:55:58.510372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140bb01-b6c2-4d65-ac74-16bf45fd78c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:55:58.511778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140bb01-b6c2-4d65-ac74-16bf45fd78c7 None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:55:58.512106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140bb01-b6c2-4d65-ac74-16bf45fd78c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:55:58.512426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140bb01-b6c2-4d65-ac74-16bf45fd78c7 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:55:58.513186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140bb01-b6c2-4d65-ac74-16bf45fd78c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:55:58.514670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140bb01-b6c2-4d65-ac74-16bf45fd78c7 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:55:58.538251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 592/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:55:58 2022] POST /identity/v3/users => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:56:00.629220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796ad79-04c2-4bfe-b578-064552fe6436 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:00.629813 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796ad79-04c2-4bfe-b578-064552fe6436 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:00.629813 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796ad79-04c2-4bfe-b578-064552fe6436 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:00.631180 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 586/1178] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:56:00.637407 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53e56a-5cf1-4f4d-91e2-11ef9b85642b None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:00.637964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53e56a-5cf1-4f4d-91e2-11ef9b85642b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:00.638123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53e56a-5cf1-4f4d-91e2-11ef9b85642b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:00.657078 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-cc53e56a-5cf1-4f4d-91e2-11ef9b85642b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:56:00.658355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cc53e56a-5cf1-4f4d-91e2-11ef9b85642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:56:00.731718 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 593/1179] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:56:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:56:01.006162 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796ad79-04c2-4bfe-b578-064552fe6436 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:01.102612 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:01.121898 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796ad79-04c2-4bfe-b578-064552fe6436 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:01.158781 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8e4bc-14fc-480d-bffc-bce50ac3a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:01.159420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8e4bc-14fc-480d-bffc-bce50ac3a441 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:01.159699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8e4bc-14fc-480d-bffc-bce50ac3a441 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:01.159969 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8e4bc-14fc-480d-bffc-bce50ac3a441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:01.171854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8e4bc-14fc-480d-bffc-bce50ac3a441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-55a8e4bc-14fc-480d-bffc-bce50ac3a441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:56:01.176513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:56:01.178309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:56:01.180015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:56:01.180015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:56:01.180015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:56:01.180015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:56:01.180015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:56:01.180015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:56:01.180015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:56:01.180015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:56:01.180015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:56:01.180015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:56:01.180015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:56:01.180015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:56:01.180015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 587/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:56:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:56:01.184548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53e56a-5cf1-4f4d-91e2-11ef9b85642b None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:01.269557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:01.296655 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53e56a-5cf1-4f4d-91e2-11ef9b85642b None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:01.336477 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ce0d1-18e9-46c6-92d1-bf6b9db72af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:01.337527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ce0d1-18e9-46c6-92d1-bf6b9db72af5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:01.338034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ce0d1-18e9-46c6-92d1-bf6b9db72af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:01.338534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ce0d1-18e9-46c6-92d1-bf6b9db72af5 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:01.340330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ce0d1-18e9-46c6-92d1-bf6b9db72af5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:56:01.340856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ce0d1-18e9-46c6-92d1-bf6b9db72af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:01.343491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ce0d1-18e9-46c6-92d1-bf6b9db72af5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:01.358207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 594/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:56:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:56:01.364214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8e4bc-14fc-480d-bffc-bce50ac3a441 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:01.485372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8e4bc-14fc-480d-bffc-bce50ac3a441 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:01.529187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41f366-186d-41ac-b817-01afa2999c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:01.529834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41f366-186d-41ac-b817-01afa2999c1e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:01.530162 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41f366-186d-41ac-b817-01afa2999c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:01.530493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41f366-186d-41ac-b817-01afa2999c1e None admin] PATH_INFO: `/v3/users/3fd6d6c48a8b411db82e358b186fe12f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:01.547061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41f366-186d-41ac-b817-01afa2999c1e None admin] RBAC: Authorizing `identity:get_user(user_id=3fd6d6c48a8b411db82e358b186fe12f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:01.548642 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41f366-186d-41ac-b817-01afa2999c1e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:01.550487 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 588/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:56:01 2022] GET /identity/v3/users/3fd6d6c48a8b411db82e358b186fe12f => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:56:01.556925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ce0d1-18e9-46c6-92d1-bf6b9db72af5 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:01.670691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ce0d1-18e9-46c6-92d1-bf6b9db72af5 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:01.707121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f135a0b-51d1-4d8d-bf7c-acb69704e537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:01.707719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f135a0b-51d1-4d8d-bf7c-acb69704e537 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:01.708003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f135a0b-51d1-4d8d-bf7c-acb69704e537 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:01.708272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f135a0b-51d1-4d8d-bf7c-acb69704e537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:01.717644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:01.783787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f135a0b-51d1-4d8d-bf7c-acb69704e537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:01.785154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f135a0b-51d1-4d8d-bf7c-acb69704e537 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:01.886500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 595/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:56:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:56:01.893668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41f366-186d-41ac-b817-01afa2999c1e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:01.897110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:02.003230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41f366-186d-41ac-b817-01afa2999c1e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:02.039288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec83f8-5209-4e24-ba9c-dbd2f092a53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:02.039837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec83f8-5209-4e24-ba9c-dbd2f092a53a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:02.040117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec83f8-5209-4e24-ba9c-dbd2f092a53a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:02.040388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec83f8-5209-4e24-ba9c-dbd2f092a53a None admin] PATH_INFO: `/v3/projects/bd6534ff78da4d83819cc8cae5e1ab27` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:02.041516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec83f8-5209-4e24-ba9c-dbd2f092a53a None admin] RBAC: Authorizing `identity:get_project(project_id=bd6534ff78da4d83819cc8cae5e1ab27)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:02.044090 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec83f8-5209-4e24-ba9c-dbd2f092a53a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:02.045751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 589/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:56:01 2022] GET /identity/v3/projects/bd6534ff78da4d83819cc8cae5e1ab27 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:56:02.052163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f135a0b-51d1-4d8d-bf7c-acb69704e537 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:02.105676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:02.166332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f135a0b-51d1-4d8d-bf7c-acb69704e537 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:02.201709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db37dc-18ae-43d5-a3db-816d5d56d3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:02.202318 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db37dc-18ae-43d5-a3db-816d5d56d3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:02.202601 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db37dc-18ae-43d5-a3db-816d5d56d3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:02.202915 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db37dc-18ae-43d5-a3db-816d5d56d3a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:02.203645 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db37dc-18ae-43d5-a3db-816d5d56d3a8 None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=bd6534ff78da4d83819cc8cae5e1ab27, user.id=3fd6d6c48a8b411db82e358b186fe12f) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:56:02.203957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db37dc-18ae-43d5-a3db-816d5d56d3a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:02.205375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db37dc-18ae-43d5-a3db-816d5d56d3a8 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:02.211034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 596/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:56:02 2022] GET /identity/v3/role_assignments?user.id=3fd6d6c48a8b411db82e358b186fe12f&scope.project.id=bd6534ff78da4d83819cc8cae5e1ab27&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:56:04.163139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61202ec9-67ff-4ef1-8e9c-90a35743265b None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:04.163706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61202ec9-67ff-4ef1-8e9c-90a35743265b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:04.163800 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61202ec9-67ff-4ef1-8e9c-90a35743265b None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:04.165563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 590/1186] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:56:04.171485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73d92-501b-4250-8590-9c8e38b55b39 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:04.172227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73d92-501b-4250-8590-9c8e38b55b39 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:04.172380 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73d92-501b-4250-8590-9c8e38b55b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:04.192301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-d3f73d92-501b-4250-8590-9c8e38b55b39 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:56:04.193496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d3f73d92-501b-4250-8590-9c8e38b55b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:56:04.266153 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 597/1187] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:56:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:56:04.540674 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61202ec9-67ff-4ef1-8e9c-90a35743265b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:04.617955 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:04.655527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61202ec9-67ff-4ef1-8e9c-90a35743265b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:04.691031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2794d-eefc-4e0d-9470-7f8bfd79ac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:04.691665 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2794d-eefc-4e0d-9470-7f8bfd79ac91 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:04.691956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2794d-eefc-4e0d-9470-7f8bfd79ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:04.692225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2794d-eefc-4e0d-9470-7f8bfd79ac91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:04.703024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2794d-eefc-4e0d-9470-7f8bfd79ac91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-b8c2794d-eefc-4e0d-9470-7f8bfd79ac91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:56:04.707762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:56:04.709638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:56:04.711353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:56:04.711353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:56:04.711353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:56:04.711353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:56:04.711353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:56:04.711353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:56:04.711353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:56:04.711353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:56:04.711353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:56:04.711353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:56:04.711353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:56:04.711353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:56:04.711353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 591/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:56:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:56:04.715989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f73d92-501b-4250-8590-9c8e38b55b39 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:04.747247 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:04.824995 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f73d92-501b-4250-8590-9c8e38b55b39 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:04.861231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1943e-43dd-47e9-b55e-3883eef5de27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:04.861840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1943e-43dd-47e9-b55e-3883eef5de27 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:04.862124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1943e-43dd-47e9-b55e-3883eef5de27 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:04.862400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1943e-43dd-47e9-b55e-3883eef5de27 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:04.863122 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1943e-43dd-47e9-b55e-3883eef5de27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:56:04.863431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1943e-43dd-47e9-b55e-3883eef5de27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:04.864814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1943e-43dd-47e9-b55e-3883eef5de27 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:04.873403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 598/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:56:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:56:04.879581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2794d-eefc-4e0d-9470-7f8bfd79ac91 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:04.987855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2794d-eefc-4e0d-9470-7f8bfd79ac91 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:05.018769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:05.025269 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda053f-b661-4b27-ade6-089d5ad26864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:05.026883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda053f-b661-4b27-ade6-089d5ad26864 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:05.027054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda053f-b661-4b27-ade6-089d5ad26864 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:05.027406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda053f-b661-4b27-ade6-089d5ad26864 None admin] PATH_INFO: `/v3/users/3fd6d6c48a8b411db82e358b186fe12f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:05.028721 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda053f-b661-4b27-ade6-089d5ad26864 None admin] RBAC: Authorizing `identity:get_user(user_id=3fd6d6c48a8b411db82e358b186fe12f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:05.030249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda053f-b661-4b27-ade6-089d5ad26864 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:05.031901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 592/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:56:04 2022] GET /identity/v3/users/3fd6d6c48a8b411db82e358b186fe12f => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:56:05.037960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1943e-43dd-47e9-b55e-3883eef5de27 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:05.140539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:05.148086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1943e-43dd-47e9-b55e-3883eef5de27 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:05.184978 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c72c2-1a1b-40a6-85f3-a515c9cecb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:05.185755 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c72c2-1a1b-40a6-85f3-a515c9cecb37 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:05.185927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c72c2-1a1b-40a6-85f3-a515c9cecb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:05.186150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c72c2-1a1b-40a6-85f3-a515c9cecb37 None admin] PATH_INFO: `/v3/projects/bd6534ff78da4d83819cc8cae5e1ab27` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:05.187330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c72c2-1a1b-40a6-85f3-a515c9cecb37 None admin] RBAC: Authorizing `identity:get_project(project_id=bd6534ff78da4d83819cc8cae5e1ab27)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:05.188762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c72c2-1a1b-40a6-85f3-a515c9cecb37 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:05.190432 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 599/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:56:05 2022] GET /identity/v3/projects/bd6534ff78da4d83819cc8cae5e1ab27 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:56:05.196943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda053f-b661-4b27-ade6-089d5ad26864 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:05.314315 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda053f-b661-4b27-ade6-089d5ad26864 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:05.351273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e4020-023a-4412-be62-cd10626a3182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:05.351938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e4020-023a-4412-be62-cd10626a3182 None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:05.352213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e4020-023a-4412-be62-cd10626a3182 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:05.352492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e4020-023a-4412-be62-cd10626a3182 None admin] PATH_INFO: `/v3/projects/bd6534ff78da4d83819cc8cae5e1ab27/users/3fd6d6c48a8b411db82e358b186fe12f/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:05.355021 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e4020-023a-4412-be62-cd10626a3182 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd6534ff78da4d83819cc8cae5e1ab27, user_id=3fd6d6c48a8b411db82e358b186fe12f, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:05.356480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e4020-023a-4412-be62-cd10626a3182 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:05.371900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 593/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:56:05 2022] PUT /identity/v3/projects/bd6534ff78da4d83819cc8cae5e1ab27/users/3fd6d6c48a8b411db82e358b186fe12f/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:56:07.359502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fe1ed-ab1e-4c29-924c-3e26c8044499 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:07.360068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fe1ed-ab1e-4c29-924c-3e26c8044499 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:07.360068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fe1ed-ab1e-4c29-924c-3e26c8044499 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:07.361388 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 600/1193] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:56:07.367007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00683ed7-47c7-4af3-a6b6-c60908c116ca None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:07.367437 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00683ed7-47c7-4af3-a6b6-c60908c116ca None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:07.367647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00683ed7-47c7-4af3-a6b6-c60908c116ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:07.386939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-00683ed7-47c7-4af3-a6b6-c60908c116ca None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:56:07.388136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-00683ed7-47c7-4af3-a6b6-c60908c116ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:56:07.443069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:07.457727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 594/1194] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:56:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:56:07.730007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fe1ed-ab1e-4c29-924c-3e26c8044499 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:07.840138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fe1ed-ab1e-4c29-924c-3e26c8044499 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:07.876238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a481a-7195-45b0-9fd5-cad778bf62ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:07.876875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a481a-7195-45b0-9fd5-cad778bf62ce None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:07.877161 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a481a-7195-45b0-9fd5-cad778bf62ce None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:07.877440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a481a-7195-45b0-9fd5-cad778bf62ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:07.888134 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a481a-7195-45b0-9fd5-cad778bf62ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-407a481a-7195-45b0-9fd5-cad778bf62ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:56:07.892870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:56:07.894638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:56:07.896606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:56:07.896606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:56:07.896606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:56:07.896606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:56:07.896606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:56:07.896606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:56:07.896606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:56:07.896606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:56:07.896606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:56:07.896606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:56:07.896606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:56:07.896606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:56:07.896606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 601/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:56:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:56:07.900136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00683ed7-47c7-4af3-a6b6-c60908c116ca None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:08.001731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00683ed7-47c7-4af3-a6b6-c60908c116ca None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:08.036183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d2317-f31e-4b72-83b5-abd957004d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:08.036796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2317-f31e-4b72-83b5-abd957004d8f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:08.037083 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2317-f31e-4b72-83b5-abd957004d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:08.037361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2317-f31e-4b72-83b5-abd957004d8f None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:08.043823 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d2317-f31e-4b72-83b5-abd957004d8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:56:08.043823 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d2317-f31e-4b72-83b5-abd957004d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:08.043823 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d2317-f31e-4b72-83b5-abd957004d8f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:08.049509 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 595/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:56:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:56:08.055658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a481a-7195-45b0-9fd5-cad778bf62ce None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:08.083859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:08.162272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a481a-7195-45b0-9fd5-cad778bf62ce None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:08.197956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f647c-69c4-4223-9e64-c12ca5568e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:08.198954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f647c-69c4-4223-9e64-c12ca5568e99 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:08.198954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f647c-69c4-4223-9e64-c12ca5568e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:08.199295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f647c-69c4-4223-9e64-c12ca5568e99 None admin] PATH_INFO: `/v3/users/3fd6d6c48a8b411db82e358b186fe12f` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:08.200331 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f647c-69c4-4223-9e64-c12ca5568e99 None admin] RBAC: Authorizing `identity:get_user(user_id=3fd6d6c48a8b411db82e358b186fe12f)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:08.201757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f647c-69c4-4223-9e64-c12ca5568e99 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:08.203377 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 602/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Aug 19 20:56:08 2022] GET /identity/v3/users/3fd6d6c48a8b411db82e358b186fe12f => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:56:08.209447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d2317-f31e-4b72-83b5-abd957004d8f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:08.271928 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:08.324539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d2317-f31e-4b72-83b5-abd957004d8f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:08.361604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e10087-0e19-4195-9e95-b2b3ed47ab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:08.362223 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e10087-0e19-4195-9e95-b2b3ed47ab6f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:08.362503 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e10087-0e19-4195-9e95-b2b3ed47ab6f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:08.362803 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e10087-0e19-4195-9e95-b2b3ed47ab6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:08.440496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e10087-0e19-4195-9e95-b2b3ed47ab6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:08.441955 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e10087-0e19-4195-9e95-b2b3ed47ab6f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:08.493713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:08.550430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 596/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:56:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:56:08.556540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f647c-69c4-4223-9e64-c12ca5568e99 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:08.652757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:08.662614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f647c-69c4-4223-9e64-c12ca5568e99 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:08.699691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697efda0-dad0-4d5a-8962-2173ec80407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:08.700330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697efda0-dad0-4d5a-8962-2173ec80407a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:08.700611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697efda0-dad0-4d5a-8962-2173ec80407a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:08.700883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697efda0-dad0-4d5a-8962-2173ec80407a None admin] PATH_INFO: `/v3/projects/bd6534ff78da4d83819cc8cae5e1ab27` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:08.702012 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697efda0-dad0-4d5a-8962-2173ec80407a None admin] RBAC: Authorizing `identity:get_project(project_id=bd6534ff78da4d83819cc8cae5e1ab27)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:08.703463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697efda0-dad0-4d5a-8962-2173ec80407a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:08.705107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 603/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Aug 19 20:56:08 2022] GET /identity/v3/projects/bd6534ff78da4d83819cc8cae5e1ab27 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:56:08.711435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e10087-0e19-4195-9e95-b2b3ed47ab6f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:56:08.843863 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e10087-0e19-4195-9e95-b2b3ed47ab6f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:56:08.892566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38345bec-e1a5-4e49-bd31-963d32e79d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:56:08.893192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38345bec-e1a5-4e49-bd31-963d32e79d68 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:56:08.893473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38345bec-e1a5-4e49-bd31-963d32e79d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:56:08.893747 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38345bec-e1a5-4e49-bd31-963d32e79d68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:56:08.894504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38345bec-e1a5-4e49-bd31-963d32e79d68 None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=bd6534ff78da4d83819cc8cae5e1ab27, user.id=3fd6d6c48a8b411db82e358b186fe12f) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:56:08.894865 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38345bec-e1a5-4e49-bd31-963d32e79d68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:56:08.896365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38345bec-e1a5-4e49-bd31-963d32e79d68 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:56:08.903964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 597/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:56:08 2022] GET /identity/v3/role_assignments?user.id=3fd6d6c48a8b411db82e358b186fe12f&scope.project.id=bd6534ff78da4d83819cc8cae5e1ab27&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:56:18.694566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=21 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:56:18.900150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=93 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:06.527403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a66dc-68b4-43f8-be37-e4da28ec14e0 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:06.528067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a66dc-68b4-43f8-be37-e4da28ec14e0 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:06.528067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a66dc-68b4-43f8-be37-e4da28ec14e0 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:06.530797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 604/1201] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:57:06.536144 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b80a9-b400-4ec4-96f2-33098afa93fe None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:06.536668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b80a9-b400-4ec4-96f2-33098afa93fe None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:06.536904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b80a9-b400-4ec4-96f2-33098afa93fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:06.563435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-756b80a9-b400-4ec4-96f2-33098afa93fe None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:57:06.564891 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-756b80a9-b400-4ec4-96f2-33098afa93fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:57:06.658202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 598/1202] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:57:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:57:06.941649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a66dc-68b4-43f8-be37-e4da28ec14e0 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:07.087598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a66dc-68b4-43f8-be37-e4da28ec14e0 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:07.130808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da98939-1527-4aba-92a0-ce04b2700446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:07.131625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da98939-1527-4aba-92a0-ce04b2700446 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:07.131789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da98939-1527-4aba-92a0-ce04b2700446 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:07.132068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da98939-1527-4aba-92a0-ce04b2700446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:07.144193 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da98939-1527-4aba-92a0-ce04b2700446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:07.145807 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da98939-1527-4aba-92a0-ce04b2700446 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-9da98939-1527-4aba-92a0-ce04b2700446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:57:07.164165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:07.165705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:57:07.168033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:57:07.168033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:07.168033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:07.171213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 605/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:07.172303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b80a9-b400-4ec4-96f2-33098afa93fe None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:07.322444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b80a9-b400-4ec4-96f2-33098afa93fe None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:07.360453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:07.368510 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c85f78-2fb7-417d-842a-ffb1e1f905ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:07.369687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c85f78-2fb7-417d-842a-ffb1e1f905ec None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:07.370064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c85f78-2fb7-417d-842a-ffb1e1f905ec None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:07.370368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c85f78-2fb7-417d-842a-ffb1e1f905ec None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:07.371116 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c85f78-2fb7-417d-842a-ffb1e1f905ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:07.371426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c85f78-2fb7-417d-842a-ffb1e1f905ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:07.372851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c85f78-2fb7-417d-842a-ffb1e1f905ec None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:07.388228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 599/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:07.397816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da98939-1527-4aba-92a0-ce04b2700446 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:07.479252 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:07.545556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da98939-1527-4aba-92a0-ce04b2700446 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:07.589183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17353de-26ff-49bb-bdd8-004a0c25310a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:07.589761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17353de-26ff-49bb-bdd8-004a0c25310a None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:07.590061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17353de-26ff-49bb-bdd8-004a0c25310a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:07.590341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17353de-26ff-49bb-bdd8-004a0c25310a None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:07.591305 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17353de-26ff-49bb-bdd8-004a0c25310a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:07.592729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17353de-26ff-49bb-bdd8-004a0c25310a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:07.624825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 606/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Aug 19 20:57:07 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:57:09.820204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626272-6b9f-4684-9a9f-6131201dddb9 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:09.820889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626272-6b9f-4684-9a9f-6131201dddb9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:09.820889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626272-6b9f-4684-9a9f-6131201dddb9 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:09.822293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 600/1206] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:57:09.827670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31498d1a-fa83-4f2b-b914-cad03cbbc4ee None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:09.828182 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31498d1a-fa83-4f2b-b914-cad03cbbc4ee None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:09.828272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31498d1a-fa83-4f2b-b914-cad03cbbc4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:09.847456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-31498d1a-fa83-4f2b-b914-cad03cbbc4ee None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:57:09.848770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-31498d1a-fa83-4f2b-b914-cad03cbbc4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:57:09.927698 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 607/1207] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:57:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:57:10.254730 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5626272-6b9f-4684-9a9f-6131201dddb9 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:10.374851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5626272-6b9f-4684-9a9f-6131201dddb9 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:10.419291 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e79140-a4bc-4513-8bbc-dd295b6aaf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:10.420071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e79140-a4bc-4513-8bbc-dd295b6aaf6c None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:10.420330 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e79140-a4bc-4513-8bbc-dd295b6aaf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:10.420592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e79140-a4bc-4513-8bbc-dd295b6aaf6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:10.434441 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e79140-a4bc-4513-8bbc-dd295b6aaf6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-c8e79140-a4bc-4513-8bbc-dd295b6aaf6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:57:10.439409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:10.440478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:10.441363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:10.441363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:10.441363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:10.441363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:10.441363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:57:10.441363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:57:10.441363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:57:10.441363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:57:10.441363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:57:10.441363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:57:10.441363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:57:10.441363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:10.441363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 601/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:57:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:10.448020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31498d1a-fa83-4f2b-b914-cad03cbbc4ee None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:10.510856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:10.582849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31498d1a-fa83-4f2b-b914-cad03cbbc4ee None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:10.625153 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f9708-f928-4a13-81fc-3628b47a1905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:10.626969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f9708-f928-4a13-81fc-3628b47a1905 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:10.626969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f9708-f928-4a13-81fc-3628b47a1905 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:10.626969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f9708-f928-4a13-81fc-3628b47a1905 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:10.627511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f9708-f928-4a13-81fc-3628b47a1905 None admin] RBAC: Adding query filter params (name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:10.627902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f9708-f928-4a13-81fc-3628b47a1905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:10.629445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f9708-f928-4a13-81fc-3628b47a1905 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:10.645245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 608/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:57:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:10.646589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e79140-a4bc-4513-8bbc-dd295b6aaf6c None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:10.720655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:10.781484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e79140-a4bc-4513-8bbc-dd295b6aaf6c None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:10.828777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7adc1-7ece-49b1-a34e-d0181ad91d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:10.829588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7adc1-7ece-49b1-a34e-d0181ad91d35 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:10.829785 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7adc1-7ece-49b1-a34e-d0181ad91d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:10.830057 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7adc1-7ece-49b1-a34e-d0181ad91d35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:10.843308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7adc1-7ece-49b1-a34e-d0181ad91d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:10.845440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7adc1-7ece-49b1-a34e-d0181ad91d35 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-a2c7adc1-7ece-49b1-a34e-d0181ad91d35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:57:10.861989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:10.863370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:57:10.864937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:57:10.864937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:10.864937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:10.866910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 602/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:10.870701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f9708-f928-4a13-81fc-3628b47a1905 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:11.000561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:11.004941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f9708-f928-4a13-81fc-3628b47a1905 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:11.054992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac339b0-c46f-453d-a26d-dc79e8e4704a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:11.055876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac339b0-c46f-453d-a26d-dc79e8e4704a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:11.056327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac339b0-c46f-453d-a26d-dc79e8e4704a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:11.056636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac339b0-c46f-453d-a26d-dc79e8e4704a None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:11.057387 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac339b0-c46f-453d-a26d-dc79e8e4704a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:11.057614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac339b0-c46f-453d-a26d-dc79e8e4704a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:11.059014 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac339b0-c46f-453d-a26d-dc79e8e4704a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:11.073627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 609/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:57:11.082316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7adc1-7ece-49b1-a34e-d0181ad91d35 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:11.242316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7adc1-7ece-49b1-a34e-d0181ad91d35 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:11.244586 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:11.288250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18a91a-d8f4-4dae-a941-cce89719f4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:11.288885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18a91a-d8f4-4dae-a941-cce89719f4ba None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:11.289174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18a91a-d8f4-4dae-a941-cce89719f4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:11.289442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18a91a-d8f4-4dae-a941-cce89719f4ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:11.299123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18a91a-d8f4-4dae-a941-cce89719f4ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:11.300629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18a91a-d8f4-4dae-a941-cce89719f4ba None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-ca18a91a-d8f4-4dae-a941-cce89719f4ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:57:11.315078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:11.316113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:11.317110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:11.317110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:11.317110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:57:11.317110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:57:11.317110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:57:11.317110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:57:11.317110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:57:11.317110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:57:11.317110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 20:57:11.317110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:11.317110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 603/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:57:11.322524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac339b0-c46f-453d-a26d-dc79e8e4704a None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:11.457836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac339b0-c46f-453d-a26d-dc79e8e4704a None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:11.501659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca38ae6-37ce-47b3-83c5-0b32203df1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:11.502325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca38ae6-37ce-47b3-83c5-0b32203df1af None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:11.502611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca38ae6-37ce-47b3-83c5-0b32203df1af None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:11.502935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca38ae6-37ce-47b3-83c5-0b32203df1af None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:11.503782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca38ae6-37ce-47b3-83c5-0b32203df1af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:11.504120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca38ae6-37ce-47b3-83c5-0b32203df1af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:11.505901 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca38ae6-37ce-47b3-83c5-0b32203df1af None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:11.536416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 610/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Aug 19 20:57:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:11.542932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18a91a-d8f4-4dae-a941-cce89719f4ba None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:11.690847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18a91a-d8f4-4dae-a941-cce89719f4ba None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:11.749735 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b52b5f-ea77-4735-ac92-9635ef68639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:11.750718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52b5f-ea77-4735-ac92-9635ef68639f None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:11.751250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52b5f-ea77-4735-ac92-9635ef68639f None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:11.751764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52b5f-ea77-4735-ac92-9635ef68639f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:11.812961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:11.883299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b52b5f-ea77-4735-ac92-9635ef68639f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:11.886950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b52b5f-ea77-4735-ac92-9635ef68639f None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:12.029473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 604/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:57:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 20:57:12.035384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca38ae6-37ce-47b3-83c5-0b32203df1af None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:12.064470 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:12.171977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca38ae6-37ce-47b3-83c5-0b32203df1af None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:12.211746 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148107de-2e8a-4594-ae4f-dbeb4fc565a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:12.212388 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148107de-2e8a-4594-ae4f-dbeb4fc565a8 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:12.212730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148107de-2e8a-4594-ae4f-dbeb4fc565a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:12.213003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148107de-2e8a-4594-ae4f-dbeb4fc565a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:12.225316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148107de-2e8a-4594-ae4f-dbeb4fc565a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:12.227147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148107de-2e8a-4594-ae4f-dbeb4fc565a8 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-148107de-2e8a-4594-ae4f-dbeb4fc565a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:57:12.245246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:12.246400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:57:12.247422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:57:12.247422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:12.247422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:12.249269 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 611/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:57:12.260605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b52b5f-ea77-4735-ac92-9635ef68639f None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:12.344939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:12.410991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b52b5f-ea77-4735-ac92-9635ef68639f None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:12.454681 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52489f7b-0609-4c28-ae0b-f1eafab1cf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:12.455351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489f7b-0609-4c28-ae0b-f1eafab1cf50 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:12.455638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489f7b-0609-4c28-ae0b-f1eafab1cf50 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:12.456006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489f7b-0609-4c28-ae0b-f1eafab1cf50 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:12.456656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52489f7b-0609-4c28-ae0b-f1eafab1cf50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:12.457054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52489f7b-0609-4c28-ae0b-f1eafab1cf50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:12.458676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52489f7b-0609-4c28-ae0b-f1eafab1cf50 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:12.473218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 605/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:12.479124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148107de-2e8a-4594-ae4f-dbeb4fc565a8 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:12.568625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:12.610489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148107de-2e8a-4594-ae4f-dbeb4fc565a8 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:12.648719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32beeabe-354c-40ba-a276-e5b5c7a72b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:12.649591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32beeabe-354c-40ba-a276-e5b5c7a72b74 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:12.649875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32beeabe-354c-40ba-a276-e5b5c7a72b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:12.650200 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32beeabe-354c-40ba-a276-e5b5c7a72b74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:12.658852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32beeabe-354c-40ba-a276-e5b5c7a72b74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:12.660432 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32beeabe-354c-40ba-a276-e5b5c7a72b74 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-32beeabe-354c-40ba-a276-e5b5c7a72b74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:57:12.674544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:12.675690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:12.676659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:57:12.676659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:57:12.676659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:57:12.676659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:57:12.676659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:57:12.676659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:57:12.676659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:57:12.676659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:12.676659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 612/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:12.683123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52489f7b-0609-4c28-ae0b-f1eafab1cf50 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:12.815857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52489f7b-0609-4c28-ae0b-f1eafab1cf50 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:12.846181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:12.862093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759b531-ca17-45f4-953f-1c0592e7befc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:12.862729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b531-ca17-45f4-953f-1c0592e7befc None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:12.863089 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b531-ca17-45f4-953f-1c0592e7befc None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:12.863400 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b531-ca17-45f4-953f-1c0592e7befc None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:12.864455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759b531-ca17-45f4-953f-1c0592e7befc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:12.864776 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759b531-ca17-45f4-953f-1c0592e7befc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:12.866911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759b531-ca17-45f4-953f-1c0592e7befc None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:12.880324 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 606/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:12.887439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32beeabe-354c-40ba-a276-e5b5c7a72b74 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:12.997357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32beeabe-354c-40ba-a276-e5b5c7a72b74 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:13.028722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:13.034971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74222c64-2819-4907-9abf-3d105f497372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:13.035582 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74222c64-2819-4907-9abf-3d105f497372 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:13.036167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74222c64-2819-4907-9abf-3d105f497372 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:13.036167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74222c64-2819-4907-9abf-3d105f497372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:13.036840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74222c64-2819-4907-9abf-3d105f497372 None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=be0a8d40d21048afa4ce94706e3625c3) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:13.037147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74222c64-2819-4907-9abf-3d105f497372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:13.038571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74222c64-2819-4907-9abf-3d105f497372 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:13.044575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 613/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:57:12 2022] GET /identity/v3/role_assignments?user.id=be0a8d40d21048afa4ce94706e3625c3&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:15.052317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9440199-45b9-46b2-b4fa-bad340f3702d None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:15.052830 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9440199-45b9-46b2-b4fa-bad340f3702d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:15.053082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9440199-45b9-46b2-b4fa-bad340f3702d None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:15.055177 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 607/1220] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:57:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:57:15.060561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2555b-ae99-4cf9-87cb-5b025b557192 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:15.061332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2555b-ae99-4cf9-87cb-5b025b557192 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:15.061332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2555b-ae99-4cf9-87cb-5b025b557192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:15.080270 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-11b2555b-ae99-4cf9-87cb-5b025b557192 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:57:15.081467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-11b2555b-ae99-4cf9-87cb-5b025b557192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:57:15.169300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 614/1221] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:57:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:57:15.460716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9440199-45b9-46b2-b4fa-bad340f3702d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:15.584074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9440199-45b9-46b2-b4fa-bad340f3702d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:15.624274 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfda18d-c21a-4c71-8b4e-df9022023ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:15.625057 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfda18d-c21a-4c71-8b4e-df9022023ffb None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:15.625459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfda18d-c21a-4c71-8b4e-df9022023ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:15.625775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfda18d-c21a-4c71-8b4e-df9022023ffb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:15.639119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfda18d-c21a-4c71-8b4e-df9022023ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-4bfda18d-c21a-4c71-8b4e-df9022023ffb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:57:15.643893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:15.645094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:15.646120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:15.646120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:15.646120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:15.646120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:15.646120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:57:15.646120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:57:15.646120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:57:15.646120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:57:15.646120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:57:15.646120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:57:15.646120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:57:15.646120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:15.646120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 608/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:57:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:15.651654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2555b-ae99-4cf9-87cb-5b025b557192 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:15.766808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2555b-ae99-4cf9-87cb-5b025b557192 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:15.795910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:15.809198 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dd852-aa83-46ae-a230-e0ae692ca6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:15.809817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dd852-aa83-46ae-a230-e0ae692ca6dd None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:15.810128 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dd852-aa83-46ae-a230-e0ae692ca6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:15.810403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dd852-aa83-46ae-a230-e0ae692ca6dd None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:15.811110 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dd852-aa83-46ae-a230-e0ae692ca6dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:15.811416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dd852-aa83-46ae-a230-e0ae692ca6dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:15.812776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dd852-aa83-46ae-a230-e0ae692ca6dd None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:15.821455 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 615/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:57:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:15.828124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfda18d-c21a-4c71-8b4e-df9022023ffb None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:15.879539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:15.943702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfda18d-c21a-4c71-8b4e-df9022023ffb None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:15.982051 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0393c7-7609-4cdd-9306-f70f5ab52271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:15.982860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0393c7-7609-4cdd-9306-f70f5ab52271 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:15.983146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0393c7-7609-4cdd-9306-f70f5ab52271 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:15.983426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0393c7-7609-4cdd-9306-f70f5ab52271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:15.995392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0393c7-7609-4cdd-9306-f70f5ab52271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:15.997019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0393c7-7609-4cdd-9306-f70f5ab52271 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-cb0393c7-7609-4cdd-9306-f70f5ab52271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:57:16.014888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:16.016152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:57:16.017221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:57:16.017221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:16.017221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:16.017221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 609/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:57:16.022666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dd852-aa83-46ae-a230-e0ae692ca6dd None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:16.152035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dd852-aa83-46ae-a230-e0ae692ca6dd None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:16.194308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1661b-c9b3-481d-a1ef-90f352b8664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:16.194986 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1661b-c9b3-481d-a1ef-90f352b8664e None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:16.195300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1661b-c9b3-481d-a1ef-90f352b8664e None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:16.195599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1661b-c9b3-481d-a1ef-90f352b8664e None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:16.196374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1661b-c9b3-481d-a1ef-90f352b8664e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:16.196744 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1661b-c9b3-481d-a1ef-90f352b8664e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:16.198823 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1661b-c9b3-481d-a1ef-90f352b8664e None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:16.212527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 616/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:57:16.219158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0393c7-7609-4cdd-9306-f70f5ab52271 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:16.326631 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:16.335145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0393c7-7609-4cdd-9306-f70f5ab52271 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:16.372592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b02eaa-a137-4e47-a52d-16c4236cadad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:16.373243 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b02eaa-a137-4e47-a52d-16c4236cadad None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:16.373551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b02eaa-a137-4e47-a52d-16c4236cadad None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:16.373807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b02eaa-a137-4e47-a52d-16c4236cadad None admin] PATH_INFO: `/v3/users/placement` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:16.382048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b02eaa-a137-4e47-a52d-16c4236cadad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:16.383547 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b02eaa-a137-4e47-a52d-16c4236cadad None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-a0b02eaa-a137-4e47-a52d-16c4236cadad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:57:16.396193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:16.397588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:16.398831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:16.398831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:16.398831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:57:16.398831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:57:16.398831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:57:16.398831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:57:16.398831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:57:16.398831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:57:16.398831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 20:57:16.398831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:16.398831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 610/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:16.404734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1661b-c9b3-481d-a1ef-90f352b8664e None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:16.460584 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:16.539545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1661b-c9b3-481d-a1ef-90f352b8664e None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:16.591028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa8a61-8251-4571-baf9-d5421f8bd3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:16.591562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa8a61-8251-4571-baf9-d5421f8bd3ab None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:16.591829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa8a61-8251-4571-baf9-d5421f8bd3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:16.592104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa8a61-8251-4571-baf9-d5421f8bd3ab None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:16.592854 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa8a61-8251-4571-baf9-d5421f8bd3ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:16.593162 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa8a61-8251-4571-baf9-d5421f8bd3ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:16.594584 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa8a61-8251-4571-baf9-d5421f8bd3ab None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:16.620431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 617/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Aug 19 20:57:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:57:16.628640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b02eaa-a137-4e47-a52d-16c4236cadad None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:16.751201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b02eaa-a137-4e47-a52d-16c4236cadad None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:16.790006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8928-3c49-4b58-b303-ebe0b85d5cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:16.790692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8928-3c49-4b58-b303-ebe0b85d5cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:16.791073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8928-3c49-4b58-b303-ebe0b85d5cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:16.791360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8928-3c49-4b58-b303-ebe0b85d5cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:16.802966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d8928-3c49-4b58-b303-ebe0b85d5cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:16.804524 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d8928-3c49-4b58-b303-ebe0b85d5cf6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-659d8928-3c49-4b58-b303-ebe0b85d5cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:57:16.821352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:16.823050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:57:16.824235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:57:16.824235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:16.824235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:16.824235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 611/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:16.831826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa8a61-8251-4571-baf9-d5421f8bd3ab None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:16.948192 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa8a61-8251-4571-baf9-d5421f8bd3ab None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:16.950717 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:16.983618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac5439-df46-4ce0-b24c-1877d3bc8c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:16.984230 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac5439-df46-4ce0-b24c-1877d3bc8c58 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:16.984513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac5439-df46-4ce0-b24c-1877d3bc8c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:16.984787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac5439-df46-4ce0-b24c-1877d3bc8c58 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:16.985435 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac5439-df46-4ce0-b24c-1877d3bc8c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:16.985739 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac5439-df46-4ce0-b24c-1877d3bc8c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:16.987138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac5439-df46-4ce0-b24c-1877d3bc8c58 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:17.001810 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 618/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:17.008442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8928-3c49-4b58-b303-ebe0b85d5cf6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:17.018993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:17.126288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8928-3c49-4b58-b303-ebe0b85d5cf6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:17.167271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646004f9-69e8-47a8-90c2-f8f0dfba1ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:17.167983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646004f9-69e8-47a8-90c2-f8f0dfba1ffd None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:17.168360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646004f9-69e8-47a8-90c2-f8f0dfba1ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:17.168617 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646004f9-69e8-47a8-90c2-f8f0dfba1ffd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:17.177045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646004f9-69e8-47a8-90c2-f8f0dfba1ffd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:17.178692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646004f9-69e8-47a8-90c2-f8f0dfba1ffd None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-646004f9-69e8-47a8-90c2-f8f0dfba1ffd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:57:17.192505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:17.193719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:17.194714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:57:17.194714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:57:17.194714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:57:17.194714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:57:17.194714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:57:17.194714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:57:17.194714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:57:17.194714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:17.194714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 612/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:57:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:17.201372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac5439-df46-4ce0-b24c-1877d3bc8c58 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:17.316012 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac5439-df46-4ce0-b24c-1877d3bc8c58 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:17.355666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c5e9c-cbd0-4c60-987c-d7bc593a56ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:17.356407 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c5e9c-cbd0-4c60-987c-d7bc593a56ce None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:17.356691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c5e9c-cbd0-4c60-987c-d7bc593a56ce None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:17.356963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c5e9c-cbd0-4c60-987c-d7bc593a56ce None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:17.357662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c5e9c-cbd0-4c60-987c-d7bc593a56ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:17.357971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c5e9c-cbd0-4c60-987c-d7bc593a56ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:17.359428 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c5e9c-cbd0-4c60-987c-d7bc593a56ce None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:17.372408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 619/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:57:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:17.378693 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646004f9-69e8-47a8-90c2-f8f0dfba1ffd None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:17.452083 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:17.491851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646004f9-69e8-47a8-90c2-f8f0dfba1ffd None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:17.530925 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce2f99-0df4-43fb-bbce-de62b3bd59ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:17.531613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2f99-0df4-43fb-bbce-de62b3bd59ab None admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:17.531930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2f99-0df4-43fb-bbce-de62b3bd59ab None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:17.532213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2f99-0df4-43fb-bbce-de62b3bd59ab None admin] PATH_INFO: `/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/be0a8d40d21048afa4ce94706e3625c3/roles/7ba43d9ef6cf4709ae99d7e4c68ce879` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:17.549525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce2f99-0df4-43fb-bbce-de62b3bd59ab None admin] RBAC: Authorizing `identity:create_grant(project_id=d1defe14eddd4b28ac969adb3d504c7a, user_id=be0a8d40d21048afa4ce94706e3625c3, role_id=7ba43d9ef6cf4709ae99d7e4c68ce879)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:17.551286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce2f99-0df4-43fb-bbce-de62b3bd59ab None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:17.566254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 613/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:57:17 2022] PUT /identity/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/be0a8d40d21048afa4ce94706e3625c3/roles/7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 20:57:19.604509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb9f7-39d1-49de-8a7c-45d007c634cd None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:19.605374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb9f7-39d1-49de-8a7c-45d007c634cd None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:19.605374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb9f7-39d1-49de-8a7c-45d007c634cd None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:19.606461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 620/1233] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:57:19.613448 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b95d5b-f7f9-4bd5-a1da-7f14f3cb5bad None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:19.614017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b95d5b-f7f9-4bd5-a1da-7f14f3cb5bad None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:19.614183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b95d5b-f7f9-4bd5-a1da-7f14f3cb5bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:19.636074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-60b95d5b-f7f9-4bd5-a1da-7f14f3cb5bad None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:57:19.637542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-60b95d5b-f7f9-4bd5-a1da-7f14f3cb5bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:57:19.727083 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 614/1234] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:57:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:57:20.044232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfb9f7-39d1-49de-8a7c-45d007c634cd None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:20.076605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:20.188598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfb9f7-39d1-49de-8a7c-45d007c634cd None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:20.230381 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f984e44-cf94-4a30-9258-589369e8b6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:20.231083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f984e44-cf94-4a30-9258-589369e8b6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:20.231348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f984e44-cf94-4a30-9258-589369e8b6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:20.231627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f984e44-cf94-4a30-9258-589369e8b6b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:20.242957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f984e44-cf94-4a30-9258-589369e8b6b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-2f984e44-cf94-4a30-9258-589369e8b6b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:57:20.247898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:20.248999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:20.249898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:20.249898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:20.249898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:20.249898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:20.249898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:57:20.249898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:57:20.249898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:57:20.249898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:57:20.249898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:57:20.249898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:57:20.249898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 20:57:20.249898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:20.254299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 621/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Aug 19 20:57:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:57:20.255411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b95d5b-f7f9-4bd5-a1da-7f14f3cb5bad None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:20.319270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:20.404899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b95d5b-f7f9-4bd5-a1da-7f14f3cb5bad None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:20.454138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d754b3-86b9-42a5-9ced-55ab12536fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:20.454867 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d754b3-86b9-42a5-9ced-55ab12536fea None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:20.455244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d754b3-86b9-42a5-9ced-55ab12536fea None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:20.455619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d754b3-86b9-42a5-9ced-55ab12536fea None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:20.456574 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d754b3-86b9-42a5-9ced-55ab12536fea None admin] RBAC: Adding query filter params (name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:20.457022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d754b3-86b9-42a5-9ced-55ab12536fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:20.458820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d754b3-86b9-42a5-9ced-55ab12536fea None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:20.474833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 615/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Aug 19 20:57:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:20.483124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f984e44-cf94-4a30-9258-589369e8b6b5 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:20.605741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:20.635163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f984e44-cf94-4a30-9258-589369e8b6b5 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:20.686023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99d71f-c076-4279-b36c-c3391677cf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:20.686775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99d71f-c076-4279-b36c-c3391677cf16 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:20.687168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99d71f-c076-4279-b36c-c3391677cf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:20.687445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99d71f-c076-4279-b36c-c3391677cf16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:20.700426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99d71f-c076-4279-b36c-c3391677cf16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:20.704178 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99d71f-c076-4279-b36c-c3391677cf16 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-ff99d71f-c076-4279-b36c-c3391677cf16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:57:20.724413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:20.725594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:57:20.726538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:57:20.726538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:20.726538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:20.726538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 622/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:20.733827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d754b3-86b9-42a5-9ced-55ab12536fea None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:20.860877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d754b3-86b9-42a5-9ced-55ab12536fea None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:20.872719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:20.905764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04c1b6-f5e7-4225-aca4-eb9972ad4968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:20.906528 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04c1b6-f5e7-4225-aca4-eb9972ad4968 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:20.906869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04c1b6-f5e7-4225-aca4-eb9972ad4968 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:20.907258 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04c1b6-f5e7-4225-aca4-eb9972ad4968 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:20.907999 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04c1b6-f5e7-4225-aca4-eb9972ad4968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:20.908554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04c1b6-f5e7-4225-aca4-eb9972ad4968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:20.910328 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04c1b6-f5e7-4225-aca4-eb9972ad4968 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:20.930647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 616/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:20.932757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99d71f-c076-4279-b36c-c3391677cf16 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:21.065228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99d71f-c076-4279-b36c-c3391677cf16 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:21.107824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639092bb-e3fb-4332-959d-9945c84c270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:21.108568 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639092bb-e3fb-4332-959d-9945c84c270a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:21.108855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639092bb-e3fb-4332-959d-9945c84c270a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:21.109197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639092bb-e3fb-4332-959d-9945c84c270a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:21.118391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:21.120910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639092bb-e3fb-4332-959d-9945c84c270a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:21.122781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639092bb-e3fb-4332-959d-9945c84c270a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-639092bb-e3fb-4332-959d-9945c84c270a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:57:21.146662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:21.148029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:21.155303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:21.155303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:21.155303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:57:21.155303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:57:21.155303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:57:21.155303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:57:21.155303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:57:21.155303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:57:21.155303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 20:57:21.155303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:21.155303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 623/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:57:21.159708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04c1b6-f5e7-4225-aca4-eb9972ad4968 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:21.287393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04c1b6-f5e7-4225-aca4-eb9972ad4968 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:21.329233 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4464-b701-4442-a6d8-c67989e274f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:21.330002 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4464-b701-4442-a6d8-c67989e274f7 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:21.330318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4464-b701-4442-a6d8-c67989e274f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:21.330648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4464-b701-4442-a6d8-c67989e274f7 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:21.331544 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4464-b701-4442-a6d8-c67989e274f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:21.331871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4464-b701-4442-a6d8-c67989e274f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:21.333527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4464-b701-4442-a6d8-c67989e274f7 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:21.355740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 617/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Aug 19 20:57:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:21.362457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639092bb-e3fb-4332-959d-9945c84c270a None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:21.499932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639092bb-e3fb-4332-959d-9945c84c270a None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:21.544424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ce3d4-2efe-4308-805f-f41bb41fe335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:21.545085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ce3d4-2efe-4308-805f-f41bb41fe335 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:21.545371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ce3d4-2efe-4308-805f-f41bb41fe335 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:21.545653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ce3d4-2efe-4308-805f-f41bb41fe335 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:21.626916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:21.634144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ce3d4-2efe-4308-805f-f41bb41fe335 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:21.636424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ce3d4-2efe-4308-805f-f41bb41fe335 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:21.769447 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 624/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:57:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:57:21.776049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4464-b701-4442-a6d8-c67989e274f7 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:21.812064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:21.903002 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4464-b701-4442-a6d8-c67989e274f7 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:21.951665 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14caffc-6a70-4fbc-844a-237995f09763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:21.952701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14caffc-6a70-4fbc-844a-237995f09763 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:21.953072 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14caffc-6a70-4fbc-844a-237995f09763 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:21.953455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14caffc-6a70-4fbc-844a-237995f09763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:21.968035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14caffc-6a70-4fbc-844a-237995f09763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:21.970099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14caffc-6a70-4fbc-844a-237995f09763 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-e14caffc-6a70-4fbc-844a-237995f09763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:57:21.991564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:21.992931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:57:21.994579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:57:21.994579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:21.994579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:21.994579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 618/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:22.001974 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ce3d4-2efe-4308-805f-f41bb41fe335 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:22.124785 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:22.139831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ce3d4-2efe-4308-805f-f41bb41fe335 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:22.205398 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327ea71-b0b4-4536-8d45-4c6b221071ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:22.206033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327ea71-b0b4-4536-8d45-4c6b221071ba None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:22.206354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327ea71-b0b4-4536-8d45-4c6b221071ba None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:22.206598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327ea71-b0b4-4536-8d45-4c6b221071ba None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:22.207290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327ea71-b0b4-4536-8d45-4c6b221071ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:22.207691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327ea71-b0b4-4536-8d45-4c6b221071ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:22.209827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327ea71-b0b4-4536-8d45-4c6b221071ba None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:22.224949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 625/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:22.232438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14caffc-6a70-4fbc-844a-237995f09763 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:22.325238 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:22.358709 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14caffc-6a70-4fbc-844a-237995f09763 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:22.411318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c55bf-6cb4-4f64-971f-f2b5acad4108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:22.412232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c55bf-6cb4-4f64-971f-f2b5acad4108 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:22.412645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c55bf-6cb4-4f64-971f-f2b5acad4108 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:22.412989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c55bf-6cb4-4f64-971f-f2b5acad4108 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:22.423668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c55bf-6cb4-4f64-971f-f2b5acad4108 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:22.425908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c55bf-6cb4-4f64-971f-f2b5acad4108 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-0c7c55bf-6cb4-4f64-971f-f2b5acad4108 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:57:22.443486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:22.444727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:22.445683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:57:22.445683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:57:22.445683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:57:22.445683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:57:22.445683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:57:22.445683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:57:22.445683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:57:22.445683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:22.445683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 619/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:57:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:22.452142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327ea71-b0b4-4536-8d45-4c6b221071ba None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:22.572955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327ea71-b0b4-4536-8d45-4c6b221071ba None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:22.611098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82db196-6f78-4f2d-9c3f-26259b98f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:22.611748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82db196-6f78-4f2d-9c3f-26259b98f4be None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:22.612003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82db196-6f78-4f2d-9c3f-26259b98f4be None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:22.612278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82db196-6f78-4f2d-9c3f-26259b98f4be None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:22.612980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82db196-6f78-4f2d-9c3f-26259b98f4be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:22.613293 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82db196-6f78-4f2d-9c3f-26259b98f4be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:22.614708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82db196-6f78-4f2d-9c3f-26259b98f4be None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:22.628966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 626/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:57:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:57:22.636712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c55bf-6cb4-4f64-971f-f2b5acad4108 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:22.760964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c55bf-6cb4-4f64-971f-f2b5acad4108 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:22.797777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2b20-d9c9-45a4-b10f-ca67de8d6f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:22.798458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2b20-d9c9-45a4-b10f-ca67de8d6f97 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:22.798665 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2b20-d9c9-45a4-b10f-ca67de8d6f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:22.798968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2b20-d9c9-45a4-b10f-ca67de8d6f97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:22.799705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2b20-d9c9-45a4-b10f-ca67de8d6f97 None admin] RBAC: Adding query filter params (role.id=7ba43d9ef6cf4709ae99d7e4c68ce879, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=be0a8d40d21048afa4ce94706e3625c3) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:22.800048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2b20-d9c9-45a4-b10f-ca67de8d6f97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:22.801451 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2b20-d9c9-45a4-b10f-ca67de8d6f97 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:22.808602 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 620/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:57:22 2022] GET /identity/v3/role_assignments?user.id=be0a8d40d21048afa4ce94706e3625c3&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=7ba43d9ef6cf4709ae99d7e4c68ce879 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:24.883458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaa594-34f7-4ae7-ae49-67f3f16f3af1 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:24.884085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaa594-34f7-4ae7-ae49-67f3f16f3af1 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:24.884085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaa594-34f7-4ae7-ae49-67f3f16f3af1 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:24.886286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 627/1247] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:57:24.892489 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e4e3c-7374-40fa-87b1-f5586aae7f67 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:24.893115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e4e3c-7374-40fa-87b1-f5586aae7f67 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:24.893115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e4e3c-7374-40fa-87b1-f5586aae7f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:24.899984 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:24.913765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-657e4e3c-7374-40fa-87b1-f5586aae7f67 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:57:24.917435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-657e4e3c-7374-40fa-87b1-f5586aae7f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:57:25.008874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 621/1248] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:57:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:57:25.324987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceaa594-34f7-4ae7-ae49-67f3f16f3af1 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:25.346139 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:25.448301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceaa594-34f7-4ae7-ae49-67f3f16f3af1 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:25.488735 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53d6b0-023d-43bb-965f-8b27f56b3c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:25.489358 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53d6b0-023d-43bb-965f-8b27f56b3c6a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:25.489635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53d6b0-023d-43bb-965f-8b27f56b3c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:25.489953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53d6b0-023d-43bb-965f-8b27f56b3c6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:25.502781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53d6b0-023d-43bb-965f-8b27f56b3c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-2c53d6b0-023d-43bb-965f-8b27f56b3c6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:57:25.508341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:25.511681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:25.513935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:25.513935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:25.513935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:25.513935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:25.513935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:57:25.513935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:57:25.513935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:57:25.513935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:57:25.513935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:57:25.513935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:57:25.513935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:57:25.513935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:25.513935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 628/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:57:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:25.517030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e4e3c-7374-40fa-87b1-f5586aae7f67 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:25.657253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e4e3c-7374-40fa-87b1-f5586aae7f67 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:25.695643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:25.702347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c90023-9a65-4c92-be79-cc4be17903e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:25.703030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c90023-9a65-4c92-be79-cc4be17903e3 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:25.703286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c90023-9a65-4c92-be79-cc4be17903e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:25.703577 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c90023-9a65-4c92-be79-cc4be17903e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:25.704347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c90023-9a65-4c92-be79-cc4be17903e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:25.704704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c90023-9a65-4c92-be79-cc4be17903e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:25.706210 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c90023-9a65-4c92-be79-cc4be17903e3 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:25.721213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 622/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:57:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:57:25.728051 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53d6b0-023d-43bb-965f-8b27f56b3c6a None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:25.835799 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:25.876901 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53d6b0-023d-43bb-965f-8b27f56b3c6a None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:25.928978 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bb2ed-3220-40ea-96f7-7de02e21b373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:25.929657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bb2ed-3220-40ea-96f7-7de02e21b373 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:25.929755 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bb2ed-3220-40ea-96f7-7de02e21b373 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:25.930013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bb2ed-3220-40ea-96f7-7de02e21b373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:25.942555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bb2ed-3220-40ea-96f7-7de02e21b373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:25.944177 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bb2ed-3220-40ea-96f7-7de02e21b373 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-a28bb2ed-3220-40ea-96f7-7de02e21b373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:57:25.961307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:25.963454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:57:25.964912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:57:25.964912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:25.964912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:25.964912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 629/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:25.969382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c90023-9a65-4c92-be79-cc4be17903e3 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:26.115163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c90023-9a65-4c92-be79-cc4be17903e3 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:26.170940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb92f1-2de9-43f8-b30c-411c7ea62787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:26.171612 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb92f1-2de9-43f8-b30c-411c7ea62787 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:26.171917 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb92f1-2de9-43f8-b30c-411c7ea62787 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:26.172169 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb92f1-2de9-43f8-b30c-411c7ea62787 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:26.172820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb92f1-2de9-43f8-b30c-411c7ea62787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:26.173181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb92f1-2de9-43f8-b30c-411c7ea62787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:26.174706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb92f1-2de9-43f8-b30c-411c7ea62787 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:26.190919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 623/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:26.197210 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bb2ed-3220-40ea-96f7-7de02e21b373 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:26.326796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bb2ed-3220-40ea-96f7-7de02e21b373 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:26.363687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:26.376609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2f18d-3022-4a6f-aed0-0d68bf0d9a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:26.377393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2f18d-3022-4a6f-aed0-0d68bf0d9a8a None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:26.377687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2f18d-3022-4a6f-aed0-0d68bf0d9a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:26.377952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2f18d-3022-4a6f-aed0-0d68bf0d9a8a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:26.388518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2f18d-3022-4a6f-aed0-0d68bf0d9a8a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:26.390097 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2f18d-3022-4a6f-aed0-0d68bf0d9a8a None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-01b2f18d-3022-4a6f-aed0-0d68bf0d9a8a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:57:26.403260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:26.404520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:26.405787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:26.405787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:26.405787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:57:26.405787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:57:26.405787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:57:26.405787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:57:26.405787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:57:26.405787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:57:26.405787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 20:57:26.405787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:26.409556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 630/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:57:26.410816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb92f1-2de9-43f8-b30c-411c7ea62787 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:26.481699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:26.534916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb92f1-2de9-43f8-b30c-411c7ea62787 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:26.578805 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fb152-5e5e-496a-bebf-d7613798a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:26.579502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fb152-5e5e-496a-bebf-d7613798a184 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:26.579807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fb152-5e5e-496a-bebf-d7613798a184 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:26.580121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fb152-5e5e-496a-bebf-d7613798a184 None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:26.580926 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fb152-5e5e-496a-bebf-d7613798a184 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:26.581237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fb152-5e5e-496a-bebf-d7613798a184 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:26.583016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fb152-5e5e-496a-bebf-d7613798a184 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:26.602936 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 624/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Aug 19 20:57:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:26.610042 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2f18d-3022-4a6f-aed0-0d68bf0d9a8a None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:26.754688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2f18d-3022-4a6f-aed0-0d68bf0d9a8a None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:26.801160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab54d66-34f3-4041-a3bf-918bee6a814b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:26.801809 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54d66-34f3-4041-a3bf-918bee6a814b None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:26.802104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54d66-34f3-4041-a3bf-918bee6a814b None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:26.802420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54d66-34f3-4041-a3bf-918bee6a814b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:26.876973 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:26.894565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab54d66-34f3-4041-a3bf-918bee6a814b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:26.896292 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab54d66-34f3-4041-a3bf-918bee6a814b None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:27.028533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 631/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:57:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 20:57:27.034925 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fb152-5e5e-496a-bebf-d7613798a184 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:27.160844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fb152-5e5e-496a-bebf-d7613798a184 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:27.177793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:27.204038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbadb2-6795-4af2-ba4b-0216c91ec35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:27.204681 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbadb2-6795-4af2-ba4b-0216c91ec35e None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:27.204965 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbadb2-6795-4af2-ba4b-0216c91ec35e None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:27.205299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbadb2-6795-4af2-ba4b-0216c91ec35e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:27.217088 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbadb2-6795-4af2-ba4b-0216c91ec35e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:27.218652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbadb2-6795-4af2-ba4b-0216c91ec35e None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-84cbadb2-6795-4af2-ba4b-0216c91ec35e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:57:27.248227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:27.249481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:57:27.250604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:57:27.250604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:27.250604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:27.250874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 625/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:57:27.256734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab54d66-34f3-4041-a3bf-918bee6a814b None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:27.365402 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:27.383865 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab54d66-34f3-4041-a3bf-918bee6a814b None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:27.430846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b2a9b-5a59-4e70-b05f-9792fdea8f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:27.432132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b2a9b-5a59-4e70-b05f-9792fdea8f26 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:27.432578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b2a9b-5a59-4e70-b05f-9792fdea8f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:27.432911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b2a9b-5a59-4e70-b05f-9792fdea8f26 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:27.433686 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b2a9b-5a59-4e70-b05f-9792fdea8f26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:27.434112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b2a9b-5a59-4e70-b05f-9792fdea8f26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:27.435968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b2a9b-5a59-4e70-b05f-9792fdea8f26 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:27.453465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 632/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:57:27.461560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbadb2-6795-4af2-ba4b-0216c91ec35e None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:27.596426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbadb2-6795-4af2-ba4b-0216c91ec35e None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:27.641688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce47666-4ebb-4cd4-bbe4-7155f9cfce61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:27.642356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce47666-4ebb-4cd4-bbe4-7155f9cfce61 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:27.642645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce47666-4ebb-4cd4-bbe4-7155f9cfce61 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:27.642961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce47666-4ebb-4cd4-bbe4-7155f9cfce61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:27.651413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce47666-4ebb-4cd4-bbe4-7155f9cfce61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:27.652862 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce47666-4ebb-4cd4-bbe4-7155f9cfce61 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-1ce47666-4ebb-4cd4-bbe4-7155f9cfce61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:57:27.668239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:27.669514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:27.670716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:57:27.670716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:57:27.670716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:57:27.670716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:57:27.670716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:57:27.670716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:57:27.670716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:57:27.670716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:27.670716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 626/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:57:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:27.676596 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b2a9b-5a59-4e70-b05f-9792fdea8f26 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:27.797427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b2a9b-5a59-4e70-b05f-9792fdea8f26 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:27.834754 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544a916-0b60-44f3-9d6a-587774640563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:27.835398 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544a916-0b60-44f3-9d6a-587774640563 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:27.835683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544a916-0b60-44f3-9d6a-587774640563 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:27.835998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544a916-0b60-44f3-9d6a-587774640563 None admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:27.836713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544a916-0b60-44f3-9d6a-587774640563 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:27.836969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544a916-0b60-44f3-9d6a-587774640563 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:27.838501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544a916-0b60-44f3-9d6a-587774640563 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:27.853581 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 633/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:57:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:27.860593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce47666-4ebb-4cd4-bbe4-7155f9cfce61 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:27.893335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:27.979353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce47666-4ebb-4cd4-bbe4-7155f9cfce61 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:28.019520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ca72a-78b4-42f0-a02f-4d809b8a0f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:28.020203 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ca72a-78b4-42f0-a02f-4d809b8a0f7b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:28.020610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ca72a-78b4-42f0-a02f-4d809b8a0f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:28.020946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ca72a-78b4-42f0-a02f-4d809b8a0f7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:28.021675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ca72a-78b4-42f0-a02f-4d809b8a0f7b None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=be0a8d40d21048afa4ce94706e3625c3) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:28.022101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ca72a-78b4-42f0-a02f-4d809b8a0f7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:28.023789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ca72a-78b4-42f0-a02f-4d809b8a0f7b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:28.030002 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 627/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:57:27 2022] GET /identity/v3/role_assignments?user.id=be0a8d40d21048afa4ce94706e3625c3&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:29.965190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c118f-c283-41b0-af76-aa486d01e684 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:29.965743 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c118f-c283-41b0-af76-aa486d01e684 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:29.965743 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c118f-c283-41b0-af76-aa486d01e684 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:29.967115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 634/1261] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:57:29.972176 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448dca-3aed-4ac5-a5b6-5cafd13447ff None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:29.972560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448dca-3aed-4ac5-a5b6-5cafd13447ff None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:29.972729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448dca-3aed-4ac5-a5b6-5cafd13447ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:29.990814 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4f448dca-3aed-4ac5-a5b6-5cafd13447ff None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:57:29.992021 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4f448dca-3aed-4ac5-a5b6-5cafd13447ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:57:30.065241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 628/1262] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:57:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 20:57:30.336109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c118f-c283-41b0-af76-aa486d01e684 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:30.347147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:30.437409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c118f-c283-41b0-af76-aa486d01e684 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:30.470234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bae88-7a1b-487b-91ba-e4b7e4ed8dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:30.470888 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bae88-7a1b-487b-91ba-e4b7e4ed8dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:30.471173 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bae88-7a1b-487b-91ba-e4b7e4ed8dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:30.471452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bae88-7a1b-487b-91ba-e4b7e4ed8dd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:30.481883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bae88-7a1b-487b-91ba-e4b7e4ed8dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-da3bae88-7a1b-487b-91ba-e4b7e4ed8dd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:57:30.486559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:30.487776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:30.488639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:30.488639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:30.488639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:30.488639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:30.488639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:57:30.488639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:57:30.488639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:57:30.488639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:57:30.488639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:57:30.488639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:57:30.488639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:57:30.488639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:30.488639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 635/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:57:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:30.493745 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f448dca-3aed-4ac5-a5b6-5cafd13447ff None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:30.512902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:30.593152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f448dca-3aed-4ac5-a5b6-5cafd13447ff None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:30.626477 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84667ccf-c2bc-47a7-bd10-8f96df51a1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:30.627111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667ccf-c2bc-47a7-bd10-8f96df51a1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:30.627398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667ccf-c2bc-47a7-bd10-8f96df51a1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:30.627672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667ccf-c2bc-47a7-bd10-8f96df51a1f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:30.628339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84667ccf-c2bc-47a7-bd10-8f96df51a1f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:30.628644 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84667ccf-c2bc-47a7-bd10-8f96df51a1f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:30.630007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84667ccf-c2bc-47a7-bd10-8f96df51a1f6 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:30.639006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 629/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:57:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:30.644729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bae88-7a1b-487b-91ba-e4b7e4ed8dd6 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:30.715725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:30.752100 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bae88-7a1b-487b-91ba-e4b7e4ed8dd6 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:30.790347 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198a78b-918a-45f4-a60e-c46069836cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:30.791565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198a78b-918a-45f4-a60e-c46069836cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:30.791851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198a78b-918a-45f4-a60e-c46069836cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:30.792290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198a78b-918a-45f4-a60e-c46069836cd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:30.803527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198a78b-918a-45f4-a60e-c46069836cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:30.805008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198a78b-918a-45f4-a60e-c46069836cd4 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-c198a78b-918a-45f4-a60e-c46069836cd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:57:30.820933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:30.822147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:57:30.823945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:57:30.823945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:30.823945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:30.823945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 636/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:30.828988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84667ccf-c2bc-47a7-bd10-8f96df51a1f6 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:30.924840 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:30.945693 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84667ccf-c2bc-47a7-bd10-8f96df51a1f6 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:30.980976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c6166-28fe-40d9-9670-11fc4168cb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:30.981639 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c6166-28fe-40d9-9670-11fc4168cb06 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:30.981859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c6166-28fe-40d9-9670-11fc4168cb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:30.982137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c6166-28fe-40d9-9670-11fc4168cb06 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:30.982807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c6166-28fe-40d9-9670-11fc4168cb06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:30.983118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c6166-28fe-40d9-9670-11fc4168cb06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:30.984490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c6166-28fe-40d9-9670-11fc4168cb06 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:30.996822 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 630/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:31.002592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198a78b-918a-45f4-a60e-c46069836cd4 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:31.101130 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198a78b-918a-45f4-a60e-c46069836cd4 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:31.123635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:31.140236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab01ec-ec81-40a1-a15d-cc8cc6acc5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:31.140877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab01ec-ec81-40a1-a15d-cc8cc6acc5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:31.141156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab01ec-ec81-40a1-a15d-cc8cc6acc5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:31.141476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab01ec-ec81-40a1-a15d-cc8cc6acc5b6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:31.149263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab01ec-ec81-40a1-a15d-cc8cc6acc5b6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:31.150818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab01ec-ec81-40a1-a15d-cc8cc6acc5b6 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-74ab01ec-ec81-40a1-a15d-cc8cc6acc5b6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:57:31.161659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:31.162707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:31.164079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:31.164079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:31.164079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:57:31.164079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:57:31.164079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:57:31.164079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:57:31.164079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:57:31.164079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:57:31.164079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 20:57:31.164079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:31.164079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 637/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:31.169289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c6166-28fe-40d9-9670-11fc4168cb06 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:31.271838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c6166-28fe-40d9-9670-11fc4168cb06 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:31.305921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b2887-5535-4608-8c7c-7b6e11194ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:31.306560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2887-5535-4608-8c7c-7b6e11194ada None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:31.306875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2887-5535-4608-8c7c-7b6e11194ada None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:31.307158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2887-5535-4608-8c7c-7b6e11194ada None admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:31.307893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b2887-5535-4608-8c7c-7b6e11194ada None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:31.308202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b2887-5535-4608-8c7c-7b6e11194ada None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:31.309645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b2887-5535-4608-8c7c-7b6e11194ada None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:31.318323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:31.328587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 631/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Aug 19 20:57:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:31.334575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab01ec-ec81-40a1-a15d-cc8cc6acc5b6 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:31.435435 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab01ec-ec81-40a1-a15d-cc8cc6acc5b6 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:31.468676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe1508-7790-40b6-8679-8891fe78d858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:31.469306 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1508-7790-40b6-8679-8891fe78d858 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:31.469592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1508-7790-40b6-8679-8891fe78d858 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:31.469867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1508-7790-40b6-8679-8891fe78d858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:31.481310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe1508-7790-40b6-8679-8891fe78d858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:31.482897 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe1508-7790-40b6-8679-8891fe78d858 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-21fe1508-7790-40b6-8679-8891fe78d858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:57:31.496836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:31.497956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:57:31.499102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:57:31.499102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:31.499102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:31.499102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 638/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:57:31.504019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b2887-5535-4608-8c7c-7b6e11194ada None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:31.606175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b2887-5535-4608-8c7c-7b6e11194ada None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:31.641537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785e4b0-2146-4cac-98e9-11fb3280eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:31.642150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785e4b0-2146-4cac-98e9-11fb3280eb8b None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:31.642430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785e4b0-2146-4cac-98e9-11fb3280eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:31.642702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785e4b0-2146-4cac-98e9-11fb3280eb8b None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:31.643376 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785e4b0-2146-4cac-98e9-11fb3280eb8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:31.643684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785e4b0-2146-4cac-98e9-11fb3280eb8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:31.645041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785e4b0-2146-4cac-98e9-11fb3280eb8b None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:31.656970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 632/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:31.662676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe1508-7790-40b6-8679-8891fe78d858 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:31.694219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:31.763928 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe1508-7790-40b6-8679-8891fe78d858 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:31.799742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aefbf3-8471-479b-b913-6beb5fd672f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:31.800374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aefbf3-8471-479b-b913-6beb5fd672f5 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:31.800657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aefbf3-8471-479b-b913-6beb5fd672f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:31.800935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aefbf3-8471-479b-b913-6beb5fd672f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:31.808288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aefbf3-8471-479b-b913-6beb5fd672f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:31.809721 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aefbf3-8471-479b-b913-6beb5fd672f5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-25aefbf3-8471-479b-b913-6beb5fd672f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:57:31.820670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:31.821813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:31.822775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:57:31.822775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:57:31.822775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:57:31.822775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:57:31.822775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:57:31.822775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:57:31.822775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:57:31.822775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:31.822775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 639/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:57:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:31.828034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785e4b0-2146-4cac-98e9-11fb3280eb8b None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:31.892991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:31.936511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785e4b0-2146-4cac-98e9-11fb3280eb8b None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:31.970571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe2353-9adf-457a-afa7-79e8a21c6b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:31.971205 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe2353-9adf-457a-afa7-79e8a21c6b1a None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:31.971484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe2353-9adf-457a-afa7-79e8a21c6b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:31.971757 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe2353-9adf-457a-afa7-79e8a21c6b1a None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:31.972440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe2353-9adf-457a-afa7-79e8a21c6b1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:31.972743 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe2353-9adf-457a-afa7-79e8a21c6b1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:31.974150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe2353-9adf-457a-afa7-79e8a21c6b1a None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:31.986636 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 633/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:57:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:31.992688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aefbf3-8471-479b-b913-6beb5fd672f5 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:32.083841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:32.093249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aefbf3-8471-479b-b913-6beb5fd672f5 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:32.129298 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb885-16e3-4cc0-83fb-ee71fed999a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:32.130023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb885-16e3-4cc0-83fb-ee71fed999a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:32.130413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb885-16e3-4cc0-83fb-ee71fed999a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:32.130583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb885-16e3-4cc0-83fb-ee71fed999a5 None admin] PATH_INFO: `/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/be0a8d40d21048afa4ce94706e3625c3/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:32.132539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb885-16e3-4cc0-83fb-ee71fed999a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1defe14eddd4b28ac969adb3d504c7a, user_id=be0a8d40d21048afa4ce94706e3625c3, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:32.133954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb885-16e3-4cc0-83fb-ee71fed999a5 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:32.148492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 640/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Aug 19 20:57:31 2022] PUT /identity/v3/projects/d1defe14eddd4b28ac969adb3d504c7a/users/be0a8d40d21048afa4ce94706e3625c3/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 20:57:34.055682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e7769-7c93-460b-af4a-bbd84d3c5312 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:34.056197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e7769-7c93-460b-af4a-bbd84d3c5312 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:34.056197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e7769-7c93-460b-af4a-bbd84d3c5312 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:34.057517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 634/1274] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:57:34.063218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8fae1-5c24-46b5-975f-ed6d88ea5ce1 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:34.063711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8fae1-5c24-46b5-975f-ed6d88ea5ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:34.063818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8fae1-5c24-46b5-975f-ed6d88ea5ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:34.083106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e9f8fae1-5c24-46b5-975f-ed6d88ea5ce1 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:57:34.084324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e9f8fae1-5c24-46b5-975f-ed6d88ea5ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:57:34.160497 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 641/1275] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:57:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:57:34.427077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e7769-7c93-460b-af4a-bbd84d3c5312 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:34.528923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e7769-7c93-460b-af4a-bbd84d3c5312 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:34.546022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:34.563315 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8903e-f12b-456e-aaf5-23d0eff9dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:34.564597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8903e-f12b-456e-aaf5-23d0eff9dee1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:34.564597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8903e-f12b-456e-aaf5-23d0eff9dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:34.564597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8903e-f12b-456e-aaf5-23d0eff9dee1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:34.574765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8903e-f12b-456e-aaf5-23d0eff9dee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-90c8903e-f12b-456e-aaf5-23d0eff9dee1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 20:57:34.579450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:34.580569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:34.581626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:34.581626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:34.581626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:34.581626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:34.581626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 20:57:34.581626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 20:57:34.581626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 20:57:34.581626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 20:57:34.581626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 20:57:34.581626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 20:57:34.581626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 20:57:34.581626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:34.581626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 635/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Aug 19 20:57:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:34.589635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8fae1-5c24-46b5-975f-ed6d88ea5ce1 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:34.670290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:34.692179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8fae1-5c24-46b5-975f-ed6d88ea5ce1 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:34.726035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ebd88-2a75-4378-b821-03290ad33698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:34.726636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ebd88-2a75-4378-b821-03290ad33698 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:34.726947 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ebd88-2a75-4378-b821-03290ad33698 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:34.727218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ebd88-2a75-4378-b821-03290ad33698 None admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:34.727876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ebd88-2a75-4378-b821-03290ad33698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:34.728181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ebd88-2a75-4378-b821-03290ad33698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:34.730110 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ebd88-2a75-4378-b821-03290ad33698 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:34.738194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 642/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Aug 19 20:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:57:34.744244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8903e-f12b-456e-aaf5-23d0eff9dee1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:34.846070 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8903e-f12b-456e-aaf5-23d0eff9dee1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:34.880538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faf0d8-5495-4af1-b3a1-8bad929a3740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:34.881167 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faf0d8-5495-4af1-b3a1-8bad929a3740 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:34.881450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faf0d8-5495-4af1-b3a1-8bad929a3740 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:34.881726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faf0d8-5495-4af1-b3a1-8bad929a3740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:34.892428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72faf0d8-5495-4af1-b3a1-8bad929a3740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:34.893875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72faf0d8-5495-4af1-b3a1-8bad929a3740 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-72faf0d8-5495-4af1-b3a1-8bad929a3740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:57:34.908957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:34.910114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:57:34.911393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:57:34.911393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:34.911393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:34.911393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 636/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:34.916661 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ebd88-2a75-4378-b821-03290ad33698 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:35.017971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ebd88-2a75-4378-b821-03290ad33698 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:35.051978 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee10f17-2bea-41ea-865f-c8a621236646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:35.052592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee10f17-2bea-41ea-865f-c8a621236646 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:35.052870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee10f17-2bea-41ea-865f-c8a621236646 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:35.053140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee10f17-2bea-41ea-865f-c8a621236646 None admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:35.053780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee10f17-2bea-41ea-865f-c8a621236646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:35.054082 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee10f17-2bea-41ea-865f-c8a621236646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:35.055463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee10f17-2bea-41ea-865f-c8a621236646 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:35.068021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 643/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:35.074059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faf0d8-5495-4af1-b3a1-8bad929a3740 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:35.106018 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:35.179248 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faf0d8-5495-4af1-b3a1-8bad929a3740 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:35.213120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a492b50-f7d8-41e4-9fa4-c2146f62dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:35.213740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a492b50-f7d8-41e4-9fa4-c2146f62dc46 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:35.214018 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a492b50-f7d8-41e4-9fa4-c2146f62dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:35.214289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a492b50-f7d8-41e4-9fa4-c2146f62dc46 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:35.221641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a492b50-f7d8-41e4-9fa4-c2146f62dc46 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:35.223095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a492b50-f7d8-41e4-9fa4-c2146f62dc46 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-8a492b50-f7d8-41e4-9fa4-c2146f62dc46 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 20:57:35.233789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:35.234995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:35.236170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:35.236170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:35.236170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 20:57:35.236170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 20:57:35.236170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 20:57:35.236170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 20:57:35.236170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 20:57:35.236170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 20:57:35.236170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 20:57:35.236170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:35.236170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 637/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 20:57:35.240927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee10f17-2bea-41ea-865f-c8a621236646 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:35.245391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:35.339696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee10f17-2bea-41ea-865f-c8a621236646 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:35.373480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb983b-baa9-448a-88d9-2518f47fcb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:35.374083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb983b-baa9-448a-88d9-2518f47fcb42 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:35.374365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb983b-baa9-448a-88d9-2518f47fcb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:35.374641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb983b-baa9-448a-88d9-2518f47fcb42 None admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:35.375399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb983b-baa9-448a-88d9-2518f47fcb42 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:35.375709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb983b-baa9-448a-88d9-2518f47fcb42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:35.377124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb983b-baa9-448a-88d9-2518f47fcb42 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:35.394373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 644/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Aug 19 20:57:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 20:57:35.400162 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a492b50-f7d8-41e4-9fa4-c2146f62dc46 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:35.491485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:35.502690 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a492b50-f7d8-41e4-9fa4-c2146f62dc46 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:35.539136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c2921-d368-4bbf-8bfe-1b7702aca8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:35.539753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c2921-d368-4bbf-8bfe-1b7702aca8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:35.540038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c2921-d368-4bbf-8bfe-1b7702aca8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:35.540320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c2921-d368-4bbf-8bfe-1b7702aca8e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:35.608051 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c2921-d368-4bbf-8bfe-1b7702aca8e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:35.609408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c2921-d368-4bbf-8bfe-1b7702aca8e1 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:35.698481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:35.708587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 638/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Aug 19 20:57:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 20:57:35.714975 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb983b-baa9-448a-88d9-2518f47fcb42 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:35.776424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:35.815046 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb983b-baa9-448a-88d9-2518f47fcb42 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:35.848131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af2257-845d-4bad-af4d-6a126da5f3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:35.848759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af2257-845d-4bad-af4d-6a126da5f3cf None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:35.849037 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af2257-845d-4bad-af4d-6a126da5f3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:35.849314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af2257-845d-4bad-af4d-6a126da5f3cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:35.859522 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af2257-845d-4bad-af4d-6a126da5f3cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:35.860888 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af2257-845d-4bad-af4d-6a126da5f3cf None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-31af2257-845d-4bad-af4d-6a126da5f3cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 20:57:35.875363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:35.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 20:57:35.877666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 20:57:35.877666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 20:57:35.877666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:35.877666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 645/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 20:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:35.882286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c2921-d368-4bbf-8bfe-1b7702aca8e1 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:35.980695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c2921-d368-4bbf-8bfe-1b7702aca8e1 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:36.013910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6fa7c-7f77-46e8-8d68-7e9e65f4c306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:36.014513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6fa7c-7f77-46e8-8d68-7e9e65f4c306 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:36.014816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6fa7c-7f77-46e8-8d68-7e9e65f4c306 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:36.015091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6fa7c-7f77-46e8-8d68-7e9e65f4c306 None admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:36.015726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6fa7c-7f77-46e8-8d68-7e9e65f4c306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:36.016027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6fa7c-7f77-46e8-8d68-7e9e65f4c306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:36.017376 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6fa7c-7f77-46e8-8d68-7e9e65f4c306 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:36.028916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 639/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Aug 19 20:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:36.034798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af2257-845d-4bad-af4d-6a126da5f3cf None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:36.137744 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af2257-845d-4bad-af4d-6a126da5f3cf None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:36.152167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:36.171885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0127-e5fa-416a-9447-d283c83998fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:36.172512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0127-e5fa-416a-9447-d283c83998fc None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:36.172794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0127-e5fa-416a-9447-d283c83998fc None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:36.173065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0127-e5fa-416a-9447-d283c83998fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:36.179457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d0127-e5fa-416a-9447-d283c83998fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:36.180888 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d0127-e5fa-416a-9447-d283c83998fc None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application [None req-276d0127-e5fa-416a-9447-d283c83998fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 20:57:36.192156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:36.193205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:36.194334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 20:57:36.194334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 20:57:36.194334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 20:57:36.194334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 20:57:36.194334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 20:57:36.194334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 20:57:36.194334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 20:57:36.194334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: ERROR keystone.server.flask.application Aug 19 20:57:36.194334 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 646/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Aug 19 20:57:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:36.199993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6fa7c-7f77-46e8-8d68-7e9e65f4c306 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:36.248904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:36.298663 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6fa7c-7f77-46e8-8d68-7e9e65f4c306 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:36.332139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d5424-fcca-4467-a807-83584fbfa702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:36.332754 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d5424-fcca-4467-a807-83584fbfa702 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:36.333041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d5424-fcca-4467-a807-83584fbfa702 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:36.333317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d5424-fcca-4467-a807-83584fbfa702 None admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:36.334024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d5424-fcca-4467-a807-83584fbfa702 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:36.334336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d5424-fcca-4467-a807-83584fbfa702 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:36.335799 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d5424-fcca-4467-a807-83584fbfa702 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:36.348960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 640/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Aug 19 20:57:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:36.355705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0127-e5fa-416a-9447-d283c83998fc None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:36.463599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0127-e5fa-416a-9447-d283c83998fc None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:36.499597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb75e07-4536-40c8-b6e8-2a12e089d300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:36.500207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb75e07-4536-40c8-b6e8-2a12e089d300 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:36.500490 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb75e07-4536-40c8-b6e8-2a12e089d300 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:36.500764 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb75e07-4536-40c8-b6e8-2a12e089d300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:36.501495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb75e07-4536-40c8-b6e8-2a12e089d300 None admin] RBAC: Adding query filter params (role.id=50c88cf8d5e64eca8d743b9028a587bc, scope.project.id=d1defe14eddd4b28ac969adb3d504c7a, user.id=be0a8d40d21048afa4ce94706e3625c3) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:36.501808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb75e07-4536-40c8-b6e8-2a12e089d300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:36.503277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb75e07-4536-40c8-b6e8-2a12e089d300 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:36.508932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 647/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Aug 19 20:57:36 2022] GET /identity/v3/role_assignments?user.id=be0a8d40d21048afa4ce94706e3625c3&scope.project.id=d1defe14eddd4b28ac969adb3d504c7a&role.id=50c88cf8d5e64eca8d743b9028a587bc => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:38.446792 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ced45-5a8a-4f14-8097-e8df19a1522f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:38.447435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ced45-5a8a-4f14-8097-e8df19a1522f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:38.447435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ced45-5a8a-4f14-8097-e8df19a1522f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:38.448902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 641/1288] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:57:38.453934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7650a-666f-4e04-a4c3-223acd0207b0 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:38.454365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7650a-666f-4e04-a4c3-223acd0207b0 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:38.454501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7650a-666f-4e04-a4c3-223acd0207b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:38.472994 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-42b7650a-666f-4e04-a4c3-223acd0207b0 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:57:38.474187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-42b7650a-666f-4e04-a4c3-223acd0207b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:57:38.507582 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:38.545798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 648/1289] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:57:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:57:38.822620 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ced45-5a8a-4f14-8097-e8df19a1522f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:38.923401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ced45-5a8a-4f14-8097-e8df19a1522f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:38.934205 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:38.957339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678d07b-4c9e-4e7c-8095-e3e4ffbe19df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:38.957971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d07b-4c9e-4e7c-8095-e3e4ffbe19df None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:38.958251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d07b-4c9e-4e7c-8095-e3e4ffbe19df None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:38.958524 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d07b-4c9e-4e7c-8095-e3e4ffbe19df None admin] PATH_INFO: `/v3/services/placement` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:38.959138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678d07b-4c9e-4e7c-8095-e3e4ffbe19df None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:38.960501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678d07b-4c9e-4e7c-8095-e3e4ffbe19df None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-9678d07b-4c9e-4e7c-8095-e3e4ffbe19df None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:38.969871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:38.971161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:38.972234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 642/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Aug 19 20:57:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:38.977023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7650a-666f-4e04-a4c3-223acd0207b0 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:39.074974 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7650a-666f-4e04-a4c3-223acd0207b0 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:39.111756 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a847-c55b-43df-93b2-dea1fddad015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:39.112367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a847-c55b-43df-93b2-dea1fddad015 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:39.112714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a847-c55b-43df-93b2-dea1fddad015 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:39.112938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a847-c55b-43df-93b2-dea1fddad015 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:39.113562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4a847-c55b-43df-93b2-dea1fddad015 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:39.113862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4a847-c55b-43df-93b2-dea1fddad015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:39.115256 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4a847-c55b-43df-93b2-dea1fddad015 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:39.121491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 649/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Fri Aug 19 20:57:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:39.127349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678d07b-4c9e-4e7c-8095-e3e4ffbe19df None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:39.234827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678d07b-4c9e-4e7c-8095-e3e4ffbe19df None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:39.268724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b375e64-ead9-424d-9afc-6069c504a403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:39.269327 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b375e64-ead9-424d-9afc-6069c504a403 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:39.269612 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b375e64-ead9-424d-9afc-6069c504a403 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:39.269891 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b375e64-ead9-424d-9afc-6069c504a403 None admin] PATH_INFO: `/v3/services` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:39.270516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b375e64-ead9-424d-9afc-6069c504a403 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:39.270849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b375e64-ead9-424d-9afc-6069c504a403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:39.272207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b375e64-ead9-424d-9afc-6069c504a403 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:39.276708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 643/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Fri Aug 19 20:57:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:41.151739 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f77ec-32ed-49ea-86ee-10a72e0c80ab None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:41.152264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f77ec-32ed-49ea-86ee-10a72e0c80ab None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:41.152395 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f77ec-32ed-49ea-86ee-10a72e0c80ab None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:41.153657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 650/1293] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:57:41.158695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbc2db-056b-4507-8d44-6a40f961a191 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:41.159100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbc2db-056b-4507-8d44-6a40f961a191 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:41.159283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbc2db-056b-4507-8d44-6a40f961a191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:41.178227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-bdcbc2db-056b-4507-8d44-6a40f961a191 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:57:41.179494 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bdcbc2db-056b-4507-8d44-6a40f961a191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:57:41.209199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:41.248247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 644/1294] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:57:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:57:41.524805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f77ec-32ed-49ea-86ee-10a72e0c80ab None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:41.555958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:41.626977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f77ec-32ed-49ea-86ee-10a72e0c80ab None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:41.661983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a182d74-dcae-40c7-a74a-7ca2df8fdf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:41.662578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a182d74-dcae-40c7-a74a-7ca2df8fdf0d None admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:41.662904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a182d74-dcae-40c7-a74a-7ca2df8fdf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:41.663166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a182d74-dcae-40c7-a74a-7ca2df8fdf0d None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:41.663810 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a182d74-dcae-40c7-a74a-7ca2df8fdf0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:41.665143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a182d74-dcae-40c7-a74a-7ca2df8fdf0d None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:41.679732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 651/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Aug 19 20:57:41 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 20:57:43.605582 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde64e5-1575-4e43-8fdd-0c639a8c7c25 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:43.606151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde64e5-1575-4e43-8fdd-0c639a8c7c25 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:43.606151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde64e5-1575-4e43-8fdd-0c639a8c7c25 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:43.607500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 645/1296] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:57:43.612602 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4b959-2404-42df-b72d-65c821da8dcf None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:43.613014 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4b959-2404-42df-b72d-65c821da8dcf None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:43.613189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4b959-2404-42df-b72d-65c821da8dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:43.631840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-42e4b959-2404-42df-b72d-65c821da8dcf None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:57:43.633031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-42e4b959-2404-42df-b72d-65c821da8dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:57:43.712628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 652/1297] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:57:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:57:43.984534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde64e5-1575-4e43-8fdd-0c639a8c7c25 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:44.092731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde64e5-1575-4e43-8fdd-0c639a8c7c25 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:44.131908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476f0f8-246f-445d-8243-6af5d3e12ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:44.132581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476f0f8-246f-445d-8243-6af5d3e12ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:44.132953 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476f0f8-246f-445d-8243-6af5d3e12ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:44.133238 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476f0f8-246f-445d-8243-6af5d3e12ad0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:44.133916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476f0f8-246f-445d-8243-6af5d3e12ad0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:44.136364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476f0f8-246f-445d-8243-6af5d3e12ad0 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-4476f0f8-246f-445d-8243-6af5d3e12ad0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:44.147326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:44.148571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:44.149485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 646/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Aug 19 20:57:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:44.155775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4b959-2404-42df-b72d-65c821da8dcf None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:44.177613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:44.266074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4b959-2404-42df-b72d-65c821da8dcf None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:44.300944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd95443-96d1-4475-9bf2-0cc20197a5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:44.301553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95443-96d1-4475-9bf2-0cc20197a5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:44.301838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95443-96d1-4475-9bf2-0cc20197a5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:44.302116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95443-96d1-4475-9bf2-0cc20197a5a1 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:44.302771 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd95443-96d1-4475-9bf2-0cc20197a5a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:44.303086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd95443-96d1-4475-9bf2-0cc20197a5a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:44.304460 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd95443-96d1-4475-9bf2-0cc20197a5a1 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:44.309709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 653/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Fri Aug 19 20:57:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:44.315725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476f0f8-246f-445d-8243-6af5d3e12ad0 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:44.351921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:44.421311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476f0f8-246f-445d-8243-6af5d3e12ad0 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:44.455098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18d316-fe53-4fd6-ab2a-e907603c2b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:44.455701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18d316-fe53-4fd6-ab2a-e907603c2b26 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:44.455985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18d316-fe53-4fd6-ab2a-e907603c2b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:44.456258 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18d316-fe53-4fd6-ab2a-e907603c2b26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:44.456970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18d316-fe53-4fd6-ab2a-e907603c2b26 None admin] RBAC: Adding query filter params (interface=public, service_id=db96567b31a84a49822403cbdfd1f9eb, region_id=RegionOne) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:44.457275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18d316-fe53-4fd6-ab2a-e907603c2b26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:44.458637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18d316-fe53-4fd6-ab2a-e907603c2b26 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:44.463875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 647/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Aug 19 20:57:44 2022] GET /identity/v3/endpoints?service_id=db96567b31a84a49822403cbdfd1f9eb&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:44.469611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd95443-96d1-4475-9bf2-0cc20197a5a1 None admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:44.552172 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:44.570902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd95443-96d1-4475-9bf2-0cc20197a5a1 None admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:44.604176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac49731-0c2d-4969-a422-98ba30d2e9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:44.604785 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac49731-0c2d-4969-a422-98ba30d2e9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:44.605068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac49731-0c2d-4969-a422-98ba30d2e9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:44.605343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac49731-0c2d-4969-a422-98ba30d2e9c4 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:44.605948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac49731-0c2d-4969-a422-98ba30d2e9c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:44.607335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac49731-0c2d-4969-a422-98ba30d2e9c4 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:44.613987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 654/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Aug 19 20:57:44 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 20:57:46.518905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb611-70ef-44af-b437-74b336c3c489 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:46.519442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb611-70ef-44af-b437-74b336c3c489 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:46.519442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb611-70ef-44af-b437-74b336c3c489 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:46.520814 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 648/1302] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:57:46.526426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92c83a-f710-4f83-b69c-71478fbbfcd7 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:46.526871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92c83a-f710-4f83-b69c-71478fbbfcd7 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:46.527013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92c83a-f710-4f83-b69c-71478fbbfcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:46.544885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-bb92c83a-f710-4f83-b69c-71478fbbfcd7 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:57:46.546082 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-bb92c83a-f710-4f83-b69c-71478fbbfcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:57:46.612064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 655/1303] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:57:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 20:57:46.915221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb611-70ef-44af-b437-74b336c3c489 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:47.013613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:47.020929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb611-70ef-44af-b437-74b336c3c489 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:47.055505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8476e4c-f6a6-421d-866f-aa5dd3934079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:47.056416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8476e4c-f6a6-421d-866f-aa5dd3934079 None admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:47.056792 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8476e4c-f6a6-421d-866f-aa5dd3934079 None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:47.057088 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8476e4c-f6a6-421d-866f-aa5dd3934079 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:47.057711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8476e4c-f6a6-421d-866f-aa5dd3934079 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:47.059176 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8476e4c-f6a6-421d-866f-aa5dd3934079 None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application [None req-c8476e4c-f6a6-421d-866f-aa5dd3934079 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 20:57:47.068777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 20:57:47.070077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application with Lock( Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self._enter() Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application return self.creator() Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application created_value = creator( Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: ERROR keystone.server.flask.application Aug 19 20:57:47.071193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 649/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Aug 19 20:57:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 20:57:47.076989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92c83a-f710-4f83-b69c-71478fbbfcd7 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:47.159052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:47.183214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92c83a-f710-4f83-b69c-71478fbbfcd7 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:47.216881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef79da-2564-432c-82da-3d44a793b3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:47.217494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef79da-2564-432c-82da-3d44a793b3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:47.217780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef79da-2564-432c-82da-3d44a793b3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:47.218056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef79da-2564-432c-82da-3d44a793b3e7 None admin] PATH_INFO: `/v3/services` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:47.218688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef79da-2564-432c-82da-3d44a793b3e7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 20:57:47.219025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef79da-2564-432c-82da-3d44a793b3e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:47.220379 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef79da-2564-432c-82da-3d44a793b3e7 None admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:47.225434 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 656/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Fri Aug 19 20:57:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 20:57:47.231556 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8476e4c-f6a6-421d-866f-aa5dd3934079 None admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:57:47.330356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8476e4c-f6a6-421d-866f-aa5dd3934079 None admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:57:47.363689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fff069-485f-449d-949e-e3422a16e9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:57:47.364297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fff069-485f-449d-949e-e3422a16e9fe None admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:57:47.364578 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fff069-485f-449d-949e-e3422a16e9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:57:47.364853 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fff069-485f-449d-949e-e3422a16e9fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:57:47.365506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fff069-485f-449d-949e-e3422a16e9fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:57:47.366904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fff069-485f-449d-949e-e3422a16e9fe None admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:57:47.389178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 650/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 20:57:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 20:57:57.222849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=30 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:57:57.382409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:58:55.550211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548aa05-8cb9-48cb-9b0b-5ee0c9a382cd None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:58:55.550812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548aa05-8cb9-48cb-9b0b-5ee0c9a382cd None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:58:55.550812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548aa05-8cb9-48cb-9b0b-5ee0c9a382cd None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:58:55.552424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 657/1307] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:58:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:58:55.558600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416896b9-a649-4510-b382-ec9440ffb42a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:58:55.559058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416896b9-a649-4510-b382-ec9440ffb42a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:58:55.559149 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416896b9-a649-4510-b382-ec9440ffb42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:58:55.707003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-416896b9-a649-4510-b382-ec9440ffb42a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:58:55.708592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-416896b9-a649-4510-b382-ec9440ffb42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:58:55.837827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 651/1308] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 20:58:56.140675 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511d3d8-fd14-4383-84f7-8988a2bd1481 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:58:56.140925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511d3d8-fd14-4383-84f7-8988a2bd1481 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:58:56.141012 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511d3d8-fd14-4383-84f7-8988a2bd1481 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:58:56.142713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 658/1309] 10.222.0.17 () {54 vars in 965 bytes} [Fri Aug 19 20:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:58:56.150606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1b001-f627-4836-b59d-f569276310d5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:58:56.150923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1b001-f627-4836-b59d-f569276310d5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:58:56.151348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1b001-f627-4836-b59d-f569276310d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:58:56.243438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ddf1b001-f627-4836-b59d-f569276310d5 None None] MFA Rules not processed for user `95b17424a40b475480403eb9f4f3f88f`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:58:56.244865 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ddf1b001-f627-4836-b59d-f569276310d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:58:56.268446 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:58:56.335426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 652/1310] 10.222.0.17 () {58 vars in 1062 bytes} [Fri Aug 19 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:58:56.345357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511d3d8-fd14-4383-84f7-8988a2bd1481 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:58:56.347246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8511d3d8-fd14-4383-84f7-8988a2bd1481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:58:56.483369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511d3d8-fd14-4383-84f7-8988a2bd1481 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:58:56.592726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d700c8-e305-4e1e-8856-09ef59f4aa14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:58:56.593487 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d700c8-e305-4e1e-8856-09ef59f4aa14 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:58:56.593607 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d700c8-e305-4e1e-8856-09ef59f4aa14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:58:56.593948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d700c8-e305-4e1e-8856-09ef59f4aa14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:58:56.595631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-20d700c8-e305-4e1e-8856-09ef59f4aa14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:58:56.695391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:58:56.780274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d700c8-e305-4e1e-8856-09ef59f4aa14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:58:56.782127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d700c8-e305-4e1e-8856-09ef59f4aa14 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:58:56.809843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 659/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 20:58:59.167234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32985d2e-cdb2-4765-9ccb-cde8b0b6b774 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:58:59.167859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32985d2e-cdb2-4765-9ccb-cde8b0b6b774 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:58:59.167859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32985d2e-cdb2-4765-9ccb-cde8b0b6b774 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:58:59.169159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 653/1312] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:58:59.175106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b42937-fbd0-4cae-aed4-677f1576d9d9 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:58:59.175616 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b42937-fbd0-4cae-aed4-677f1576d9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:58:59.175716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b42937-fbd0-4cae-aed4-677f1576d9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:58:59.269837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-96b42937-fbd0-4cae-aed4-677f1576d9d9 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:58:59.271083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-96b42937-fbd0-4cae-aed4-677f1576d9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:58:59.392617 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 660/1313] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:58:59.681370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32985d2e-cdb2-4765-9ccb-cde8b0b6b774 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:58:59.683383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-32985d2e-cdb2-4765-9ccb-cde8b0b6b774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:58:59.801516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32985d2e-cdb2-4765-9ccb-cde8b0b6b774 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:58:59.879165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:58:59.881749 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8aaf7-f20b-4cad-8b81-6a2c0ec7113e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:58:59.882362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8aaf7-f20b-4cad-8b81-6a2c0ec7113e service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:58:59.883031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8aaf7-f20b-4cad-8b81-6a2c0ec7113e service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:58:59.883391 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8aaf7-f20b-4cad-8b81-6a2c0ec7113e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:58:59.886578 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-59b8aaf7-f20b-4cad-8b81-6a2c0ec7113e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:00.002961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8aaf7-f20b-4cad-8b81-6a2c0ec7113e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:59:00.004415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8aaf7-f20b-4cad-8b81-6a2c0ec7113e service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:59:00.025604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 654/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 20:59:02.368373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249df2-20a2-40fc-8f1e-ac394fe5d638 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:02.369002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249df2-20a2-40fc-8f1e-ac394fe5d638 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:02.369436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249df2-20a2-40fc-8f1e-ac394fe5d638 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:02.370916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 661/1315] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:02.376606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3860e-9fd1-4030-959d-ee5a6a54385f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:02.377145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3860e-9fd1-4030-959d-ee5a6a54385f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:02.377242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3860e-9fd1-4030-959d-ee5a6a54385f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:02.448613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ecd3860e-9fd1-4030-959d-ee5a6a54385f None None] MFA Rules not processed for user `15313602248c4227a5b0b9e1c4fdfeed`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:02.449841 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ecd3860e-9fd1-4030-959d-ee5a6a54385f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:02.505250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:02.559946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 655/1316] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:59:02 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:02.898023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad22fb-dc7a-445d-97dc-83b3ad52ea66 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:02.898305 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad22fb-dc7a-445d-97dc-83b3ad52ea66 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:02.898586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad22fb-dc7a-445d-97dc-83b3ad52ea66 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:02.900768 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 662/1317] 10.222.0.17 () {54 vars in 965 bytes} [Fri Aug 19 20:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 20:59:02.907527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55b67e-d48b-4fb8-96f7-fa18c85d6c60 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:02.907818 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55b67e-d48b-4fb8-96f7-fa18c85d6c60 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:02.908094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55b67e-d48b-4fb8-96f7-fa18c85d6c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:02.991812 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-af55b67e-d48b-4fb8-96f7-fa18c85d6c60 None None] MFA Rules not processed for user `95b17424a40b475480403eb9f4f3f88f`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:02.993612 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-af55b67e-d48b-4fb8-96f7-fa18c85d6c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:03.080570 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 656/1318] 10.222.0.17 () {58 vars in 1062 bytes} [Fri Aug 19 20:59:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:03.090652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad22fb-dc7a-445d-97dc-83b3ad52ea66 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:59:03.092344 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-04ad22fb-dc7a-445d-97dc-83b3ad52ea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:03.103301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:03.206950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad22fb-dc7a-445d-97dc-83b3ad52ea66 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:59:03.288900 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc600785-ecee-44c3-ad4f-c8eed2ff3e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:59:03.289526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc600785-ecee-44c3-ad4f-c8eed2ff3e22 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:03.290543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc600785-ecee-44c3-ad4f-c8eed2ff3e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:03.290848 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc600785-ecee-44c3-ad4f-c8eed2ff3e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:03.292750 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-dc600785-ecee-44c3-ad4f-c8eed2ff3e22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:03.365097 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:03.415352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc600785-ecee-44c3-ad4f-c8eed2ff3e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:59:03.416871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc600785-ecee-44c3-ad4f-c8eed2ff3e22 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:59:03.436770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 663/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:59:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 20:59:06.589139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0848cd-f65b-410f-9e1e-3b767db0596f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:06.589694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0848cd-f65b-410f-9e1e-3b767db0596f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:06.589694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0848cd-f65b-410f-9e1e-3b767db0596f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:06.591221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 657/1320] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:06.598429 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b2d00-c249-4fc3-9ed0-c236ed532cbb None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:06.599068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b2d00-c249-4fc3-9ed0-c236ed532cbb None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:06.599315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b2d00-c249-4fc3-9ed0-c236ed532cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:06.721672 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-b70b2d00-c249-4fc3-9ed0-c236ed532cbb None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:06.723772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b70b2d00-c249-4fc3-9ed0-c236ed532cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:06.884968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 664/1321] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:59:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:07.184994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0848cd-f65b-410f-9e1e-3b767db0596f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:59:07.186670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-dd0848cd-f65b-410f-9e1e-3b767db0596f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:07.247277 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:07.311085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0848cd-f65b-410f-9e1e-3b767db0596f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:59:07.395904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91555eb8-1f78-4039-8a25-045eca7d6e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:59:07.396527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91555eb8-1f78-4039-8a25-045eca7d6e0f service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:07.396815 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91555eb8-1f78-4039-8a25-045eca7d6e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:07.397093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91555eb8-1f78-4039-8a25-045eca7d6e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:07.399537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-91555eb8-1f78-4039-8a25-045eca7d6e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:07.518549 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:07.534347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91555eb8-1f78-4039-8a25-045eca7d6e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:59:07.535995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91555eb8-1f78-4039-8a25-045eca7d6e0f service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:59:07.557332 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 658/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:59:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 20:59:10.601410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbf715-3530-405c-8440-a6b152c53401 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:10.602522 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbf715-3530-405c-8440-a6b152c53401 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:10.602522 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbf715-3530-405c-8440-a6b152c53401 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:10.603945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 665/1323] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:10.609553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6d5d6-0f0a-4a5a-b250-480ade579c4c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:10.610107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6d5d6-0f0a-4a5a-b250-480ade579c4c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:10.610205 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6d5d6-0f0a-4a5a-b250-480ade579c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:10.686811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-38a6d5d6-0f0a-4a5a-b250-480ade579c4c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:10.688010 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-38a6d5d6-0f0a-4a5a-b250-480ade579c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:10.828878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 659/1324] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:11.112134 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbf715-3530-405c-8440-a6b152c53401 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:59:11.113803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-03fbf715-3530-405c-8440-a6b152c53401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:11.137618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:11.244798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbf715-3530-405c-8440-a6b152c53401 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:59:11.339251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723978ca-090d-41b3-9a27-e48e30fa4c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:59:11.339896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723978ca-090d-41b3-9a27-e48e30fa4c42 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:11.340186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723978ca-090d-41b3-9a27-e48e30fa4c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:11.340463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723978ca-090d-41b3-9a27-e48e30fa4c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:11.342304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-723978ca-090d-41b3-9a27-e48e30fa4c42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:11.433851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:11.482768 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723978ca-090d-41b3-9a27-e48e30fa4c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:59:11.484376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723978ca-090d-41b3-9a27-e48e30fa4c42 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:59:11.506405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 666/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 20:59:13.537078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b48fb-362c-4d13-86e4-5a99515193f7 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:13.537611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b48fb-362c-4d13-86e4-5a99515193f7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:13.537611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b48fb-362c-4d13-86e4-5a99515193f7 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:13.538943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 660/1326] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:13.545034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edd973-4e68-4dc0-8de9-01370fe4b0e8 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:13.545450 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edd973-4e68-4dc0-8de9-01370fe4b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:13.545598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edd973-4e68-4dc0-8de9-01370fe4b0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:13.613649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-d8edd973-4e68-4dc0-8de9-01370fe4b0e8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:13.614821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d8edd973-4e68-4dc0-8de9-01370fe4b0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:13.711898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 667/1327] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:13.997242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b48fb-362c-4d13-86e4-5a99515193f7 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:59:13.998903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-383b48fb-362c-4d13-86e4-5a99515193f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:14.063945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:14.111881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b48fb-362c-4d13-86e4-5a99515193f7 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:59:14.189583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afa212-4c5a-4ca7-abf9-e13075bb6eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:59:14.190079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afa212-4c5a-4ca7-abf9-e13075bb6eda service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:14.190365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afa212-4c5a-4ca7-abf9-e13075bb6eda service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:14.190640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afa212-4c5a-4ca7-abf9-e13075bb6eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:14.192310 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e4afa212-4c5a-4ca7-abf9-e13075bb6eda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:14.310101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:14.312751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afa212-4c5a-4ca7-abf9-e13075bb6eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:59:14.314838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afa212-4c5a-4ca7-abf9-e13075bb6eda service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:59:14.334102 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 661/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 20:59:16.348820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ea3ea-00cb-4d97-8ed3-42c33f177b7a None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:16.349414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ea3ea-00cb-4d97-8ed3-42c33f177b7a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:16.349414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ea3ea-00cb-4d97-8ed3-42c33f177b7a None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:16.350758 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 668/1329] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:16.357180 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba9d56-e665-4736-aa58-290458e7bce2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:16.357723 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba9d56-e665-4736-aa58-290458e7bce2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:16.357834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba9d56-e665-4736-aa58-290458e7bce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:16.433220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-51ba9d56-e665-4736-aa58-290458e7bce2 None None] MFA Rules not processed for user `15313602248c4227a5b0b9e1c4fdfeed`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:16.434467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-51ba9d56-e665-4736-aa58-290458e7bce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:16.539121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 662/1330] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:59:16 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:16.822983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ea3ea-00cb-4d97-8ed3-42c33f177b7a None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:59:16.825360 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b93ea3ea-00cb-4d97-8ed3-42c33f177b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:16.860891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:16.960801 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ea3ea-00cb-4d97-8ed3-42c33f177b7a None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:59:17.042524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd8594-6fd9-4cd1-a919-076f567f0711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:59:17.043166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd8594-6fd9-4cd1-a919-076f567f0711 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:17.043443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd8594-6fd9-4cd1-a919-076f567f0711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:17.043712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd8594-6fd9-4cd1-a919-076f567f0711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:17.045316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d3fd8594-6fd9-4cd1-a919-076f567f0711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:17.124328 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:17.157862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd8594-6fd9-4cd1-a919-076f567f0711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:59:17.159275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd8594-6fd9-4cd1-a919-076f567f0711 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:59:17.177853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 669/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:59:16 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 20:59:19.436318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684de39-ade4-44a4-8381-73248f32aae7 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:19.436847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684de39-ade4-44a4-8381-73248f32aae7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:19.436847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684de39-ade4-44a4-8381-73248f32aae7 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:19.438198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 663/1332] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:19.443288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9490b5c-a8b7-4bbd-9927-643a265b7bc0 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:19.443727 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9490b5c-a8b7-4bbd-9927-643a265b7bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:19.443853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9490b5c-a8b7-4bbd-9927-643a265b7bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:19.511028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e9490b5c-a8b7-4bbd-9927-643a265b7bc0 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:19.512422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e9490b5c-a8b7-4bbd-9927-643a265b7bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:19.616860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 670/1333] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:19.897919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684de39-ade4-44a4-8381-73248f32aae7 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:59:19.900347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a684de39-ade4-44a4-8381-73248f32aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:19.981535 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:20.020397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684de39-ade4-44a4-8381-73248f32aae7 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:59:20.105527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198be63d-a119-407e-a7cc-79129e769776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:59:20.106148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be63d-a119-407e-a7cc-79129e769776 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:20.106433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be63d-a119-407e-a7cc-79129e769776 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:20.106712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be63d-a119-407e-a7cc-79129e769776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:20.108431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-198be63d-a119-407e-a7cc-79129e769776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:20.229198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198be63d-a119-407e-a7cc-79129e769776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:59:20.230664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198be63d-a119-407e-a7cc-79129e769776 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:59:20.241908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:20.251801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 664/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:59:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 20:59:22.254815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39412703-3586-4a85-b60b-454deca446cd None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:22.255384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39412703-3586-4a85-b60b-454deca446cd None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:22.255384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39412703-3586-4a85-b60b-454deca446cd None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:22.257520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 671/1335] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:22.266571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdb90b-2d6c-4c73-b4d7-65058bfe8046 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:22.266571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdb90b-2d6c-4c73-b4d7-65058bfe8046 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:22.267545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdb90b-2d6c-4c73-b4d7-65058bfe8046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:22.343201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d1cdb90b-2d6c-4c73-b4d7-65058bfe8046 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:22.344433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d1cdb90b-2d6c-4c73-b4d7-65058bfe8046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:22.452810 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 665/1336] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:22.744578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39412703-3586-4a85-b60b-454deca446cd None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:59:22.746223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-39412703-3586-4a85-b60b-454deca446cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:22.791317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:22.865393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39412703-3586-4a85-b60b-454deca446cd None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:59:22.963503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c769f-809a-4c49-a67f-ab66c541cf46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:59:22.964127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c769f-809a-4c49-a67f-ab66c541cf46 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:22.964406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c769f-809a-4c49-a67f-ab66c541cf46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:22.964677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c769f-809a-4c49-a67f-ab66c541cf46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:22.966296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-509c769f-809a-4c49-a67f-ab66c541cf46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:23.055443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:23.082539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c769f-809a-4c49-a67f-ab66c541cf46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:59:23.084042 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c769f-809a-4c49-a67f-ab66c541cf46 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:59:23.104806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 672/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:59:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 20:59:25.425703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3a31-3ea7-4331-829b-1a6eb549c560 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:25.426242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3a31-3ea7-4331-829b-1a6eb549c560 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:25.426615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3a31-3ea7-4331-829b-1a6eb549c560 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:25.428788 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 666/1338] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:25.439763 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09307a-a4d0-4d4f-beed-683c3ec5e623 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:25.440266 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09307a-a4d0-4d4f-beed-683c3ec5e623 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:25.440361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09307a-a4d0-4d4f-beed-683c3ec5e623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:25.519691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-3f09307a-a4d0-4d4f-beed-683c3ec5e623 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:25.520839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3f09307a-a4d0-4d4f-beed-683c3ec5e623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:25.622802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 673/1339] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:59:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:25.919346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3a31-3ea7-4331-829b-1a6eb549c560 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:59:25.920909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2bee3a31-3ea7-4331-829b-1a6eb549c560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:26.004615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:26.048278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3a31-3ea7-4331-829b-1a6eb549c560 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:59:26.126607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e2c3c-c614-4dfb-be2e-d784548f6bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:59:26.127261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e2c3c-c614-4dfb-be2e-d784548f6bdb service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:26.127548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e2c3c-c614-4dfb-be2e-d784548f6bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:26.127830 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e2c3c-c614-4dfb-be2e-d784548f6bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:26.129510 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-694e2c3c-c614-4dfb-be2e-d784548f6bdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:26.251950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e2c3c-c614-4dfb-be2e-d784548f6bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:59:26.253299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e2c3c-c614-4dfb-be2e-d784548f6bdb service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:59:26.272054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 667/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:59:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 20:59:30.490523 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9188-e1be-4c02-b005-22456ac0b417 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:30.491167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9188-e1be-4c02-b005-22456ac0b417 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:30.491167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9188-e1be-4c02-b005-22456ac0b417 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:30.493146 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 674/1341] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:30.499158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96dc1e-1895-470c-a5c5-75e56a30dc4b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:30.499619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96dc1e-1895-470c-a5c5-75e56a30dc4b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:30.499842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96dc1e-1895-470c-a5c5-75e56a30dc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:30.505383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:30.571318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ef96dc1e-1895-470c-a5c5-75e56a30dc4b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:30.572559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ef96dc1e-1895-470c-a5c5-75e56a30dc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:30.675592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 668/1342] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:30.959322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf9188-e1be-4c02-b005-22456ac0b417 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:59:30.961590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-15bf9188-e1be-4c02-b005-22456ac0b417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:31.016859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:31.078763 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf9188-e1be-4c02-b005-22456ac0b417 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:59:31.165045 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e47dec-2cdc-4356-868c-a36f6c83902d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:59:31.165662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e47dec-2cdc-4356-868c-a36f6c83902d service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:31.165947 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e47dec-2cdc-4356-868c-a36f6c83902d service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:31.166222 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e47dec-2cdc-4356-868c-a36f6c83902d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:31.167876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-46e47dec-2cdc-4356-868c-a36f6c83902d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:31.264024 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:31.282543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e47dec-2cdc-4356-868c-a36f6c83902d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:59:31.284001 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e47dec-2cdc-4356-868c-a36f6c83902d service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:59:31.303116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 675/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 20:59:33.874505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271511-3939-4ee9-a669-626b72de6246 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:33.875121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271511-3939-4ee9-a669-626b72de6246 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:33.875121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271511-3939-4ee9-a669-626b72de6246 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:33.876447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 669/1344] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:33.881856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1deb6b-9ae6-42c4-a71f-3713c685a4eb None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:33.882309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1deb6b-9ae6-42c4-a71f-3713c685a4eb None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:33.882466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1deb6b-9ae6-42c4-a71f-3713c685a4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:33.954953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-1d1deb6b-9ae6-42c4-a71f-3713c685a4eb None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:33.956226 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1d1deb6b-9ae6-42c4-a71f-3713c685a4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:34.066799 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 676/1345] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:34.369982 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d271511-3939-4ee9-a669-626b72de6246 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:59:34.371599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3d271511-3939-4ee9-a669-626b72de6246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:34.472474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:34.493290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d271511-3939-4ee9-a669-626b72de6246 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:59:34.581245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1082a0-9bc0-44dd-8dd6-86f6b796ea35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:59:34.581859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1082a0-9bc0-44dd-8dd6-86f6b796ea35 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:34.582141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1082a0-9bc0-44dd-8dd6-86f6b796ea35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:34.582423 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1082a0-9bc0-44dd-8dd6-86f6b796ea35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:34.584089 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5b1082a0-9bc0-44dd-8dd6-86f6b796ea35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:34.735047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1082a0-9bc0-44dd-8dd6-86f6b796ea35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:59:34.736597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1082a0-9bc0-44dd-8dd6-86f6b796ea35 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:59:34.758331 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 670/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:59:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 20:59:39.154466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3047e-999a-4ec5-9f16-87411f681438 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:39.155000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3047e-999a-4ec5-9f16-87411f681438 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:39.155000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3047e-999a-4ec5-9f16-87411f681438 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:39.156288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 677/1347] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:39.161725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e9340-2e41-4f29-a492-c6fc8a68f24f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:39.162210 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e9340-2e41-4f29-a492-c6fc8a68f24f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:39.162321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e9340-2e41-4f29-a492-c6fc8a68f24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:39.178207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:39.239150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ed3e9340-2e41-4f29-a492-c6fc8a68f24f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:39.240477 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ed3e9340-2e41-4f29-a492-c6fc8a68f24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:39.378514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 671/1348] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:39.672090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3047e-999a-4ec5-9f16-87411f681438 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:59:39.673657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-efc3047e-999a-4ec5-9f16-87411f681438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:39.735950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:39.785024 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3047e-999a-4ec5-9f16-87411f681438 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:59:39.862858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f26b56-763c-415b-9490-82e915beed63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:59:39.863566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f26b56-763c-415b-9490-82e915beed63 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:39.863847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f26b56-763c-415b-9490-82e915beed63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:39.864119 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f26b56-763c-415b-9490-82e915beed63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:39.865703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f7f26b56-763c-415b-9490-82e915beed63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:39.975673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:39.980458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f26b56-763c-415b-9490-82e915beed63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:59:39.982069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f26b56-763c-415b-9490-82e915beed63 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:59:40.001785 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 678/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 20:59:45.057763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d076b-8627-4872-8b22-f522f3f38ee3 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:45.058876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d076b-8627-4872-8b22-f522f3f38ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:45.059364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d076b-8627-4872-8b22-f522f3f38ee3 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:45.061436 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 672/1350] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 20:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:45.067941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1dbf2-beae-411a-823f-97e4b0d6c500 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:45.068354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1dbf2-beae-411a-823f-97e4b0d6c500 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:45.068551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1dbf2-beae-411a-823f-97e4b0d6c500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:45.177065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-3dc1dbf2-beae-411a-823f-97e4b0d6c500 None None] MFA Rules not processed for user `be0a8d40d21048afa4ce94706e3625c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:45.178384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3dc1dbf2-beae-411a-823f-97e4b0d6c500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:45.333598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 679/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:49.376894 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=59 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:49.896895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f23b8-7d37-4327-bba9-accd0da040eb None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:49.897837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f23b8-7d37-4327-bba9-accd0da040eb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:49.898641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f23b8-7d37-4327-bba9-accd0da040eb None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:49.900735 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 673/1352] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 20:59:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:49.906914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0dd6d-ba24-423b-a1ef-449f108f7f72 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:49.907419 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0dd6d-ba24-423b-a1ef-449f108f7f72 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:49.907525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0dd6d-ba24-423b-a1ef-449f108f7f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:49.992282 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:50.017566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-adf0dd6d-ba24-423b-a1ef-449f108f7f72 None None] MFA Rules not processed for user `be0a8d40d21048afa4ce94706e3625c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:50.018843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-adf0dd6d-ba24-423b-a1ef-449f108f7f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:50.135476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 680/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:51.487563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601a663-794e-48ff-bc78-d6f081692738 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:51.488131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601a663-794e-48ff-bc78-d6f081692738 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:51.488131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601a663-794e-48ff-bc78-d6f081692738 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:51.489359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 674/1354] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 20:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:51.495378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24854fc-a0a2-430a-910f-1e2144b5819f None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:51.495903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24854fc-a0a2-430a-910f-1e2144b5819f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:51.496001 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24854fc-a0a2-430a-910f-1e2144b5819f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:51.580029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-a24854fc-a0a2-430a-910f-1e2144b5819f None None] MFA Rules not processed for user `be0a8d40d21048afa4ce94706e3625c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:51.581276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a24854fc-a0a2-430a-910f-1e2144b5819f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:51.628820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:51.698167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 681/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 20:59:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:55.125383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cdd69-d63e-4374-9a81-13ca4bd4c294 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:55.126305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cdd69-d63e-4374-9a81-13ca4bd4c294 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:55.126584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cdd69-d63e-4374-9a81-13ca4bd4c294 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:55.128302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 675/1356] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:55.136817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da69f50-d3aa-4070-8fe1-497b52d45b90 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:55.137399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da69f50-d3aa-4070-8fe1-497b52d45b90 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:55.138553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da69f50-d3aa-4070-8fe1-497b52d45b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:55.236745 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7da69f50-d3aa-4070-8fe1-497b52d45b90 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:55.238530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7da69f50-d3aa-4070-8fe1-497b52d45b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:55.377468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 682/1357] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:55.706120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f3774-e82b-4153-a632-fa50ffabb82d None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:55.707131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f3774-e82b-4153-a632-fa50ffabb82d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:55.708103 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f3774-e82b-4153-a632-fa50ffabb82d None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:55.711832 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 676/1358] 10.222.0.17 () {54 vars in 962 bytes} [Fri Aug 19 20:59:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:55.721535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c95f4e-f254-4dc5-a763-3c02fb4e0ff3 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:55.722639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c95f4e-f254-4dc5-a763-3c02fb4e0ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:55.722886 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c95f4e-f254-4dc5-a763-3c02fb4e0ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:55.748735 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:55.843770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-49c95f4e-f254-4dc5-a763-3c02fb4e0ff3 None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:55.845277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-49c95f4e-f254-4dc5-a763-3c02fb4e0ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:55.990430 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 683/1359] 10.222.0.17 () {58 vars in 1059 bytes} [Fri Aug 19 20:59:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:55.999762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f3774-e82b-4153-a632-fa50ffabb82d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:59:56.002261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b92f3774-e82b-4153-a632-fa50ffabb82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:56.184090 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f3774-e82b-4153-a632-fa50ffabb82d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:59:56.265234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:56.311017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fec5d5-6af2-4db7-a7c9-77a85354198f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:59:56.311641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fec5d5-6af2-4db7-a7c9-77a85354198f service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:56.311934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fec5d5-6af2-4db7-a7c9-77a85354198f service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:56.312209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fec5d5-6af2-4db7-a7c9-77a85354198f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:56.313892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-64fec5d5-6af2-4db7-a7c9-77a85354198f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:56.447931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fec5d5-6af2-4db7-a7c9-77a85354198f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 20:59:56.451029 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fec5d5-6af2-4db7-a7c9-77a85354198f service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 20:59:56.490060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 677/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 20:59:58.942841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064332b-2ef0-4a71-92a4-016294f4c688 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:58.943438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064332b-2ef0-4a71-92a4-016294f4c688 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:58.943438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064332b-2ef0-4a71-92a4-016294f4c688 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:58.945576 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 684/1361] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 20:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 20:59:58.951054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0ff4f-c7d8-4864-b399-c0b30f290806 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:58.951587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0ff4f-c7d8-4864-b399-c0b30f290806 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:58.951692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0ff4f-c7d8-4864-b399-c0b30f290806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:59.041719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-70b0ff4f-c7d8-4864-b399-c0b30f290806 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 20:59:59.043033 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-70b0ff4f-c7d8-4864-b399-c0b30f290806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:59.100992 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:59.182802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 678/1362] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 20:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 20:59:59.494776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064332b-2ef0-4a71-92a4-016294f4c688 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 20:59:59.497054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1064332b-2ef0-4a71-92a4-016294f4c688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 20:59:59.668803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 20:59:59.798283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064332b-2ef0-4a71-92a4-016294f4c688 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 20:59:59.961794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac984a-23e0-4892-9fb7-93e0a17436d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 20:59:59.962521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac984a-23e0-4892-9fb7-93e0a17436d6 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 20:59:59.962757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac984a-23e0-4892-9fb7-93e0a17436d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 20:59:59.963031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac984a-23e0-4892-9fb7-93e0a17436d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 20:59:59.964648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-fbac984a-23e0-4892-9fb7-93e0a17436d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:00.002163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:00.093588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac984a-23e0-4892-9fb7-93e0a17436d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:00.095518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac984a-23e0-4892-9fb7-93e0a17436d6 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:00.122922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 685/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 20:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:00:02.572532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e321e-957c-4b95-a626-2a93e4a4b606 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:02.573530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e321e-957c-4b95-a626-2a93e4a4b606 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:02.573812 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e321e-957c-4b95-a626-2a93e4a4b606 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:02.575713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 679/1364] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:02.581772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8afee-0553-44b8-9fc3-9164ccfbbdaf None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:02.582295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8afee-0553-44b8-9fc3-9164ccfbbdaf None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:02.582380 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8afee-0553-44b8-9fc3-9164ccfbbdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:02.660005 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-03e8afee-0553-44b8-9fc3-9164ccfbbdaf None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:02.661416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-03e8afee-0553-44b8-9fc3-9164ccfbbdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:02.796594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:02.802342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 686/1365] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:03.367731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9321ea-388a-4234-85a7-0a520c20bbfc None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:03.368198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9321ea-388a-4234-85a7-0a520c20bbfc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:03.368661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9321ea-388a-4234-85a7-0a520c20bbfc None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:03.371576 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 680/1366] 10.222.0.17 () {54 vars in 962 bytes} [Fri Aug 19 21:00:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:03.382180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb1443-29b9-4a33-bcb9-3bb5f1b221e8 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:03.382639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb1443-29b9-4a33-bcb9-3bb5f1b221e8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:03.383176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb1443-29b9-4a33-bcb9-3bb5f1b221e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:03.537840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-50cb1443-29b9-4a33-bcb9-3bb5f1b221e8 None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:03.539468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-50cb1443-29b9-4a33-bcb9-3bb5f1b221e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:03.690555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 687/1367] 10.222.0.17 () {58 vars in 1059 bytes} [Fri Aug 19 21:00:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:00:03.699805 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9321ea-388a-4234-85a7-0a520c20bbfc None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:03.702550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6e9321ea-388a-4234-85a7-0a520c20bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:03.971751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9321ea-388a-4234-85a7-0a520c20bbfc None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:03.997888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:04.206074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392d0df-f9d8-4cb7-ba16-a7b6694f731d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:04.207747 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392d0df-f9d8-4cb7-ba16-a7b6694f731d service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:04.208620 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392d0df-f9d8-4cb7-ba16-a7b6694f731d service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:04.210034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392d0df-f9d8-4cb7-ba16-a7b6694f731d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:04.214344 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4392d0df-f9d8-4cb7-ba16-a7b6694f731d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:04.385200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392d0df-f9d8-4cb7-ba16-a7b6694f731d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:04.388993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392d0df-f9d8-4cb7-ba16-a7b6694f731d service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:04.430696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 681/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:00:05.011511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116e07d-c7fe-4efc-9c19-876998b1821b None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:05.012099 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116e07d-c7fe-4efc-9c19-876998b1821b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:05.012573 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116e07d-c7fe-4efc-9c19-876998b1821b None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:05.015476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 688/1369] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:00:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:05.024894 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb68ee-ad4d-447d-91c2-356896a683b7 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:05.025716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb68ee-ad4d-447d-91c2-356896a683b7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:05.025716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb68ee-ad4d-447d-91c2-356896a683b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:05.070307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:05.123742 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-bcdb68ee-ad4d-447d-91c2-356896a683b7 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:05.125659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bcdb68ee-ad4d-447d-91c2-356896a683b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:05.276961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 682/1370] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:06.066452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4318-2a7a-41cd-aec1-5a86d172289f None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:06.066452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4318-2a7a-41cd-aec1-5a86d172289f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:06.066452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4318-2a7a-41cd-aec1-5a86d172289f None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:06.068622 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 689/1371] 10.222.0.17 () {54 vars in 964 bytes} [Fri Aug 19 21:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 21:00:06.075945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2948874-f5fb-4b32-b9a7-43daf5343fa9 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:06.075945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2948874-f5fb-4b32-b9a7-43daf5343fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:06.075945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2948874-f5fb-4b32-b9a7-43daf5343fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:06.172859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a2948874-f5fb-4b32-b9a7-43daf5343fa9 None None] MFA Rules not processed for user `4c27e2db991245359bcceb62ff768b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:06.174097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a2948874-f5fb-4b32-b9a7-43daf5343fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:06.250619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:06.305476 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 683/1372] 10.222.0.17 () {58 vars in 1061 bytes} [Fri Aug 19 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:00:06.320406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf4318-2a7a-41cd-aec1-5a86d172289f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:06.323355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a3bf4318-2a7a-41cd-aec1-5a86d172289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:06.432630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:06.530655 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf4318-2a7a-41cd-aec1-5a86d172289f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:06.625386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba482f0-b9c6-49e1-90b3-7e24aa76eb5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:06.626002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba482f0-b9c6-49e1-90b3-7e24aa76eb5d service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:06.626493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba482f0-b9c6-49e1-90b3-7e24aa76eb5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:06.626782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba482f0-b9c6-49e1-90b3-7e24aa76eb5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:06.628373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3ba482f0-b9c6-49e1-90b3-7e24aa76eb5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:06.753712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:06.773629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba482f0-b9c6-49e1-90b3-7e24aa76eb5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:06.775114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba482f0-b9c6-49e1-90b3-7e24aa76eb5d service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:06.811351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 690/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:00:07.121306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66ce7d-c8b8-41ba-bd87-ca99923b5541 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:07.122458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66ce7d-c8b8-41ba-bd87-ca99923b5541 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:07.122458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66ce7d-c8b8-41ba-bd87-ca99923b5541 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:07.127483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 684/1374] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:00:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:07.129409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33427211-af6b-44ff-a8ce-3cc3b4c5442c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:07.130034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33427211-af6b-44ff-a8ce-3cc3b4c5442c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:07.130576 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33427211-af6b-44ff-a8ce-3cc3b4c5442c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:07.237082 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-33427211-af6b-44ff-a8ce-3cc3b4c5442c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:07.239213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-33427211-af6b-44ff-a8ce-3cc3b4c5442c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:07.392785 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 691/1375] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:07.858974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66ce7d-c8b8-41ba-bd87-ca99923b5541 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:07.860525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1d66ce7d-c8b8-41ba-bd87-ca99923b5541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:08.040366 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66ce7d-c8b8-41ba-bd87-ca99923b5541 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:08.108385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:08.186224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e037c0-0239-4888-8de3-0b5dad4595b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:08.187025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e037c0-0239-4888-8de3-0b5dad4595b5 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:08.187177 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e037c0-0239-4888-8de3-0b5dad4595b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:08.187435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e037c0-0239-4888-8de3-0b5dad4595b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:08.189183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-71e037c0-0239-4888-8de3-0b5dad4595b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:08.287293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e037c0-0239-4888-8de3-0b5dad4595b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:08.289877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e037c0-0239-4888-8de3-0b5dad4595b5 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:08.309177 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 685/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:00:10.322280 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934d46-fe0c-44e2-b5fa-5d865a622bad None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:10.322876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934d46-fe0c-44e2-b5fa-5d865a622bad None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:10.322876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934d46-fe0c-44e2-b5fa-5d865a622bad None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:10.324217 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 692/1377] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:10.331184 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67556e7d-a25e-42ab-aee1-b60c7df1b75f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:10.332043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67556e7d-a25e-42ab-aee1-b60c7df1b75f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:10.332620 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67556e7d-a25e-42ab-aee1-b60c7df1b75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:10.418578 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-67556e7d-a25e-42ab-aee1-b60c7df1b75f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:10.420093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-67556e7d-a25e-42ab-aee1-b60c7df1b75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:10.429202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:10.542498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 686/1378] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:00:10.854154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a934d46-fe0c-44e2-b5fa-5d865a622bad None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:10.855772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9a934d46-fe0c-44e2-b5fa-5d865a622bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:10.944503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:11.057261 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a934d46-fe0c-44e2-b5fa-5d865a622bad None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:11.188635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e90d2-fc17-40cc-ae5d-4fbaea16040c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:11.189242 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e90d2-fc17-40cc-ae5d-4fbaea16040c service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:11.189520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e90d2-fc17-40cc-ae5d-4fbaea16040c service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:11.189795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e90d2-fc17-40cc-ae5d-4fbaea16040c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:11.191444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-505e90d2-fc17-40cc-ae5d-4fbaea16040c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:11.211456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:11.297258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e90d2-fc17-40cc-ae5d-4fbaea16040c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:11.299125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e90d2-fc17-40cc-ae5d-4fbaea16040c service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:11.319059 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 693/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:00:13.339494 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166088a-ffbe-4ad3-a0d1-92207e645b05 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:13.340058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166088a-ffbe-4ad3-a0d1-92207e645b05 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:13.340058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166088a-ffbe-4ad3-a0d1-92207e645b05 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:13.341402 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 687/1380] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:13.347393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240c81c-da5b-4941-ace4-b80dc32f9ef3 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:13.347894 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240c81c-da5b-4941-ace4-b80dc32f9ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:13.347894 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240c81c-da5b-4941-ace4-b80dc32f9ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:13.427185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-0240c81c-da5b-4941-ace4-b80dc32f9ef3 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:13.429138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0240c81c-da5b-4941-ace4-b80dc32f9ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:13.543782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:13.551543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 694/1381] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:00:13.871515 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166088a-ffbe-4ad3-a0d1-92207e645b05 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:13.873443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5166088a-ffbe-4ad3-a0d1-92207e645b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:14.065589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:14.079713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166088a-ffbe-4ad3-a0d1-92207e645b05 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:14.208209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056a623-6bde-48a1-b15a-a917caf6dcff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:14.208858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056a623-6bde-48a1-b15a-a917caf6dcff service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:14.209716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056a623-6bde-48a1-b15a-a917caf6dcff service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:14.210022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056a623-6bde-48a1-b15a-a917caf6dcff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:14.211772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e056a623-6bde-48a1-b15a-a917caf6dcff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:14.314757 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056a623-6bde-48a1-b15a-a917caf6dcff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:14.316386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056a623-6bde-48a1-b15a-a917caf6dcff service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:14.328150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:14.338289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 688/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:00:16.389634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a947f-b500-4e9a-9c77-220cfbe27767 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:16.390186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a947f-b500-4e9a-9c77-220cfbe27767 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:16.390280 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a947f-b500-4e9a-9c77-220cfbe27767 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:16.391812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 695/1383] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:16.397942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608d5e8-1100-449c-a03f-086baf0a9816 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:16.398540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608d5e8-1100-449c-a03f-086baf0a9816 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:16.398642 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608d5e8-1100-449c-a03f-086baf0a9816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:16.490009 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4608d5e8-1100-449c-a03f-086baf0a9816 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:16.492049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4608d5e8-1100-449c-a03f-086baf0a9816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:16.632223 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 689/1384] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:16.936768 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a947f-b500-4e9a-9c77-220cfbe27767 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:16.939778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-866a947f-b500-4e9a-9c77-220cfbe27767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:17.312910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a947f-b500-4e9a-9c77-220cfbe27767 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:17.421646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:17.487349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3fe52-6337-4b2d-99b0-12a075166a65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:17.488263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3fe52-6337-4b2d-99b0-12a075166a65 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:17.488666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3fe52-6337-4b2d-99b0-12a075166a65 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:17.489123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3fe52-6337-4b2d-99b0-12a075166a65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:17.492043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-97b3fe52-6337-4b2d-99b0-12a075166a65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:17.612970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3fe52-6337-4b2d-99b0-12a075166a65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:17.614521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3fe52-6337-4b2d-99b0-12a075166a65 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:17.643862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 696/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:00:19.885461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24106af-3685-499b-886a-87801f62a003 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:19.886054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24106af-3685-499b-886a-87801f62a003 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:19.886998 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24106af-3685-499b-886a-87801f62a003 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:19.890282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 690/1386] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:00:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:19.895977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b254c-534d-4fda-a278-4e07bc14f9ef None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:19.897209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b254c-534d-4fda-a278-4e07bc14f9ef None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:19.897209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b254c-534d-4fda-a278-4e07bc14f9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:19.976397 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-b50b254c-534d-4fda-a278-4e07bc14f9ef None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:19.977745 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b50b254c-534d-4fda-a278-4e07bc14f9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:20.017798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:20.117548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 697/1387] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:00:20.415279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24106af-3685-499b-886a-87801f62a003 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:20.417599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d24106af-3685-499b-886a-87801f62a003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:20.524674 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:20.632334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24106af-3685-499b-886a-87801f62a003 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:20.777334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb8e13-89ee-4eb8-8fa6-8738a77c137a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:20.778019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb8e13-89ee-4eb8-8fa6-8738a77c137a service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:20.778305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb8e13-89ee-4eb8-8fa6-8738a77c137a service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:20.778580 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb8e13-89ee-4eb8-8fa6-8738a77c137a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:20.780421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-91cb8e13-89ee-4eb8-8fa6-8738a77c137a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:20.828888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:20.892605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb8e13-89ee-4eb8-8fa6-8738a77c137a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:20.894502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb8e13-89ee-4eb8-8fa6-8738a77c137a service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:20.916581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 691/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:00:22.586555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ebb83-a27d-4816-a004-28b0bf39859d None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:22.587204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ebb83-a27d-4816-a004-28b0bf39859d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:22.587204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ebb83-a27d-4816-a004-28b0bf39859d None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:22.588388 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 698/1389] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:22.594175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb29b10-2bde-475a-aa8e-f10d2f4f2289 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:22.594775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb29b10-2bde-475a-aa8e-f10d2f4f2289 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:22.594775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb29b10-2bde-475a-aa8e-f10d2f4f2289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:22.670766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-deb29b10-2bde-475a-aa8e-f10d2f4f2289 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:22.672021 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-deb29b10-2bde-475a-aa8e-f10d2f4f2289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:22.788125 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 692/1390] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:22.909883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8d481-e925-4dad-8ca4-5680002a7ff3 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:22.910164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8d481-e925-4dad-8ca4-5680002a7ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:22.910439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8d481-e925-4dad-8ca4-5680002a7ff3 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:22.912492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 699/1391] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:22.922260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d357b-e9bd-484f-bb91-c36bfb2dbca5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:22.922545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d357b-e9bd-484f-bb91-c36bfb2dbca5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:22.922882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d357b-e9bd-484f-bb91-c36bfb2dbca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:22.940650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:22.997996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-cb3d357b-e9bd-484f-bb91-c36bfb2dbca5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:22.999234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cb3d357b-e9bd-484f-bb91-c36bfb2dbca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:23.097040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70992c-8a80-4a2a-8b4c-c4c25a793f47 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:23.097325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70992c-8a80-4a2a-8b4c-c4c25a793f47 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:23.097603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70992c-8a80-4a2a-8b4c-c4c25a793f47 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:23.099143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 700/1392] 10.222.0.17 () {54 vars in 967 bytes} [Fri Aug 19 21:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 21:00:23.105079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64f36e-c9ea-42d8-bca7-03e664fa8089 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:23.105364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64f36e-c9ea-42d8-bca7-03e664fa8089 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:23.105641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64f36e-c9ea-42d8-bca7-03e664fa8089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:23.111480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 693/1393] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:23.187029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7b64f36e-c9ea-42d8-bca7-03e664fa8089 None None] MFA Rules not processed for user `51e6b105e7094aea9dcc7423d6205c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:23.188174 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7b64f36e-c9ea-42d8-bca7-03e664fa8089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:23.281358 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 701/1394] 10.222.0.17 () {58 vars in 1064 bytes} [Fri Aug 19 21:00:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:00:23.289914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d357b-e9bd-484f-bb91-c36bfb2dbca5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:23.291181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cb3d357b-e9bd-484f-bb91-c36bfb2dbca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:23.395345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d357b-e9bd-484f-bb91-c36bfb2dbca5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:23.408160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:23.410517 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64f36e-c9ea-42d8-bca7-03e664fa8089 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:23.411852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7b64f36e-c9ea-42d8-bca7-03e664fa8089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:23.447431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:23.491866 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d2551-a7fd-45da-b84e-b6694d24fb21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b105e7094aea9dcc7423d6205c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:23.492493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d2551-a7fd-45da-b84e-b6694d24fb21 service glance] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:23.492779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d2551-a7fd-45da-b84e-b6694d24fb21 service glance] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:23.493057 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d2551-a7fd-45da-b84e-b6694d24fb21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:23.494776 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b05d2551-a7fd-45da-b84e-b6694d24fb21 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:23.555348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64f36e-c9ea-42d8-bca7-03e664fa8089 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:23.631648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d2551-a7fd-45da-b84e-b6694d24fb21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:23.633120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d2551-a7fd-45da-b84e-b6694d24fb21 service glance] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:23.655454 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 694/1395] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:00:23.692036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3bbb6-bcb7-45aa-9aea-e3772011be74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:23.692676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3bbb6-bcb7-45aa-9aea-e3772011be74 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:23.692911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3bbb6-bcb7-45aa-9aea-e3772011be74 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:23.693747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3bbb6-bcb7-45aa-9aea-e3772011be74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:23.695848 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a2e3bbb6-bcb7-45aa-9aea-e3772011be74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:23.716975 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:23.802054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3bbb6-bcb7-45aa-9aea-e3772011be74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:23.804550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3bbb6-bcb7-45aa-9aea-e3772011be74 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:23.827860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 702/1396] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:00:24.475502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0140d-dbba-4082-a709-124389714710 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:24.475797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0140d-dbba-4082-a709-124389714710 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:24.476160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0140d-dbba-4082-a709-124389714710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:24.530616 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:24.555913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7fe0140d-dbba-4082-a709-124389714710 None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:24.557175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7fe0140d-dbba-4082-a709-124389714710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:24.651137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 695/1397] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:24.701399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79eddf-c948-4973-a5f0-dceff636f739 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:24.701962 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79eddf-c948-4973-a5f0-dceff636f739 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:24.701962 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79eddf-c948-4973-a5f0-dceff636f739 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:24.703336 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 703/1398] 10.222.0.17 () {54 vars in 943 bytes} [Fri Aug 19 21:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:24.710052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ae509-f2d9-423a-911d-feace01dce1b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:24.710397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ae509-f2d9-423a-911d-feace01dce1b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:24.710683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ae509-f2d9-423a-911d-feace01dce1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:24.795631 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a96ae509-f2d9-423a-911d-feace01dce1b None None] MFA Rules not processed for user `6fbfc93e45704b3ba2e5a4bcf7568a14`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:24.796843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a96ae509-f2d9-423a-911d-feace01dce1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:24.865566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:24.922382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 696/1399] 10.222.0.17 () {58 vars in 1040 bytes} [Fri Aug 19 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:24.934001 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79eddf-c948-4973-a5f0-dceff636f739 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:24.935659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4e79eddf-c948-4973-a5f0-dceff636f739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:25.092236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79eddf-c948-4973-a5f0-dceff636f739 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:25.102798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:25.201112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eb9d0-1b4e-4867-868f-d07b30b630e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:25.201714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eb9d0-1b4e-4867-868f-d07b30b630e6 service swift] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:25.201991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eb9d0-1b4e-4867-868f-d07b30b630e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:25.202259 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eb9d0-1b4e-4867-868f-d07b30b630e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:25.203911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b57eb9d0-1b4e-4867-868f-d07b30b630e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:25.300594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eb9d0-1b4e-4867-868f-d07b30b630e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:25.302186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eb9d0-1b4e-4867-868f-d07b30b630e6 service swift] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:25.311308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 704/1400] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:00:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 21:00:25.875966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d670c3b-9012-4626-9afd-6338e0ab1a96 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:25.876512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d670c3b-9012-4626-9afd-6338e0ab1a96 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:25.876751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d670c3b-9012-4626-9afd-6338e0ab1a96 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:25.882550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 697/1401] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:25.884303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacfda5-47dd-4a42-8d55-5f61f7dfc2be None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:25.884774 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacfda5-47dd-4a42-8d55-5f61f7dfc2be None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:25.885025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacfda5-47dd-4a42-8d55-5f61f7dfc2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:25.945080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:25.966422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-2aacfda5-47dd-4a42-8d55-5f61f7dfc2be None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:25.967739 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2aacfda5-47dd-4a42-8d55-5f61f7dfc2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:26.103999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 705/1402] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:00:26.399919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d670c3b-9012-4626-9afd-6338e0ab1a96 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:26.402806 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7d670c3b-9012-4626-9afd-6338e0ab1a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:26.689385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d670c3b-9012-4626-9afd-6338e0ab1a96 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:26.738635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:26.861013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b54af9-65a0-44ad-ac51-db458387a29a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:26.861872 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b54af9-65a0-44ad-ac51-db458387a29a service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:26.862294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b54af9-65a0-44ad-ac51-db458387a29a service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:26.862722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b54af9-65a0-44ad-ac51-db458387a29a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:26.864942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d0b54af9-65a0-44ad-ac51-db458387a29a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:26.970402 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b54af9-65a0-44ad-ac51-db458387a29a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:26.971901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b54af9-65a0-44ad-ac51-db458387a29a service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:27.000303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 698/1403] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:00:29.094047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd0c2-af66-4ed3-be62-4c712f0c87f2 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:29.094047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd0c2-af66-4ed3-be62-4c712f0c87f2 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:29.094047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd0c2-af66-4ed3-be62-4c712f0c87f2 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:29.094047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 706/1404] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:29.099430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836456c7-0817-4617-adae-63578a93067a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:29.100122 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836456c7-0817-4617-adae-63578a93067a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:29.100122 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836456c7-0817-4617-adae-63578a93067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:29.166761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:29.176864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-836456c7-0817-4617-adae-63578a93067a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:29.179172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-836456c7-0817-4617-adae-63578a93067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:29.296292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 699/1405] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:29.592881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fd0c2-af66-4ed3-be62-4c712f0c87f2 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:29.594699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-994fd0c2-af66-4ed3-be62-4c712f0c87f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:29.729701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:29.774325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fd0c2-af66-4ed3-be62-4c712f0c87f2 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:29.921495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e758210-0c36-4c15-a870-ed39616f59f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:29.922192 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e758210-0c36-4c15-a870-ed39616f59f8 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:29.922507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e758210-0c36-4c15-a870-ed39616f59f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:29.922811 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e758210-0c36-4c15-a870-ed39616f59f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:29.924442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8e758210-0c36-4c15-a870-ed39616f59f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:30.019041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:30.031623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e758210-0c36-4c15-a870-ed39616f59f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:30.033217 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e758210-0c36-4c15-a870-ed39616f59f8 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:30.056617 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 707/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:00:32.391158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f68d6-6c9d-475b-aedd-e49aa7166ce4 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:32.391740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f68d6-6c9d-475b-aedd-e49aa7166ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:32.391932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f68d6-6c9d-475b-aedd-e49aa7166ce4 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:32.393876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 700/1407] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:32.400242 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901e9c-717a-4915-ad05-cecf01e88f18 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:32.400744 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901e9c-717a-4915-ad05-cecf01e88f18 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:32.400834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901e9c-717a-4915-ad05-cecf01e88f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:32.492817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-8c901e9c-717a-4915-ad05-cecf01e88f18 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:32.495092 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8c901e9c-717a-4915-ad05-cecf01e88f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:32.646868 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 708/1408] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:00:32.929345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f68d6-6c9d-475b-aedd-e49aa7166ce4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:32.930959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ce9f68d6-6c9d-475b-aedd-e49aa7166ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:33.085732 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:33.107892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f68d6-6c9d-475b-aedd-e49aa7166ce4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:33.262261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74211009-9f8b-409e-bb3a-2f7e6e77dd8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:33.262942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74211009-9f8b-409e-bb3a-2f7e6e77dd8c service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:33.263252 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74211009-9f8b-409e-bb3a-2f7e6e77dd8c service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:33.263502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74211009-9f8b-409e-bb3a-2f7e6e77dd8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:33.265118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-74211009-9f8b-409e-bb3a-2f7e6e77dd8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:33.377343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:33.383031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74211009-9f8b-409e-bb3a-2f7e6e77dd8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:33.384968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74211009-9f8b-409e-bb3a-2f7e6e77dd8c service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:33.406302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 701/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:00:42.628106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=74 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:43.402964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=7 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:48.668867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb6d48-04be-419c-8ac7-8c27acb13b17 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:48.669464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb6d48-04be-419c-8ac7-8c27acb13b17 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:48.669575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb6d48-04be-419c-8ac7-8c27acb13b17 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:48.671043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 709/1410] 10.222.0.17 () {54 vars in 918 bytes} [Fri Aug 19 21:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 21:00:48.676664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe2c0-dda3-4ce8-9885-4b6f9fb293dd None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:48.677182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe2c0-dda3-4ce8-9885-4b6f9fb293dd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:48.677288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe2c0-dda3-4ce8-9885-4b6f9fb293dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:48.757935 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-133fe2c0-dda3-4ce8-9885-4b6f9fb293dd None None] MFA Rules not processed for user `be0a8d40d21048afa4ce94706e3625c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:48.759184 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-133fe2c0-dda3-4ce8-9885-4b6f9fb293dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:48.884234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 702/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Aug 19 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:48.899025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db589e2c-b7d3-4c5f-8fd7-4111fea3340f None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:48.899310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db589e2c-b7d3-4c5f-8fd7-4111fea3340f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:48.899587 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db589e2c-b7d3-4c5f-8fd7-4111fea3340f None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:48.900915 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 710/1412] 10.222.0.17 () {54 vars in 918 bytes} [Fri Aug 19 21:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:48.905797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb3c2d-f820-4508-ae0b-bc7ccbdbfdc8 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:48.906093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb3c2d-f820-4508-ae0b-bc7ccbdbfdc8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:48.906400 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb3c2d-f820-4508-ae0b-bc7ccbdbfdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:48.986254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:48.990931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-15fb3c2d-f820-4508-ae0b-bc7ccbdbfdc8 None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:48.992927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-15fb3c2d-f820-4508-ae0b-bc7ccbdbfdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:49.120258 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 703/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Aug 19 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:51.589934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532bd32-880d-49b0-a5b6-afab07e71c63 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:51.590702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532bd32-880d-49b0-a5b6-afab07e71c63 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:51.590702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532bd32-880d-49b0-a5b6-afab07e71c63 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:51.591839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 21:00:51.604163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e25fb7-d777-422e-947d-a3718ebc1efe None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:51.604715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e25fb7-d777-422e-947d-a3718ebc1efe None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:51.604715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e25fb7-d777-422e-947d-a3718ebc1efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:51.674445 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-29e25fb7-d777-422e-947d-a3718ebc1efe None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:51.675707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-29e25fb7-d777-422e-947d-a3718ebc1efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:51.733932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:51.778370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:52.078640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532bd32-880d-49b0-a5b6-afab07e71c63 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:52.081070 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6532bd32-880d-49b0-a5b6-afab07e71c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:52.231116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532bd32-880d-49b0-a5b6-afab07e71c63 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:52.309241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:52.351175 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b2192-b567-46ba-8ab0-fd9151737100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:52.351693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b2192-b567-46ba-8ab0-fd9151737100 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:52.351975 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b2192-b567-46ba-8ab0-fd9151737100 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:52.352248 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b2192-b567-46ba-8ab0-fd9151737100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:52.353873 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-245b2192-b567-46ba-8ab0-fd9151737100 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:52.452124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b2192-b567-46ba-8ab0-fd9151737100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:52.453721 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b2192-b567-46ba-8ab0-fd9151737100 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:52.474444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 712/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:00:53.412971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523079ef-233f-4e28-bf40-8e13311c1327 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:53.413537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523079ef-233f-4e28-bf40-8e13311c1327 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:53.413537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523079ef-233f-4e28-bf40-8e13311c1327 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:53.414877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 21:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:53.420097 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2f7dc-f245-4e07-b56d-2df3cde19d80 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:53.420563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2f7dc-f245-4e07-b56d-2df3cde19d80 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:53.420677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2f7dc-f245-4e07-b56d-2df3cde19d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:53.509984 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-69d2f7dc-f245-4e07-b56d-2df3cde19d80 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:53.511490 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-69d2f7dc-f245-4e07-b56d-2df3cde19d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:53.539829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:53.609894 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 21:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:53.766097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523079ef-233f-4e28-bf40-8e13311c1327 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:53.768921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-523079ef-233f-4e28-bf40-8e13311c1327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:53.938582 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523079ef-233f-4e28-bf40-8e13311c1327 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:53.983827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:54.060280 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9a02-b68e-40ec-9f32-d6fb80a73880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:54.060890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9a02-b68e-40ec-9f32-d6fb80a73880 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:54.061170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9a02-b68e-40ec-9f32-d6fb80a73880 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:54.061444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9a02-b68e-40ec-9f32-d6fb80a73880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:54.063109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c14e9a02-b68e-40ec-9f32-d6fb80a73880 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:54.173361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e9a02-b68e-40ec-9f32-d6fb80a73880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:54.175014 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e9a02-b68e-40ec-9f32-d6fb80a73880 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:54.194925 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 706/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:00:55.189765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be9ba8-0c92-4c24-8284-8d384f0a60aa None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:55.190579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be9ba8-0c92-4c24-8284-8d384f0a60aa None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:55.190579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be9ba8-0c92-4c24-8284-8d384f0a60aa None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:55.191746 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 21:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 21:00:55.198049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ae385-2f46-4599-b35e-825dcd216953 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:55.198619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ae385-2f46-4599-b35e-825dcd216953 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:55.198619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ae385-2f46-4599-b35e-825dcd216953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:55.260815 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:55.288877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-aa5ae385-2f46-4599-b35e-825dcd216953 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:55.290135 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-aa5ae385-2f46-4599-b35e-825dcd216953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:55.400355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:00:55.555483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be9ba8-0c92-4c24-8284-8d384f0a60aa None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:55.556940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-00be9ba8-0c92-4c24-8284-8d384f0a60aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:55.741955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be9ba8-0c92-4c24-8284-8d384f0a60aa None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:55.756081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:55.877745 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cca978-0552-4d22-85c3-8ae163b3fec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:55.878267 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cca978-0552-4d22-85c3-8ae163b3fec8 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:55.878546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cca978-0552-4d22-85c3-8ae163b3fec8 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:55.878844 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cca978-0552-4d22-85c3-8ae163b3fec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:55.881635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-44cca978-0552-4d22-85c3-8ae163b3fec8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:55.983580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cca978-0552-4d22-85c3-8ae163b3fec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:55.985181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cca978-0552-4d22-85c3-8ae163b3fec8 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:56.006281 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 715/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:00:56.928264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7778c-ffe0-4941-b6bc-1368e6c3cffd None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:56.928866 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7778c-ffe0-4941-b6bc-1368e6c3cffd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:56.929255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7778c-ffe0-4941-b6bc-1368e6c3cffd None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:56.931859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 21:00:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:56.937273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021ce31-b3f9-4b95-875f-cd68bd070b97 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:56.937803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021ce31-b3f9-4b95-875f-cd68bd070b97 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:56.937803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021ce31-b3f9-4b95-875f-cd68bd070b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:56.960260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:57.027340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-5021ce31-b3f9-4b95-875f-cd68bd070b97 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:57.028557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5021ce31-b3f9-4b95-875f-cd68bd070b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:57.152775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 21:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:57.310282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7778c-ffe0-4941-b6bc-1368e6c3cffd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:57.311942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-52a7778c-ffe0-4941-b6bc-1368e6c3cffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:57.444488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:57.491665 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7778c-ffe0-4941-b6bc-1368e6c3cffd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:57.642080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cd73f-0749-4e08-9737-aaea569ff4c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:57.642703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cd73f-0749-4e08-9737-aaea569ff4c0 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:57.643020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cd73f-0749-4e08-9737-aaea569ff4c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:57.643296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cd73f-0749-4e08-9737-aaea569ff4c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:57.644981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1a4cd73f-0749-4e08-9737-aaea569ff4c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:57.734961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:57.754197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cd73f-0749-4e08-9737-aaea569ff4c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:57.756629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cd73f-0749-4e08-9737-aaea569ff4c0 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:57.784663 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 709/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:00:58.717938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d272606-99af-4f1c-b00e-59116731f8f7 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:58.718615 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d272606-99af-4f1c-b00e-59116731f8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:58.719021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d272606-99af-4f1c-b00e-59116731f8f7 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:58.721643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 21:00:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:00:58.728944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a60f-6958-4fd6-83bd-6d3d7b9070cc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:58.729823 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a60f-6958-4fd6-83bd-6d3d7b9070cc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:58.730006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a60f-6958-4fd6-83bd-6d3d7b9070cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:58.840138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b9c6a60f-6958-4fd6-83bd-6d3d7b9070cc None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:00:58.841453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b9c6a60f-6958-4fd6-83bd-6d3d7b9070cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:59.017337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:00:59.226777 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d272606-99af-4f1c-b00e-59116731f8f7 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:00:59.228394 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9d272606-99af-4f1c-b00e-59116731f8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:59.362532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:59.452489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d272606-99af-4f1c-b00e-59116731f8f7 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:00:59.612867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6aa7e-fc80-45f8-845a-bdcaaf27ea79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:00:59.614649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6aa7e-fc80-45f8-845a-bdcaaf27ea79 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:00:59.614649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6aa7e-fc80-45f8-845a-bdcaaf27ea79 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:00:59.614649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6aa7e-fc80-45f8-845a-bdcaaf27ea79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:00:59.615994 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3fa6aa7e-fc80-45f8-845a-bdcaaf27ea79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:00:59.699673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:00:59.769148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6aa7e-fc80-45f8-845a-bdcaaf27ea79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:00:59.773188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6aa7e-fc80-45f8-845a-bdcaaf27ea79 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:00:59.807462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 718/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:00.667844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25efc1-4a22-4a66-98b3-9f650e3a29c8 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:00.668477 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25efc1-4a22-4a66-98b3-9f650e3a29c8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:00.668477 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25efc1-4a22-4a66-98b3-9f650e3a29c8 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:00.669834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 21:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 21:01:00.677954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1ac44-787f-469a-9fa5-10284fbbdf51 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:00.678331 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1ac44-787f-469a-9fa5-10284fbbdf51 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:00.678661 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1ac44-787f-469a-9fa5-10284fbbdf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:00.777478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-67d1ac44-787f-469a-9fa5-10284fbbdf51 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:00.778713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-67d1ac44-787f-469a-9fa5-10284fbbdf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:00.892644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:01.048013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25efc1-4a22-4a66-98b3-9f650e3a29c8 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:01.049552 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cb25efc1-4a22-4a66-98b3-9f650e3a29c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:01.105920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:01.222634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25efc1-4a22-4a66-98b3-9f650e3a29c8 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:01.358542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400dde5-e4a3-464f-8772-a277e12897ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:01.359562 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400dde5-e4a3-464f-8772-a277e12897ea service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:01.360073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400dde5-e4a3-464f-8772-a277e12897ea service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:01.360546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400dde5-e4a3-464f-8772-a277e12897ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:01.363141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9400dde5-e4a3-464f-8772-a277e12897ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:01.374336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:01.480221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400dde5-e4a3-464f-8772-a277e12897ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:01.481772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400dde5-e4a3-464f-8772-a277e12897ea service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:01.501521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 712/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:02.357403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a9de6-7808-47b0-b1d0-d0a5358ebdec None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:02.357988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a9de6-7808-47b0-b1d0-d0a5358ebdec None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:02.357988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a9de6-7808-47b0-b1d0-d0a5358ebdec None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:02.359360 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 21:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:02.365451 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dbde4-ce87-444c-8f32-86d96c41ffc0 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:02.365901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dbde4-ce87-444c-8f32-86d96c41ffc0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:02.366018 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dbde4-ce87-444c-8f32-86d96c41ffc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:02.447884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ff7dbde4-ce87-444c-8f32-86d96c41ffc0 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:02.449405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ff7dbde4-ce87-444c-8f32-86d96c41ffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:02.529069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:02.561882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 21:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:02.715975 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a9de6-7808-47b0-b1d0-d0a5358ebdec None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:02.717500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cb4a9de6-7808-47b0-b1d0-d0a5358ebdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:02.736602 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:02.882602 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a9de6-7808-47b0-b1d0-d0a5358ebdec None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:02.975730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:03.002556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e3bfe-a1b4-4c46-bb10-44af76e7688c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:03.003207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e3bfe-a1b4-4c46-bb10-44af76e7688c service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:03.003475 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e3bfe-a1b4-4c46-bb10-44af76e7688c service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:03.003747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e3bfe-a1b4-4c46-bb10-44af76e7688c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:03.005414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8f4e3bfe-a1b4-4c46-bb10-44af76e7688c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:03.095866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e3bfe-a1b4-4c46-bb10-44af76e7688c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:03.097498 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e3bfe-a1b4-4c46-bb10-44af76e7688c service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:03.119590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 721/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:03.961465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca950cbc-316b-45d9-8eae-d60b618dfe1f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:03.962072 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca950cbc-316b-45d9-8eae-d60b618dfe1f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:03.962178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca950cbc-316b-45d9-8eae-d60b618dfe1f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:03.963586 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 21:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:03.970433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096d920-92e1-455e-adbe-de0c36c24ea8 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:03.971020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096d920-92e1-455e-adbe-de0c36c24ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:03.971207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096d920-92e1-455e-adbe-de0c36c24ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:04.060552 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7096d920-92e1-455e-adbe-de0c36c24ea8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:04.061725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7096d920-92e1-455e-adbe-de0c36c24ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:04.113474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:04.181824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:04.336334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca950cbc-316b-45d9-8eae-d60b618dfe1f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:04.337885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ca950cbc-316b-45d9-8eae-d60b618dfe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:04.498366 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca950cbc-316b-45d9-8eae-d60b618dfe1f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:04.563315 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:04.652025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be1244-ab1a-4099-a251-a684af1b08f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:04.652653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be1244-ab1a-4099-a251-a684af1b08f0 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:04.652936 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be1244-ab1a-4099-a251-a684af1b08f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:04.653215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be1244-ab1a-4099-a251-a684af1b08f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:04.654910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b6be1244-ab1a-4099-a251-a684af1b08f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:04.774976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be1244-ab1a-4099-a251-a684af1b08f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:04.777214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be1244-ab1a-4099-a251-a684af1b08f0 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:04.799906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 715/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:05.628763 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123c31d-66ea-440e-8e7b-f122163c8831 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:05.629971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123c31d-66ea-440e-8e7b-f122163c8831 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:05.629971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123c31d-66ea-440e-8e7b-f122163c8831 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:05.631356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 21:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:05.636562 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837a138-5954-4cc7-b95c-2f832eb1abc5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:05.637000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837a138-5954-4cc7-b95c-2f832eb1abc5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:05.637116 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837a138-5954-4cc7-b95c-2f832eb1abc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:05.715802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5837a138-5954-4cc7-b95c-2f832eb1abc5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:05.717042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5837a138-5954-4cc7-b95c-2f832eb1abc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:05.719195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:05.830528 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 21:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:05.987882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123c31d-66ea-440e-8e7b-f122163c8831 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:05.990038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4123c31d-66ea-440e-8e7b-f122163c8831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:06.181714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123c31d-66ea-440e-8e7b-f122163c8831 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:06.231652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:06.328419 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b678283-f881-4760-a37e-091c40e38f73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:06.329096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b678283-f881-4760-a37e-091c40e38f73 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:06.329474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b678283-f881-4760-a37e-091c40e38f73 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:06.329838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b678283-f881-4760-a37e-091c40e38f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:06.331721 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4b678283-f881-4760-a37e-091c40e38f73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:06.461267 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b678283-f881-4760-a37e-091c40e38f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:06.464410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b678283-f881-4760-a37e-091c40e38f73 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:06.498916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 724/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:08.400738 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ebdcb-6c6c-4701-b246-f0c9402f5869 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:08.401325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ebdcb-6c6c-4701-b246-f0c9402f5869 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:08.401325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ebdcb-6c6c-4701-b246-f0c9402f5869 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:08.402630 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:08.408369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc23f7-afa7-4c1c-9fcb-4f44d55594bd None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:08.408924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc23f7-afa7-4c1c-9fcb-4f44d55594bd None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:08.408924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc23f7-afa7-4c1c-9fcb-4f44d55594bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:08.453540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:08.481733 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-6ddc23f7-afa7-4c1c-9fcb-4f44d55594bd None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:08.483020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6ddc23f7-afa7-4c1c-9fcb-4f44d55594bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:08.589926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:08.886689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ebdcb-6c6c-4701-b246-f0c9402f5869 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:08.888314 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-176ebdcb-6c6c-4701-b246-f0c9402f5869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:09.053142 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ebdcb-6c6c-4701-b246-f0c9402f5869 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:09.087583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:09.133241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee498ea6-a761-42ac-9f36-05a5529ccb76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:09.134067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee498ea6-a761-42ac-9f36-05a5529ccb76 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:09.134566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee498ea6-a761-42ac-9f36-05a5529ccb76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:09.135019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee498ea6-a761-42ac-9f36-05a5529ccb76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:09.137379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ee498ea6-a761-42ac-9f36-05a5529ccb76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:09.267789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee498ea6-a761-42ac-9f36-05a5529ccb76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:09.269244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee498ea6-a761-42ac-9f36-05a5529ccb76 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:09.293694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 718/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:11.460923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c247-c65b-4f0f-b674-69f6c6072180 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:11.461465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c247-c65b-4f0f-b674-69f6c6072180 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:11.461465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c247-c65b-4f0f-b674-69f6c6072180 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:11.462841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:11.468341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daee3ac-bad8-4f4d-a16d-bcc7148bcfbd None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:11.468752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daee3ac-bad8-4f4d-a16d-bcc7148bcfbd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:11.468892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daee3ac-bad8-4f4d-a16d-bcc7148bcfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:11.538245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7daee3ac-bad8-4f4d-a16d-bcc7148bcfbd None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:11.539551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7daee3ac-bad8-4f4d-a16d-bcc7148bcfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:11.553767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:11.645825 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:11.939485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7c247-c65b-4f0f-b674-69f6c6072180 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:11.941017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-83e7c247-c65b-4f0f-b674-69f6c6072180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:12.054852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7c247-c65b-4f0f-b674-69f6c6072180 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:12.067369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:12.135706 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed4f68-45f4-41ca-b07b-5b1c055feb4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:12.136586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed4f68-45f4-41ca-b07b-5b1c055feb4f service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:12.136868 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed4f68-45f4-41ca-b07b-5b1c055feb4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:12.137142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed4f68-45f4-41ca-b07b-5b1c055feb4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:12.138807 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-efed4f68-45f4-41ca-b07b-5b1c055feb4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:12.267338 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed4f68-45f4-41ca-b07b-5b1c055feb4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:12.269461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed4f68-45f4-41ca-b07b-5b1c055feb4f service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:12.291294 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 727/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:14.705303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417576-fac4-4e78-90dd-bf472aca8339 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:14.705921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417576-fac4-4e78-90dd-bf472aca8339 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:14.706031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417576-fac4-4e78-90dd-bf472aca8339 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:14.707728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:14.714170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1cf0-2d1a-4600-820b-6dc6d3ac4866 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:14.714841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1cf0-2d1a-4600-820b-6dc6d3ac4866 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:14.714841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1cf0-2d1a-4600-820b-6dc6d3ac4866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:14.770373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:14.792524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-517a1cf0-2d1a-4600-820b-6dc6d3ac4866 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:14.793732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-517a1cf0-2d1a-4600-820b-6dc6d3ac4866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:14.909402 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:15.203296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417576-fac4-4e78-90dd-bf472aca8339 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:15.204950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f3417576-fac4-4e78-90dd-bf472aca8339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:15.330258 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417576-fac4-4e78-90dd-bf472aca8339 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:15.376730 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:15.416774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4313c3-43c0-4d54-b2e5-1b054a3a3a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:15.417387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4313c3-43c0-4d54-b2e5-1b054a3a3a50 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:15.417671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4313c3-43c0-4d54-b2e5-1b054a3a3a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:15.417937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4313c3-43c0-4d54-b2e5-1b054a3a3a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:15.419616 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5e4313c3-43c0-4d54-b2e5-1b054a3a3a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:15.552676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4313c3-43c0-4d54-b2e5-1b054a3a3a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:15.554029 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4313c3-43c0-4d54-b2e5-1b054a3a3a50 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:15.574693 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 721/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:17.744968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf2827-d48e-4441-b713-21f983ac2308 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:17.745550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf2827-d48e-4441-b713-21f983ac2308 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:17.745550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf2827-d48e-4441-b713-21f983ac2308 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:17.746909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:17.752534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac409-9d7a-40f3-b797-4fa01fc6aa7c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:17.753272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac409-9d7a-40f3-b797-4fa01fc6aa7c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:17.753272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac409-9d7a-40f3-b797-4fa01fc6aa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:17.827293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f7bac409-9d7a-40f3-b797-4fa01fc6aa7c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:17.828556 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f7bac409-9d7a-40f3-b797-4fa01fc6aa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:17.851605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:17.944954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:18.245207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf2827-d48e-4441-b713-21f983ac2308 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:18.246824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9fdf2827-d48e-4441-b713-21f983ac2308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:18.359646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf2827-d48e-4441-b713-21f983ac2308 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:18.381878 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:18.443381 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d76d62-8fdc-45a6-824f-6b6e88149f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:18.443997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d76d62-8fdc-45a6-824f-6b6e88149f9e service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:18.444284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d76d62-8fdc-45a6-824f-6b6e88149f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:18.444562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d76d62-8fdc-45a6-824f-6b6e88149f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:18.446229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-45d76d62-8fdc-45a6-824f-6b6e88149f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:18.570397 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d76d62-8fdc-45a6-824f-6b6e88149f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:18.572081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d76d62-8fdc-45a6-824f-6b6e88149f9e service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:18.591442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 730/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:01:20.668084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b343-5287-4cfa-b82a-9bf6ff8db322 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:20.668663 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b343-5287-4cfa-b82a-9bf6ff8db322 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:20.668663 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b343-5287-4cfa-b82a-9bf6ff8db322 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:20.670316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:20.676051 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d2133-76b6-4a56-938d-0ce777908ee4 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:20.676860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d2133-76b6-4a56-938d-0ce777908ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:20.676860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d2133-76b6-4a56-938d-0ce777908ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:20.741767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:20.746043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ab8d2133-76b6-4a56-938d-0ce777908ee4 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:20.747572 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ab8d2133-76b6-4a56-938d-0ce777908ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:20.852722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:21.145791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80b343-5287-4cfa-b82a-9bf6ff8db322 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:21.147420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ae80b343-5287-4cfa-b82a-9bf6ff8db322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:21.260679 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80b343-5287-4cfa-b82a-9bf6ff8db322 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:21.316274 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:21.352279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cf92e-9975-4070-978f-8ae347bf1b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:21.352988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cf92e-9975-4070-978f-8ae347bf1b3a service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:21.353335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cf92e-9975-4070-978f-8ae347bf1b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:21.353670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cf92e-9975-4070-978f-8ae347bf1b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:21.355545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-aa2cf92e-9975-4070-978f-8ae347bf1b3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:21.479846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cf92e-9975-4070-978f-8ae347bf1b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:21.481302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cf92e-9975-4070-978f-8ae347bf1b3a service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:21.505895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 724/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:23.593091 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a7984-8f2e-443f-8d45-28105e6ed7db None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:23.593609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a7984-8f2e-443f-8d45-28105e6ed7db None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:23.593609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a7984-8f2e-443f-8d45-28105e6ed7db None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:23.594982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:23.601403 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040de862-1866-4c73-9b89-5f7e8b96e4dc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:23.601934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040de862-1866-4c73-9b89-5f7e8b96e4dc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:23.601934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040de862-1866-4c73-9b89-5f7e8b96e4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:23.675067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-040de862-1866-4c73-9b89-5f7e8b96e4dc None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:23.676997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-040de862-1866-4c73-9b89-5f7e8b96e4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:23.708726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:23.782889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:24.072023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a7984-8f2e-443f-8d45-28105e6ed7db None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:24.073563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-077a7984-8f2e-443f-8d45-28105e6ed7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:24.193789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a7984-8f2e-443f-8d45-28105e6ed7db None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:24.230781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:24.280079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04c6bf-81ee-4c45-9d50-cf55a35e8fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:24.280684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c6bf-81ee-4c45-9d50-cf55a35e8fdd service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:24.280965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c6bf-81ee-4c45-9d50-cf55a35e8fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:24.281239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c6bf-81ee-4c45-9d50-cf55a35e8fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:24.282899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ba04c6bf-81ee-4c45-9d50-cf55a35e8fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:24.408214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04c6bf-81ee-4c45-9d50-cf55a35e8fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:24.409629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04c6bf-81ee-4c45-9d50-cf55a35e8fdd service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:24.428742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 733/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:26.489017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6a1e-003d-4c07-b7b1-fc6c311db6be None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:26.489891 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6a1e-003d-4c07-b7b1-fc6c311db6be None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:26.489891 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6a1e-003d-4c07-b7b1-fc6c311db6be None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:26.491137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:26.499217 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbb467-98c8-4734-a22b-bf7f4eeb26ef None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:26.499760 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbb467-98c8-4734-a22b-bf7f4eeb26ef None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:26.499760 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbb467-98c8-4734-a22b-bf7f4eeb26ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:26.572013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-4abbb467-98c8-4734-a22b-bf7f4eeb26ef None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:26.573129 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4abbb467-98c8-4734-a22b-bf7f4eeb26ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:26.581872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:26.680340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:26.969345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a6a1e-003d-4c07-b7b1-fc6c311db6be None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:26.970919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-480a6a1e-003d-4c07-b7b1-fc6c311db6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:27.087074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a6a1e-003d-4c07-b7b1-fc6c311db6be None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:27.153131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:27.175997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21590e87-cc4c-4185-bab1-821d498e53a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:27.176652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21590e87-cc4c-4185-bab1-821d498e53a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:27.176930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21590e87-cc4c-4185-bab1-821d498e53a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:27.177202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21590e87-cc4c-4185-bab1-821d498e53a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:27.178864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-21590e87-cc4c-4185-bab1-821d498e53a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:27.299548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21590e87-cc4c-4185-bab1-821d498e53a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:27.301186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21590e87-cc4c-4185-bab1-821d498e53a4 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:27.322479 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 727/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:01:29.726534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a5620-8826-40f8-a846-324bed3db77c None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:29.727207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a5620-8826-40f8-a846-324bed3db77c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:29.727207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a5620-8826-40f8-a846-324bed3db77c None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:29.728551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:29.734774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3654d-dea9-4817-814f-38e0d44c722d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:29.735411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3654d-dea9-4817-814f-38e0d44c722d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:29.735411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3654d-dea9-4817-814f-38e0d44c722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:29.813827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-64c3654d-dea9-4817-814f-38e0d44c722d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:29.815131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-64c3654d-dea9-4817-814f-38e0d44c722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:29.860045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:29.922320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:30.216767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a5620-8826-40f8-a846-324bed3db77c None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:30.218346 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-fa5a5620-8826-40f8-a846-324bed3db77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:30.329136 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a5620-8826-40f8-a846-324bed3db77c None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:30.367814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:30.406190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f8496-465e-47f8-9fd5-b6683681b21c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:30.406826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f8496-465e-47f8-9fd5-b6683681b21c service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:30.407114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f8496-465e-47f8-9fd5-b6683681b21c service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:30.407392 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f8496-465e-47f8-9fd5-b6683681b21c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:30.409002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ff3f8496-465e-47f8-9fd5-b6683681b21c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:30.520741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f8496-465e-47f8-9fd5-b6683681b21c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:30.522086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f8496-465e-47f8-9fd5-b6683681b21c service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:30.542079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 736/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:32.564054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420eccf-c465-41f9-af0d-d9636f61e925 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:32.564672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420eccf-c465-41f9-af0d-d9636f61e925 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:32.564672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420eccf-c465-41f9-af0d-d9636f61e925 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:32.565956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 21:01:32.572308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcffd6-c66a-47a4-a487-f47d8f059590 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:32.572929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcffd6-c66a-47a4-a487-f47d8f059590 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:32.572929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcffd6-c66a-47a4-a487-f47d8f059590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:32.653218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-8dbcffd6-c66a-47a4-a487-f47d8f059590 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:32.654508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8dbcffd6-c66a-47a4-a487-f47d8f059590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:32.678896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:32.780547 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:33.068292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420eccf-c465-41f9-af0d-d9636f61e925 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:33.069849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c420eccf-c465-41f9-af0d-d9636f61e925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:33.182123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420eccf-c465-41f9-af0d-d9636f61e925 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:33.254804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:33.263010 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97c9b-3b5a-4b41-959f-e5e76bf6c4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:33.263628 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97c9b-3b5a-4b41-959f-e5e76bf6c4fa service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:33.263909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97c9b-3b5a-4b41-959f-e5e76bf6c4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:33.264183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97c9b-3b5a-4b41-959f-e5e76bf6c4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:33.265841 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-59f97c9b-3b5a-4b41-959f-e5e76bf6c4fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:33.381107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f97c9b-3b5a-4b41-959f-e5e76bf6c4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:33.382553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f97c9b-3b5a-4b41-959f-e5e76bf6c4fa service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:33.402055 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 730/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:35.411793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9fd91-adb1-4cb0-8bf6-ce5ca64165ce None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:35.412377 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9fd91-adb1-4cb0-8bf6-ce5ca64165ce None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:35.412377 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9fd91-adb1-4cb0-8bf6-ce5ca64165ce None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:35.413738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:35.419943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3d7d2-54d3-46cc-bdee-7ad2e638dd5a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:35.420515 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3d7d2-54d3-46cc-bdee-7ad2e638dd5a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:35.420515 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3d7d2-54d3-46cc-bdee-7ad2e638dd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:35.503883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4df3d7d2-54d3-46cc-bdee-7ad2e638dd5a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:35.505130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4df3d7d2-54d3-46cc-bdee-7ad2e638dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:35.560998 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:35.620024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:35.926912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9fd91-adb1-4cb0-8bf6-ce5ca64165ce None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:35.928503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4de9fd91-adb1-4cb0-8bf6-ce5ca64165ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:36.048201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9fd91-adb1-4cb0-8bf6-ce5ca64165ce None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:36.109064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:36.141222 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252f8ac-e38f-462f-9a07-5d2a273edfe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:36.141834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252f8ac-e38f-462f-9a07-5d2a273edfe4 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:36.142113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252f8ac-e38f-462f-9a07-5d2a273edfe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:36.142410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252f8ac-e38f-462f-9a07-5d2a273edfe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:36.144064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6252f8ac-e38f-462f-9a07-5d2a273edfe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:36.292001 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252f8ac-e38f-462f-9a07-5d2a273edfe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:36.294559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252f8ac-e38f-462f-9a07-5d2a273edfe4 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:36.329056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 739/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:45.617951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=22 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:46.324972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=66 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:56.707701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae078b-1fbf-4113-a750-b3dda2e8ce34 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:56.708303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae078b-1fbf-4113-a750-b3dda2e8ce34 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:56.708303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae078b-1fbf-4113-a750-b3dda2e8ce34 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:56.709600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 732/1471] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:56.715968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6da4c-1a2a-4d57-815f-b95314c3156c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:56.716444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6da4c-1a2a-4d57-815f-b95314c3156c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:56.716535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6da4c-1a2a-4d57-815f-b95314c3156c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:56.784692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-78f6da4c-1a2a-4d57-815f-b95314c3156c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:56.785921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-78f6da4c-1a2a-4d57-815f-b95314c3156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:56.887166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 740/1472] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:57.194393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d5698-33a8-4fac-8f89-5343f653ff5a None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:57.194676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d5698-33a8-4fac-8f89-5343f653ff5a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:57.194991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d5698-33a8-4fac-8f89-5343f653ff5a None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:57.196351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 733/1473] 10.222.0.17 () {54 vars in 967 bytes} [Fri Aug 19 21:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:57.201850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd208384-90c8-4f4f-a88b-30ee82a09b20 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:57.202234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd208384-90c8-4f4f-a88b-30ee82a09b20 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:57.203002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd208384-90c8-4f4f-a88b-30ee82a09b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:57.288718 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-dd208384-90c8-4f4f-a88b-30ee82a09b20 None None] MFA Rules not processed for user `51e6b105e7094aea9dcc7423d6205c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:57.289992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-dd208384-90c8-4f4f-a88b-30ee82a09b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:57.312097 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:57.372474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 741/1474] 10.222.0.17 () {58 vars in 1064 bytes} [Fri Aug 19 21:01:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:01:57.380675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d5698-33a8-4fac-8f89-5343f653ff5a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:01:57.382239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f99d5698-33a8-4fac-8f89-5343f653ff5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:57.492316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d5698-33a8-4fac-8f89-5343f653ff5a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:01:57.571834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdf013-439d-4f58-be02-53b8ad4a4db3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b105e7094aea9dcc7423d6205c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:01:57.572748 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf013-439d-4f58-be02-53b8ad4a4db3 service glance] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:57.573064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf013-439d-4f58-be02-53b8ad4a4db3 service glance] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:57.573349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf013-439d-4f58-be02-53b8ad4a4db3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:57.575006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-01cdf013-439d-4f58-be02-53b8ad4a4db3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:01:57.631954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:57.692370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdf013-439d-4f58-be02-53b8ad4a4db3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:01:57.693861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdf013-439d-4f58-be02-53b8ad4a4db3 service glance] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:01:57.713633 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 734/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:01:59.805284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fcb3d-9f4e-43b1-a5f2-19a21cb192be None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:59.805905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fcb3d-9f4e-43b1-a5f2-19a21cb192be None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:59.805905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fcb3d-9f4e-43b1-a5f2-19a21cb192be None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:59.808294 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 742/1476] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:01:59.814096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121457c-469d-4a44-bd0a-a3e6f1936f58 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:01:59.814653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121457c-469d-4a44-bd0a-a3e6f1936f58 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:01:59.814653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121457c-469d-4a44-bd0a-a3e6f1936f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:01:59.889322 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2121457c-469d-4a44-bd0a-a3e6f1936f58 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:01:59.890563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2121457c-469d-4a44-bd0a-a3e6f1936f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:00.036119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 735/1477] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:02:00.344576 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fcb3d-9f4e-43b1-a5f2-19a21cb192be None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:02:00.346040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3f7fcb3d-9f4e-43b1-a5f2-19a21cb192be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:00.475109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fcb3d-9f4e-43b1-a5f2-19a21cb192be None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:02:00.525485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:02:00.571878 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd0e47-8777-451d-9d49-34f0862cffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:02:00.572486 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0e47-8777-451d-9d49-34f0862cffd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:00.572769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0e47-8777-451d-9d49-34f0862cffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:00.573044 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0e47-8777-451d-9d49-34f0862cffd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:00.573686 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd0e47-8777-451d-9d49-34f0862cffd8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:02:00.575532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: WARNING py.warnings [None req-6cbd0e47-8777-451d-9d49-34f0862cffd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:02:00.575532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: warnings.warn(msg) Aug 19 21:02:00.575532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: Aug 19 21:02:00.576678 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd0e47-8777-451d-9d49-34f0862cffd8 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:02:00.596249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 743/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Aug 19 21:02:00 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:02:02.573733 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458c563-a5ff-469f-a556-8ec25debe7c9 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:02.574324 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458c563-a5ff-469f-a556-8ec25debe7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:02.574324 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458c563-a5ff-469f-a556-8ec25debe7c9 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:02.575700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 736/1479] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:02:02.581106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d592cc-b1b4-49f3-b9ee-1f21d631bdd1 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:02.581599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d592cc-b1b4-49f3-b9ee-1f21d631bdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:02.582016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d592cc-b1b4-49f3-b9ee-1f21d631bdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:02.649098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-19d592cc-b1b4-49f3-b9ee-1f21d631bdd1 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:02:02.650333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-19d592cc-b1b4-49f3-b9ee-1f21d631bdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:02.750226 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 744/1480] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:02:03.047282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458c563-a5ff-469f-a556-8ec25debe7c9 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:02:03.048850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8458c563-a5ff-469f-a556-8ec25debe7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:03.059224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:02:03.204165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458c563-a5ff-469f-a556-8ec25debe7c9 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:02:03.288957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:02:03.323508 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478f21c-d8a7-4069-bbad-3f473427ba69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:02:03.324139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478f21c-d8a7-4069-bbad-3f473427ba69 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:03.324423 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478f21c-d8a7-4069-bbad-3f473427ba69 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:03.324702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478f21c-d8a7-4069-bbad-3f473427ba69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:03.326337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7478f21c-d8a7-4069-bbad-3f473427ba69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:03.421550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478f21c-d8a7-4069-bbad-3f473427ba69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:02:03.423209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478f21c-d8a7-4069-bbad-3f473427ba69 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:02:03.442277 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 737/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:02:05.590289 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae516cd-57d2-4209-8f85-075a98286751 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:05.590861 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae516cd-57d2-4209-8f85-075a98286751 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:05.590861 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae516cd-57d2-4209-8f85-075a98286751 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:05.592222 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 745/1482] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:02:05.598067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2bf44-4dd0-4c98-bdee-71d629185f48 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:05.598551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2bf44-4dd0-4c98-bdee-71d629185f48 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:05.598661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2bf44-4dd0-4c98-bdee-71d629185f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:05.666691 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-25b2bf44-4dd0-4c98-bdee-71d629185f48 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:02:05.668043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-25b2bf44-4dd0-4c98-bdee-71d629185f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:05.716137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:02:05.779238 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 738/1483] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:02:06.069877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae516cd-57d2-4209-8f85-075a98286751 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:02:06.071424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-fae516cd-57d2-4209-8f85-075a98286751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:06.095946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:02:06.181455 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae516cd-57d2-4209-8f85-075a98286751 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:02:06.258713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8fb40-8f16-4f43-823f-30b297f3f166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:02:06.259292 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8fb40-8f16-4f43-823f-30b297f3f166 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:06.259579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8fb40-8f16-4f43-823f-30b297f3f166 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:06.259969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8fb40-8f16-4f43-823f-30b297f3f166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:06.266697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4db8fb40-8f16-4f43-823f-30b297f3f166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:06.346435 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:02:06.388796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8fb40-8f16-4f43-823f-30b297f3f166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:02:06.390225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8fb40-8f16-4f43-823f-30b297f3f166 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:02:06.410786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 746/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:02:08.417754 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fbc0d-1963-4a92-bcb9-eecff3f3927f None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:08.418355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fbc0d-1963-4a92-bcb9-eecff3f3927f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:08.418355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fbc0d-1963-4a92-bcb9-eecff3f3927f None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:08.419781 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 739/1485] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:02:08.425338 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a81424-ceeb-45ca-a025-9f692a8b1c1b None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:08.425836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a81424-ceeb-45ca-a025-9f692a8b1c1b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:08.425936 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a81424-ceeb-45ca-a025-9f692a8b1c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:08.494693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-65a81424-ceeb-45ca-a025-9f692a8b1c1b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:02:08.495964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-65a81424-ceeb-45ca-a025-9f692a8b1c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:08.601951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 747/1486] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:02:08.898385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fbc0d-1963-4a92-bcb9-eecff3f3927f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:02:08.900047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-509fbc0d-1963-4a92-bcb9-eecff3f3927f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:09.007830 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fbc0d-1963-4a92-bcb9-eecff3f3927f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:02:09.084303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:02:09.086169 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8783ff6-6424-4003-bb81-da5f934fd266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:02:09.086856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8783ff6-6424-4003-bb81-da5f934fd266 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:09.087183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8783ff6-6424-4003-bb81-da5f934fd266 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:09.087643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8783ff6-6424-4003-bb81-da5f934fd266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:09.089708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b8783ff6-6424-4003-bb81-da5f934fd266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:09.205494 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8783ff6-6424-4003-bb81-da5f934fd266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:02:09.207804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8783ff6-6424-4003-bb81-da5f934fd266 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:02:09.227209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 740/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:02:11.431439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2381bd2-cc7c-47b1-95cd-0e565f846257 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:11.432015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2381bd2-cc7c-47b1-95cd-0e565f846257 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:11.432015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2381bd2-cc7c-47b1-95cd-0e565f846257 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:11.433364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 748/1488] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:02:11.438629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fd435-6ed1-496e-8db8-eba24af1a606 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:11.439147 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fd435-6ed1-496e-8db8-eba24af1a606 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:11.439253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fd435-6ed1-496e-8db8-eba24af1a606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:11.507068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-085fd435-6ed1-496e-8db8-eba24af1a606 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:02:11.508308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-085fd435-6ed1-496e-8db8-eba24af1a606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:11.563888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:02:11.611355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 741/1489] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:02:11.911132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2381bd2-cc7c-47b1-95cd-0e565f846257 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:02:11.912674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b2381bd2-cc7c-47b1-95cd-0e565f846257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:11.949893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:02:12.023814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2381bd2-cc7c-47b1-95cd-0e565f846257 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:02:12.099100 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee380d1-8120-4ca9-875a-3d3da2a5d514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:02:12.099729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee380d1-8120-4ca9-875a-3d3da2a5d514 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:12.100012 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee380d1-8120-4ca9-875a-3d3da2a5d514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:12.100290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee380d1-8120-4ca9-875a-3d3da2a5d514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:12.101967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8ee380d1-8120-4ca9-875a-3d3da2a5d514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:12.185480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:02:12.215336 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee380d1-8120-4ca9-875a-3d3da2a5d514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:02:12.216786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee380d1-8120-4ca9-875a-3d3da2a5d514 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:02:12.235858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 749/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:02:14.379901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a8841-4325-4149-9e6f-f3a9190979d0 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:14.380485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a8841-4325-4149-9e6f-f3a9190979d0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:14.380485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a8841-4325-4149-9e6f-f3a9190979d0 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:14.381793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 742/1491] 10.222.0.17 () {54 vars in 927 bytes} [Fri Aug 19 21:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:02:14.387323 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeecfd2-e85f-41a7-b77b-2fbb860c5356 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:14.387750 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeecfd2-e85f-41a7-b77b-2fbb860c5356 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:14.387854 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeecfd2-e85f-41a7-b77b-2fbb860c5356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:14.454804 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-eaeecfd2-e85f-41a7-b77b-2fbb860c5356 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:02:14.456533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-eaeecfd2-e85f-41a7-b77b-2fbb860c5356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:14.555865 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 750/1492] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Aug 19 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:02:14.854185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a8841-4325-4149-9e6f-f3a9190979d0 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:02:14.855779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4a2a8841-4325-4149-9e6f-f3a9190979d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:14.964043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a8841-4325-4149-9e6f-f3a9190979d0 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:02:15.039037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f95389-2108-4860-a8c6-a4ae85386f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:02:15.039565 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95389-2108-4860-a8c6-a4ae85386f49 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:02:15.039844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95389-2108-4860-a8c6-a4ae85386f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:02:15.040123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95389-2108-4860-a8c6-a4ae85386f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:02:15.041757 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-21f95389-2108-4860-a8c6-a4ae85386f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:02:15.052032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:02:15.165983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f95389-2108-4860-a8c6-a4ae85386f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:02:15.167500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f95389-2108-4860-a8c6-a4ae85386f49 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:02:15.186450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 743/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:02:24.553902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=82 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:02:25.184099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=50 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:35.189175 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46b924-ad82-40ed-8325-7b4cfb1c28e3 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:35.189786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46b924-ad82-40ed-8325-7b4cfb1c28e3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:35.189786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46b924-ad82-40ed-8325-7b4cfb1c28e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:35.265701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-db46b924-ad82-40ed-8325-7b4cfb1c28e3 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:03:35.266958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-db46b924-ad82-40ed-8325-7b4cfb1c28e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:35.367047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 751/1494] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:03:35.375156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95bd5e-180e-4cfb-876e-15844c23d378 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:35.375710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95bd5e-180e-4cfb-876e-15844c23d378 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:35.375710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95bd5e-180e-4cfb-876e-15844c23d378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:35.574972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5d95bd5e-180e-4cfb-876e-15844c23d378 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:03:35.576091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5d95bd5e-180e-4cfb-876e-15844c23d378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:35.674462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 744/1495] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:03:35.679315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46b924-ad82-40ed-8325-7b4cfb1c28e3 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:03:35.680598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-db46b924-ad82-40ed-8325-7b4cfb1c28e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:35.694232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46b924-ad82-40ed-8325-7b4cfb1c28e3 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:03:35.758936 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:35.794704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865076c-4a27-4acb-9dd1-efce232b3954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:03:35.795368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865076c-4a27-4acb-9dd1-efce232b3954 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:35.795643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865076c-4a27-4acb-9dd1-efce232b3954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:35.795901 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865076c-4a27-4acb-9dd1-efce232b3954 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:35.796549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865076c-4a27-4acb-9dd1-efce232b3954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:03:35.796854 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865076c-4a27-4acb-9dd1-efce232b3954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:03:35.797898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: WARNING py.warnings [None req-8865076c-4a27-4acb-9dd1-efce232b3954 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:03:35.797898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: warnings.warn(msg) Aug 19 21:03:35.797898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: Aug 19 21:03:35.798816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865076c-4a27-4acb-9dd1-efce232b3954 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:03:35.810762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 752/1496] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:03:35.819894 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95bd5e-180e-4cfb-876e-15844c23d378 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:03:35.829033 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95bd5e-180e-4cfb-876e-15844c23d378 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:03:35.891506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:35.925976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569f0ae-a542-423b-bc6f-aa546e95831a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:03:35.926700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569f0ae-a542-423b-bc6f-aa546e95831a admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:35.927010 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569f0ae-a542-423b-bc6f-aa546e95831a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:35.927278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569f0ae-a542-423b-bc6f-aa546e95831a admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:35.927892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569f0ae-a542-423b-bc6f-aa546e95831a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:03:35.929615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-0569f0ae-a542-423b-bc6f-aa546e95831a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:03:35.929615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 19 21:03:35.929615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: Aug 19 21:03:35.930828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569f0ae-a542-423b-bc6f-aa546e95831a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:03:35.986302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 745/1497] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:03:35 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:03:35.990808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865076c-4a27-4acb-9dd1-efce232b3954 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:03:35.992381 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8865076c-4a27-4acb-9dd1-efce232b3954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:36.028159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865076c-4a27-4acb-9dd1-efce232b3954 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:03:36.125945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b88297-8017-4fce-bec9-cf303d04d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:03:36.126497 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b88297-8017-4fce-bec9-cf303d04d487 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:36.126816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b88297-8017-4fce-bec9-cf303d04d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:36.127096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b88297-8017-4fce-bec9-cf303d04d487 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:36.127720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b88297-8017-4fce-bec9-cf303d04d487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:03:36.128722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: WARNING py.warnings [None req-33b88297-8017-4fce-bec9-cf303d04d487 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:03:36.128722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: warnings.warn(msg) Aug 19 21:03:36.128722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: Aug 19 21:03:36.130054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b88297-8017-4fce-bec9-cf303d04d487 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:03:36.174256 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 753/1498] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:03:35 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:03:36.178417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569f0ae-a542-423b-bc6f-aa546e95831a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:03:36.179979 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0569f0ae-a542-423b-bc6f-aa546e95831a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:36.242279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569f0ae-a542-423b-bc6f-aa546e95831a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:03:36.327814 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:36.341080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068270ce-2b5a-4f27-b3fa-70f8a16ae672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:03:36.341698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068270ce-2b5a-4f27-b3fa-70f8a16ae672 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:36.341982 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068270ce-2b5a-4f27-b3fa-70f8a16ae672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:36.342375 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068270ce-2b5a-4f27-b3fa-70f8a16ae672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:36.343175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068270ce-2b5a-4f27-b3fa-70f8a16ae672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:03:36.344225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-068270ce-2b5a-4f27-b3fa-70f8a16ae672 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:03:36.344225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 19 21:03:36.344225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: Aug 19 21:03:36.345265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068270ce-2b5a-4f27-b3fa-70f8a16ae672 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:03:36.362707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 746/1499] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:03:36.367423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b88297-8017-4fce-bec9-cf303d04d487 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:03:36.368939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-33b88297-8017-4fce-bec9-cf303d04d487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:36.380694 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b88297-8017-4fce-bec9-cf303d04d487 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:03:36.405880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:36.479676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2e83f-26cf-4433-bca9-f5e47ed55b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:03:36.480295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2e83f-26cf-4433-bca9-f5e47ed55b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:36.480582 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2e83f-26cf-4433-bca9-f5e47ed55b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:36.480867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2e83f-26cf-4433-bca9-f5e47ed55b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:36.481548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2e83f-26cf-4433-bca9-f5e47ed55b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:03:36.482566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: WARNING py.warnings [None req-78a2e83f-26cf-4433-bca9-f5e47ed55b34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:03:36.482566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: warnings.warn(msg) Aug 19 21:03:36.482566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: Aug 19 21:03:36.483495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2e83f-26cf-4433-bca9-f5e47ed55b34 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:03:36.496618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 754/1500] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:03:36.501065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068270ce-2b5a-4f27-b3fa-70f8a16ae672 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:03:36.502610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-068270ce-2b5a-4f27-b3fa-70f8a16ae672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:36.535988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068270ce-2b5a-4f27-b3fa-70f8a16ae672 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:03:36.631452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104326f-4c24-44f7-9a5e-69968de3d4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:03:36.632026 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104326f-4c24-44f7-9a5e-69968de3d4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:36.632305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104326f-4c24-44f7-9a5e-69968de3d4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:36.632577 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104326f-4c24-44f7-9a5e-69968de3d4c4 admin admin] PATH_INFO: `/v3/projects/7b5cfb815d45452db3360731c82cee13/users/806bee53ba414112b92711e6c279cfd6/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:36.655164 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104326f-4c24-44f7-9a5e-69968de3d4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5cfb815d45452db3360731c82cee13, user_id=806bee53ba414112b92711e6c279cfd6, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:03:36.656190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-f104326f-4c24-44f7-9a5e-69968de3d4c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:03:36.656190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 19 21:03:36.656190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: Aug 19 21:03:36.658111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104326f-4c24-44f7-9a5e-69968de3d4c4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:03:36.684221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 747/1501] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:03:36 2022] PUT /identity/v3/projects/7b5cfb815d45452db3360731c82cee13/users/806bee53ba414112b92711e6c279cfd6/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:03:36.697104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4ae0d-2c12-4a2b-a38a-a5883b0e15c3 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:36.697399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4ae0d-2c12-4a2b-a38a-a5883b0e15c3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:36.697677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4ae0d-2c12-4a2b-a38a-a5883b0e15c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:36.755779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-20d4ae0d-2c12-4a2b-a38a-a5883b0e15c3 None None] MFA Rules not processed for user `806bee53ba414112b92711e6c279cfd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:03:36.757003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-20d4ae0d-2c12-4a2b-a38a-a5883b0e15c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:36.838057 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 755/1502] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:03:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:03:36.852136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cca3e8-96ca-462e-88c7-871ef0620b77 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:36.852420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cca3e8-96ca-462e-88c7-871ef0620b77 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:36.852694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cca3e8-96ca-462e-88c7-871ef0620b77 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:36.854043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 748/1503] 10.222.0.17 () {54 vars in 964 bytes} [Fri Aug 19 21:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:03:36.859095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672beaf-580c-4b0b-8a2b-6e62aa416c9c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:36.859527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672beaf-580c-4b0b-8a2b-6e62aa416c9c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:36.859810 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672beaf-580c-4b0b-8a2b-6e62aa416c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:36.897486 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:36.944677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-8672beaf-580c-4b0b-8a2b-6e62aa416c9c None None] MFA Rules not processed for user `4c27e2db991245359bcceb62ff768b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:03:36.945886 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8672beaf-580c-4b0b-8a2b-6e62aa416c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:37.023422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 756/1504] 10.222.0.17 () {58 vars in 1061 bytes} [Fri Aug 19 21:03:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:03:37.031221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cca3e8-96ca-462e-88c7-871ef0620b77 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:03:37.032747 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d8cca3e8-96ca-462e-88c7-871ef0620b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:37.085182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:37.149176 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cca3e8-96ca-462e-88c7-871ef0620b77 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:03:37.224802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da5803-d627-4ac5-bd66-8743c12240fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:03:37.226104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5803-d627-4ac5-bd66-8743c12240fa service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:37.226425 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5803-d627-4ac5-bd66-8743c12240fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:37.226710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5803-d627-4ac5-bd66-8743c12240fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:37.228559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-45da5803-d627-4ac5-bd66-8743c12240fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:37.333533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da5803-d627-4ac5-bd66-8743c12240fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:03:37.335004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da5803-d627-4ac5-bd66-8743c12240fa service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:03:37.338657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:37.355065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 749/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:03:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:03:37.402622 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cebfa-6299-45c9-b104-c124e108c862 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:37.403090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cebfa-6299-45c9-b104-c124e108c862 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:37.403196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cebfa-6299-45c9-b104-c124e108c862 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:37.404385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 757/1506] 10.222.0.17 () {52 vars in 830 bytes} [Fri Aug 19 21:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:03:37.408050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da5803-d627-4ac5-bd66-8743c12240fa service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:03:37.409187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-45da5803-d627-4ac5-bd66-8743c12240fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:37.511641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da5803-d627-4ac5-bd66-8743c12240fa service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:03:37.613547 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:03:37.614185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:37.614508 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:37.614862 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] PATH_INFO: `/v3/users/806bee53ba414112b92711e6c279cfd6` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:37.628017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806bee53ba414112b92711e6c279cfd6)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:03:37.629111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:03:37.629111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 19 21:03:37.629111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: Aug 19 21:03:37.630863 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:03:37.641966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:37.714301 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806bee53ba414112b92711e6c279cfd6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:03:37.738488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806bee53ba414112b92711e6c279cfd6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:03:37.749718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806bee53ba414112b92711e6c279cfd6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:03:37.750339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806bee53ba414112b92711e6c279cfd6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:03:37.750972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806bee53ba414112b92711e6c279cfd6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:03:37.773202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 750/1507] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:03:37 2022] DELETE /identity/v3/users/806bee53ba414112b92711e6c279cfd6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:03:37.777731 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915690-c2dc-4fc9-9d98-8b05943fc1e7 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:37.778020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915690-c2dc-4fc9-9d98-8b05943fc1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:37.778426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915690-c2dc-4fc9-9d98-8b05943fc1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:37.837428 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-9f915690-c2dc-4fc9-9d98-8b05943fc1e7 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:03:37.838829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9f915690-c2dc-4fc9-9d98-8b05943fc1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:37.917963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:37.932562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 758/1508] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:03:37.942349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:03:37.943568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:38.050558 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9bb28-feb2-425f-bcd9-00f345bf7932 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:03:38.109758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:38.130763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a0461-201c-4dd7-ad08-f2dd2a5e288c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:03:38.131375 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a0461-201c-4dd7-ad08-f2dd2a5e288c service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:38.131656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a0461-201c-4dd7-ad08-f2dd2a5e288c service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:38.131930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a0461-201c-4dd7-ad08-f2dd2a5e288c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:38.133545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a08a0461-201c-4dd7-ad08-f2dd2a5e288c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:38.253054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a0461-201c-4dd7-ad08-f2dd2a5e288c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:03:38.254577 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a0461-201c-4dd7-ad08-f2dd2a5e288c service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:03:38.275344 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 751/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:03:38.659827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f915690-c2dc-4fc9-9d98-8b05943fc1e7 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:03:38.661289 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9f915690-c2dc-4fc9-9d98-8b05943fc1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:03:38.673916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f915690-c2dc-4fc9-9d98-8b05943fc1e7 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:03:38.779085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:03:38.779719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:03:38.780008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:03:38.780282 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e admin admin] PATH_INFO: `/v3/projects/7b5cfb815d45452db3360731c82cee13` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:03:38.790748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5cfb815d45452db3360731c82cee13)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:03:38.791820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: WARNING py.warnings [None req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:03:38.791820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: warnings.warn(msg) Aug 19 21:03:38.791820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: Aug 19 21:03:38.793047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:03:38.858228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5cfb815d45452db3360731c82cee13', 'request_id': 'req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:03:38.868372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5cfb815d45452db3360731c82cee13', 'request_id': 'req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:03:38.883280 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5cfb815d45452db3360731c82cee13', 'request_id': 'req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:03:38.906759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e admin admin] The token cache is being invalidate because project 7b5cfb815d45452db3360731c82cee13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:03:38.907066 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:03:38.907502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-52d53ebb-2705-45fa-ac1c-1e4804adaf8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:03:38.908938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 759/1510] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:03:38 2022] DELETE /identity/v3/projects/7b5cfb815d45452db3360731c82cee13 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:03:48.272928 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=62 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:48.904766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:05:16.805539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2adb41-78ff-4716-8ee3-f5c93e954d28 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:16.806136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2adb41-78ff-4716-8ee3-f5c93e954d28 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:16.806136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2adb41-78ff-4716-8ee3-f5c93e954d28 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:16.807501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 21:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:05:16.812433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14710572-16a1-4969-a64b-113af7019f91 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:16.812898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14710572-16a1-4969-a64b-113af7019f91 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:16.813010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14710572-16a1-4969-a64b-113af7019f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:16.901676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-14710572-16a1-4969-a64b-113af7019f91 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:05:16.902914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-14710572-16a1-4969-a64b-113af7019f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:17.007821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:05:17.164586 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2adb41-78ff-4716-8ee3-f5c93e954d28 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:05:17.166820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1c2adb41-78ff-4716-8ee3-f5c93e954d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:17.291386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2adb41-78ff-4716-8ee3-f5c93e954d28 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:05:17.296960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0171bd5-9a43-4728-b74e-0490a3b0bab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:05:17.297575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0171bd5-9a43-4728-b74e-0490a3b0bab9 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:17.297857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0171bd5-9a43-4728-b74e-0490a3b0bab9 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:17.298133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0171bd5-9a43-4728-b74e-0490a3b0bab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:17.307146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0171bd5-9a43-4728-b74e-0490a3b0bab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:05:17.308732 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0171bd5-9a43-4728-b74e-0490a3b0bab9 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:05:17.319259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 753/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:05:18.168107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e54208-70ae-4f5a-a52c-0fcf348d397d None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:18.168682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e54208-70ae-4f5a-a52c-0fcf348d397d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:18.168682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e54208-70ae-4f5a-a52c-0fcf348d397d None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:18.170041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 21:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:05:18.175043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff0c0-9986-4084-8e43-f0ee708fdd66 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:18.175480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff0c0-9986-4084-8e43-f0ee708fdd66 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:18.175636 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff0c0-9986-4084-8e43-f0ee708fdd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:18.195574 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ce0ff0c0-9986-4084-8e43-f0ee708fdd66 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:05:18.196787 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ce0ff0c0-9986-4084-8e43-f0ee708fdd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:18.204742 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:05:18.355274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e54208-70ae-4f5a-a52c-0fcf348d397d None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:05:18.369880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e54208-70ae-4f5a-a52c-0fcf348d397d None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:05:18.375376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292e042-7466-462d-8cb4-73c35af97996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:05:18.375979 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292e042-7466-462d-8cb4-73c35af97996 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:18.376266 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292e042-7466-462d-8cb4-73c35af97996 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:18.376545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292e042-7466-462d-8cb4-73c35af97996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:18.385199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292e042-7466-462d-8cb4-73c35af97996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:05:18.386852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292e042-7466-462d-8cb4-73c35af97996 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:05:18.397226 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 762/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:05:19.245098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01600c42-3d18-4b68-a05c-4c5a8e9c3e38 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:19.245649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01600c42-3d18-4b68-a05c-4c5a8e9c3e38 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:19.245649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01600c42-3d18-4b68-a05c-4c5a8e9c3e38 None None] PATH_INFO: `/v3` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:19.246995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 755/1517] 10.222.0.58 () {54 vars in 925 bytes} [Fri Aug 19 21:05:19 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:05:19.252971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3ae6c-c0c1-4206-9244-e43340a82ddb None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:19.253412 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3ae6c-c0c1-4206-9244-e43340a82ddb None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:19.253528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3ae6c-c0c1-4206-9244-e43340a82ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:19.313165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-10e3ae6c-c0c1-4206-9244-e43340a82ddb None None] MFA Rules not processed for user `be0a8d40d21048afa4ce94706e3625c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:05:19.314368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-10e3ae6c-c0c1-4206-9244-e43340a82ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:19.331656 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:05:19.387862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 763/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Aug 19 21:05:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:05:23.293747 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717d24-43d2-44fa-bc44-06d278580add None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:23.294405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717d24-43d2-44fa-bc44-06d278580add None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:23.294405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717d24-43d2-44fa-bc44-06d278580add None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:23.295720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 756/1519] 10.222.0.17 () {54 vars in 961 bytes} [Fri Aug 19 21:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:05:23.301074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4269657-f6c8-4ab8-99a3-6a7f99a28ede None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:23.301524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4269657-f6c8-4ab8-99a3-6a7f99a28ede None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:23.301636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4269657-f6c8-4ab8-99a3-6a7f99a28ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:23.323427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-a4269657-f6c8-4ab8-99a3-6a7f99a28ede None None] MFA Rules not processed for user `be0a8d40d21048afa4ce94706e3625c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:05:23.326052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a4269657-f6c8-4ab8-99a3-6a7f99a28ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:23.340061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 764/1520] 10.222.0.17 () {58 vars in 1058 bytes} [Fri Aug 19 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:05:23.351134 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1717d24-43d2-44fa-bc44-06d278580add None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:05:23.366811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1717d24-43d2-44fa-bc44-06d278580add None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:05:23.371767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbad8f-d7ea-46b5-96c7-c257b7cbf7fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:05:23.372377 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbad8f-d7ea-46b5-96c7-c257b7cbf7fc service placement] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:23.372669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbad8f-d7ea-46b5-96c7-c257b7cbf7fc service placement] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:23.372920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbad8f-d7ea-46b5-96c7-c257b7cbf7fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:23.384092 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbad8f-d7ea-46b5-96c7-c257b7cbf7fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:05:23.385694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbad8f-d7ea-46b5-96c7-c257b7cbf7fc service placement] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:05:23.399404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 757/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:05:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:05:29.605220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804e50c-419e-4b3f-a521-65c71a9dd681 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:29.605782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804e50c-419e-4b3f-a521-65c71a9dd681 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:29.605782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804e50c-419e-4b3f-a521-65c71a9dd681 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:29.607206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 21:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:05:29.612163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fedccd-8f95-4370-b028-cd4ad4a8b698 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:29.612601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fedccd-8f95-4370-b028-cd4ad4a8b698 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:29.612715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fedccd-8f95-4370-b028-cd4ad4a8b698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:29.632325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-30fedccd-8f95-4370-b028-cd4ad4a8b698 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:05:29.633521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-30fedccd-8f95-4370-b028-cd4ad4a8b698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:29.641654 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:05:29.797212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804e50c-419e-4b3f-a521-65c71a9dd681 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:05:29.812443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804e50c-419e-4b3f-a521-65c71a9dd681 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:05:29.817894 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06116665-85f3-472e-83ae-512541a257e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:05:29.819179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06116665-85f3-472e-83ae-512541a257e8 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:29.819457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06116665-85f3-472e-83ae-512541a257e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:29.819730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06116665-85f3-472e-83ae-512541a257e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:29.827950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06116665-85f3-472e-83ae-512541a257e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:05:29.829524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06116665-85f3-472e-83ae-512541a257e8 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:05:29.839292 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 766/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:05:30.668543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcda302-7bbf-41aa-bad6-c35a433ef709 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:30.669180 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcda302-7bbf-41aa-bad6-c35a433ef709 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:30.669180 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcda302-7bbf-41aa-bad6-c35a433ef709 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:30.670488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 21:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:05:30.675308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e35a-9029-466c-8477-905652c4cce7 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:30.675778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e35a-9029-466c-8477-905652c4cce7 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:30.675896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e35a-9029-466c-8477-905652c4cce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:30.695009 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-d053e35a-9029-466c-8477-905652c4cce7 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:05:30.696225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d053e35a-9029-466c-8477-905652c4cce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:30.704116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:05:30.854973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcda302-7bbf-41aa-bad6-c35a433ef709 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:05:30.869664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcda302-7bbf-41aa-bad6-c35a433ef709 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:05:30.876058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ff9e7-e8f4-471f-95c8-066cebe8b819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:05:30.876663 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ff9e7-e8f4-471f-95c8-066cebe8b819 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:30.876940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ff9e7-e8f4-471f-95c8-066cebe8b819 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:30.877242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ff9e7-e8f4-471f-95c8-066cebe8b819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:30.888323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ff9e7-e8f4-471f-95c8-066cebe8b819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:05:30.890177 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ff9e7-e8f4-471f-95c8-066cebe8b819 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:05:30.900331 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 760/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:05:34.839256 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756939f-2ef4-4077-ba07-e4c6971363c2 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:34.839843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756939f-2ef4-4077-ba07-e4c6971363c2 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:34.839843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756939f-2ef4-4077-ba07-e4c6971363c2 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:34.841157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:05:34.846429 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e8456-691c-44be-8232-bf38f24cbdc3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:34.846918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e8456-691c-44be-8232-bf38f24cbdc3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:34.847076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e8456-691c-44be-8232-bf38f24cbdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:34.866210 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b65e8456-691c-44be-8232-bf38f24cbdc3 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:05:34.867428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b65e8456-691c-44be-8232-bf38f24cbdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:34.875146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:05:35.165116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756939f-2ef4-4077-ba07-e4c6971363c2 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:05:35.166886 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0756939f-2ef4-4077-ba07-e4c6971363c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:35.246557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756939f-2ef4-4077-ba07-e4c6971363c2 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:05:35.250107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1defc83-4f59-400d-8fe8-5c02908c30ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:05:35.250711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1defc83-4f59-400d-8fe8-5c02908c30ac service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:35.251026 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1defc83-4f59-400d-8fe8-5c02908c30ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:35.251300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1defc83-4f59-400d-8fe8-5c02908c30ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:35.260132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1defc83-4f59-400d-8fe8-5c02908c30ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:05:35.261547 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1defc83-4f59-400d-8fe8-5c02908c30ac service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:05:35.271060 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 769/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:05:37.176824 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41967-f5f6-480a-ad37-8263ce2d1385 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:37.177407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41967-f5f6-480a-ad37-8263ce2d1385 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:37.177407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41967-f5f6-480a-ad37-8263ce2d1385 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:37.178751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:05:37.184012 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604c818-d0c1-4398-b918-56454c540988 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:37.184454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604c818-d0c1-4398-b918-56454c540988 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:37.184569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604c818-d0c1-4398-b918-56454c540988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:37.204439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e604c818-d0c1-4398-b918-56454c540988 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:05:37.205632 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e604c818-d0c1-4398-b918-56454c540988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:37.213709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:05:37.496815 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b41967-f5f6-480a-ad37-8263ce2d1385 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:05:37.508499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b41967-f5f6-480a-ad37-8263ce2d1385 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:05:37.512212 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4c0cb-a05c-4c97-b485-6dcf72842946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:05:37.512815 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4c0cb-a05c-4c97-b485-6dcf72842946 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:37.513100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4c0cb-a05c-4c97-b485-6dcf72842946 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:37.513378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4c0cb-a05c-4c97-b485-6dcf72842946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:37.525625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4c0cb-a05c-4c97-b485-6dcf72842946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:05:37.527085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4c0cb-a05c-4c97-b485-6dcf72842946 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:05:37.537361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 763/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:05:41.018152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4930-c954-434c-bc40-bc17988fd7f7 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:41.018717 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4930-c954-434c-bc40-bc17988fd7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:41.018717 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4930-c954-434c-bc40-bc17988fd7f7 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:41.020169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:05:41.025482 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2b0da-d2bf-48d3-b47c-87e6f9bb05e3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:41.025946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2b0da-d2bf-48d3-b47c-87e6f9bb05e3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:41.026100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2b0da-d2bf-48d3-b47c-87e6f9bb05e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:41.033645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=81 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:05:41.046723 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e4b2b0da-d2bf-48d3-b47c-87e6f9bb05e3 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:05:41.047960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e4b2b0da-d2bf-48d3-b47c-87e6f9bb05e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:41.056848 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:05:41.615357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa4930-c954-434c-bc40-bc17988fd7f7 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:05:41.617511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-94fa4930-c954-434c-bc40-bc17988fd7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:41.683725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:05:41.698302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa4930-c954-434c-bc40-bc17988fd7f7 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:05:41.701851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed92112-a6c7-459f-ae84-37f0aeb094fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:05:41.702502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92112-a6c7-459f-ae84-37f0aeb094fa service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:41.702818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92112-a6c7-459f-ae84-37f0aeb094fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:41.703098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92112-a6c7-459f-ae84-37f0aeb094fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:41.713236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed92112-a6c7-459f-ae84-37f0aeb094fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:05:41.714798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed92112-a6c7-459f-ae84-37f0aeb094fa service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:05:41.725416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 772/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:05:43.671204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054f029-3a30-4874-a891-a63d9953ec26 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:43.671793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054f029-3a30-4874-a891-a63d9953ec26 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:43.671793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054f029-3a30-4874-a891-a63d9953ec26 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:43.673112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 21:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:05:43.678544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebf06f-49f1-4603-85bf-f34bc74fc178 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:43.678990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebf06f-49f1-4603-85bf-f34bc74fc178 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:43.679134 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebf06f-49f1-4603-85bf-f34bc74fc178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:43.699282 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-a1ebf06f-49f1-4603-85bf-f34bc74fc178 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:05:43.700413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a1ebf06f-49f1-4603-85bf-f34bc74fc178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:43.708510 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 21:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:05:44.263444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054f029-3a30-4874-a891-a63d9953ec26 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:05:44.265405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c054f029-3a30-4874-a891-a63d9953ec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:05:44.278501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054f029-3a30-4874-a891-a63d9953ec26 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:05:44.282007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a2ddd-570d-400b-a0fa-0308f9e839b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:05:44.282601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a2ddd-570d-400b-a0fa-0308f9e839b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:05:44.282921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a2ddd-570d-400b-a0fa-0308f9e839b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:05:44.283200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a2ddd-570d-400b-a0fa-0308f9e839b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:05:44.292158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a2ddd-570d-400b-a0fa-0308f9e839b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:05:44.293582 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a2ddd-570d-400b-a0fa-0308f9e839b1 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:05:44.304121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 766/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:05:53.694399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=11 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:05:54.298875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=8 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:18.368595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c3bbf-3407-4845-a92b-8a26d26c071f None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:18.370063 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c3bbf-3407-4845-a92b-8a26d26c071f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:18.370851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c3bbf-3407-4845-a92b-8a26d26c071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:18.402308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-678c3bbf-3407-4845-a92b-8a26d26c071f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:18.403575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-678c3bbf-3407-4845-a92b-8a26d26c071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:18.419000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 774/1540] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:18.428199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf6f15-e09e-48c2-aa5d-b78efe5bea4e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:18.429343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf6f15-e09e-48c2-aa5d-b78efe5bea4e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:18.429993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf6f15-e09e-48c2-aa5d-b78efe5bea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:18.456408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-dadf6f15-e09e-48c2-aa5d-b78efe5bea4e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:18.457637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-dadf6f15-e09e-48c2-aa5d-b78efe5bea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:18.477410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 767/1541] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:07:18.482271 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c3bbf-3407-4845-a92b-8a26d26c071f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:18.497773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c3bbf-3407-4845-a92b-8a26d26c071f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:18.506589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616aeb05-0a6b-4854-b4e8-970fc87e91ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:18.509116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aeb05-0a6b-4854-b4e8-970fc87e91ac admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:18.509452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aeb05-0a6b-4854-b4e8-970fc87e91ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:18.509662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aeb05-0a6b-4854-b4e8-970fc87e91ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:18.510404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616aeb05-0a6b-4854-b4e8-970fc87e91ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:18.510844 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616aeb05-0a6b-4854-b4e8-970fc87e91ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:18.512791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616aeb05-0a6b-4854-b4e8-970fc87e91ac admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:18.533186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 775/1542] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:18.543048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf6f15-e09e-48c2-aa5d-b78efe5bea4e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:18.561526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf6f15-e09e-48c2-aa5d-b78efe5bea4e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:18.566873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f0e61-6127-44c8-8853-ffbd9792443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:18.567526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f0e61-6127-44c8-8853-ffbd9792443e admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:18.567801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f0e61-6127-44c8-8853-ffbd9792443e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:18.568079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f0e61-6127-44c8-8853-ffbd9792443e admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:18.568932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f0e61-6127-44c8-8853-ffbd9792443e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:18.572502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f0e61-6127-44c8-8853-ffbd9792443e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:18.642690 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 768/1543] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:18 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:18.647306 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616aeb05-0a6b-4854-b4e8-970fc87e91ac admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:18.663261 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616aeb05-0a6b-4854-b4e8-970fc87e91ac admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:18.666482 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee9b0d-aa5d-4a96-a44b-cab47a646b91 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:18.666797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee9b0d-aa5d-4a96-a44b-cab47a646b91 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:18.667074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee9b0d-aa5d-4a96-a44b-cab47a646b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:18.706373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-13ee9b0d-aa5d-4a96-a44b-cab47a646b91 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:18.707756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-13ee9b0d-aa5d-4a96-a44b-cab47a646b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:18.823367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba13450-ff00-4302-a745-947817cb5448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:18.824584 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba13450-ff00-4302-a745-947817cb5448 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:18.825124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba13450-ff00-4302-a745-947817cb5448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:18.825643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba13450-ff00-4302-a745-947817cb5448 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:18.826517 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba13450-ff00-4302-a745-947817cb5448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:18.829120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba13450-ff00-4302-a745-947817cb5448 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:18.883027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 769/1544] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:07:18.885644 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d2a8a-c6eb-4612-8ae7-2f868b7eb380 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:18.886263 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d2a8a-c6eb-4612-8ae7-2f868b7eb380 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:18.887179 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d2a8a-c6eb-4612-8ae7-2f868b7eb380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:18.891235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 776/1545] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:18 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:18.893030 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a05ce-516a-42ae-9ab8-cf228195e354 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:18.893582 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a05ce-516a-42ae-9ab8-cf228195e354 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:18.894084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a05ce-516a-42ae-9ab8-cf228195e354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:18.925140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-4b6a05ce-516a-42ae-9ab8-cf228195e354 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:18.925396 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e20d2a8a-c6eb-4612-8ae7-2f868b7eb380 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:18.926609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4b6a05ce-516a-42ae-9ab8-cf228195e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:18.927290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e20d2a8a-c6eb-4612-8ae7-2f868b7eb380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:18.936209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 777/1546] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:18.937310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0f9a-b955-400e-9cde-a289075c4a66 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:18.937433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 770/1547] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:18.937527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0f9a-b955-400e-9cde-a289075c4a66 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:18.937755 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0f9a-b955-400e-9cde-a289075c4a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:18.940358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d2a8a-c6eb-4612-8ae7-2f868b7eb380 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:18.957975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d2a8a-c6eb-4612-8ae7-2f868b7eb380 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:18.963588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db218ef-6f95-4dbc-a950-d2acf71fd15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:18.963788 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-de1b0f9a-b955-400e-9cde-a289075c4a66 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:18.964264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db218ef-6f95-4dbc-a950-d2acf71fd15d admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:18.964548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db218ef-6f95-4dbc-a950-d2acf71fd15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:18.964804 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-de1b0f9a-b955-400e-9cde-a289075c4a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:18.964923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db218ef-6f95-4dbc-a950-d2acf71fd15d admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:18.965463 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db218ef-6f95-4dbc-a950-d2acf71fd15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:18.967276 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db218ef-6f95-4dbc-a950-d2acf71fd15d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:18.982516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 771/1548] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:18.982516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4005e8-bead-4d37-8ac8-566bade3b189 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:18.982516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4005e8-bead-4d37-8ac8-566bade3b189 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:18.982516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4005e8-bead-4d37-8ac8-566bade3b189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:18.986934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 778/1549] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:18.988399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060de762-f0a1-4981-b1c0-5ae1f28b4eb1 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:18.988681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060de762-f0a1-4981-b1c0-5ae1f28b4eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:18.988961 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060de762-f0a1-4981-b1c0-5ae1f28b4eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.004313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8b4005e8-bead-4d37-8ac8-566bade3b189 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:19.005544 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8b4005e8-bead-4d37-8ac8-566bade3b189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:19.013911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-060de762-f0a1-4981-b1c0-5ae1f28b4eb1 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:19.015324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-060de762-f0a1-4981-b1c0-5ae1f28b4eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:19.019644 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 772/1550] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:19.021197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4fe5-fbb1-439f-b77c-499672debc07 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.021385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4fe5-fbb1-439f-b77c-499672debc07 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.021661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4fe5-fbb1-439f-b77c-499672debc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.036874 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 779/1551] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:19.037191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e11044-9513-45e4-adb7-e29d0b252ff8 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.037357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e11044-9513-45e4-adb7-e29d0b252ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.038761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e11044-9513-45e4-adb7-e29d0b252ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.055844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-3d8f4fe5-fbb1-439f-b77c-499672debc07 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:19.057337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3d8f4fe5-fbb1-439f-b77c-499672debc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:19.059246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-d3e11044-9513-45e4-adb7-e29d0b252ff8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:19.060526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d3e11044-9513-45e4-adb7-e29d0b252ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:19.068196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 773/1552] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:19.069793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18079c-90f3-4481-a766-a45a676c9c39 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.071444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18079c-90f3-4481-a766-a45a676c9c39 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.071727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18079c-90f3-4481-a766-a45a676c9c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.076932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 780/1553] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:19.078357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e11044-9513-45e4-adb7-e29d0b252ff8 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.093718 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e11044-9513-45e4-adb7-e29d0b252ff8 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.099164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ef0ae-7696-47e7-af9d-197f3c4d7247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.099787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ef0ae-7696-47e7-af9d-197f3c4d7247 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.100069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ef0ae-7696-47e7-af9d-197f3c4d7247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.100339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ef0ae-7696-47e7-af9d-197f3c4d7247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.100625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7d18079c-90f3-4481-a766-a45a676c9c39 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:19.101116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ef0ae-7696-47e7-af9d-197f3c4d7247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.101842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7d18079c-90f3-4481-a766-a45a676c9c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:19.103015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ef0ae-7696-47e7-af9d-197f3c4d7247 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.112097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 774/1554] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:19.117622 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 781/1555] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:19.117927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024aff9-8984-4f32-8edc-98c8cf9ffd27 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.117927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024aff9-8984-4f32-8edc-98c8cf9ffd27 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.117927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024aff9-8984-4f32-8edc-98c8cf9ffd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.118311 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c902bd-69a0-464d-9acd-f4bb9f4e7fd0 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.118311 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c902bd-69a0-464d-9acd-f4bb9f4e7fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.118311 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c902bd-69a0-464d-9acd-f4bb9f4e7fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.137563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1024aff9-8984-4f32-8edc-98c8cf9ffd27 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:19.138692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1024aff9-8984-4f32-8edc-98c8cf9ffd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:19.144015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-82c902bd-69a0-464d-9acd-f4bb9f4e7fd0 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:19.145124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-82c902bd-69a0-464d-9acd-f4bb9f4e7fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:19.148503 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 775/1556] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:19.148934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024aff9-8984-4f32-8edc-98c8cf9ffd27 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.155707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 782/1557] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:19.156970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166722bf-0027-4c8a-b6a1-8ccec7148782 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.157256 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166722bf-0027-4c8a-b6a1-8ccec7148782 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.157533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166722bf-0027-4c8a-b6a1-8ccec7148782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.159816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024aff9-8984-4f32-8edc-98c8cf9ffd27 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.166204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc68fa9-b435-4557-8e8b-86cb62ef166f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.166857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc68fa9-b435-4557-8e8b-86cb62ef166f admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.167150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc68fa9-b435-4557-8e8b-86cb62ef166f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.167429 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc68fa9-b435-4557-8e8b-86cb62ef166f admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.169292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc68fa9-b435-4557-8e8b-86cb62ef166f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:19.169292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc68fa9-b435-4557-8e8b-86cb62ef166f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.169557 dv-cinder-852209-6-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-ccc68fa9-b435-4557-8e8b-86cb62ef166f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:07:19.169557 dv-cinder-852209-6-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 19 21:07:19.169557 dv-cinder-852209-6-smb devstack@keystone.service[81641]: Aug 19 21:07:19.170711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc68fa9-b435-4557-8e8b-86cb62ef166f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.181930 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-166722bf-0027-4c8a-b6a1-8ccec7148782 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:19.183201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-166722bf-0027-4c8a-b6a1-8ccec7148782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:19.188887 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 776/1558] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:19.191638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 783/1559] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:19.193378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c422877-b76e-43b4-931c-2b75956039c4 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.194268 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c422877-b76e-43b4-931c-2b75956039c4 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.195672 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c422877-b76e-43b4-931c-2b75956039c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.197160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc68fa9-b435-4557-8e8b-86cb62ef166f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.218228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc68fa9-b435-4557-8e8b-86cb62ef166f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.219191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-6c422877-b76e-43b4-931c-2b75956039c4 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:19.220561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6c422877-b76e-43b4-931c-2b75956039c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:19.226872 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda2801-14ec-4281-a65c-7864abdeedf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.228164 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda2801-14ec-4281-a65c-7864abdeedf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.228585 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda2801-14ec-4281-a65c-7864abdeedf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.229025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda2801-14ec-4281-a65c-7864abdeedf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.230280 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda2801-14ec-4281-a65c-7864abdeedf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:19.230795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda2801-14ec-4281-a65c-7864abdeedf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.231874 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 784/1560] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:19.233975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda2801-14ec-4281-a65c-7864abdeedf6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.239849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c422877-b76e-43b4-931c-2b75956039c4 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.252116 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 777/1561] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:19.253107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda2801-14ec-4281-a65c-7864abdeedf6 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.253677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c422877-b76e-43b4-931c-2b75956039c4 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.260794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326e6f7-c865-4ed2-a7a1-295d9ddd3060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.261302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e6f7-c865-4ed2-a7a1-295d9ddd3060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.261621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e6f7-c865-4ed2-a7a1-295d9ddd3060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.261870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e6f7-c865-4ed2-a7a1-295d9ddd3060 admin admin] PATH_INFO: `/v3/projects/df4003b6d7db450ca87311cbf6598fac/users/8b4a6b0dc41d446f8c46bd5097f6b254/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.266641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda2801-14ec-4281-a65c-7864abdeedf6 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.271574 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da9fd9-8fd5-435b-8374-aa645bb090d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.272202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da9fd9-8fd5-435b-8374-aa645bb090d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.273096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da9fd9-8fd5-435b-8374-aa645bb090d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.273550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da9fd9-8fd5-435b-8374-aa645bb090d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.274254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da9fd9-8fd5-435b-8374-aa645bb090d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:19.274565 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da9fd9-8fd5-435b-8374-aa645bb090d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.276231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da9fd9-8fd5-435b-8374-aa645bb090d8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.281050 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326e6f7-c865-4ed2-a7a1-295d9ddd3060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4003b6d7db450ca87311cbf6598fac, user_id=8b4a6b0dc41d446f8c46bd5097f6b254, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.282111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: WARNING py.warnings [None req-a326e6f7-c865-4ed2-a7a1-295d9ddd3060 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:07:19.282111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: warnings.warn(msg) Aug 19 21:07:19.282111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: Aug 19 21:07:19.284234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326e6f7-c865-4ed2-a7a1-295d9ddd3060 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.289228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 778/1562] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:19.290137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da9fd9-8fd5-435b-8374-aa645bb090d8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.301331 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da9fd9-8fd5-435b-8374-aa645bb090d8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.306303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 785/1563] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:19 2022] PUT /identity/v3/projects/df4003b6d7db450ca87311cbf6598fac/users/8b4a6b0dc41d446f8c46bd5097f6b254/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:19.310389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326e6f7-c865-4ed2-a7a1-295d9ddd3060 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.353371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:19.373358 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:19.377531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22735e3-4a72-4f18-8512-e09ff35cc208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.378173 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22735e3-4a72-4f18-8512-e09ff35cc208 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.378462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22735e3-4a72-4f18-8512-e09ff35cc208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.378773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22735e3-4a72-4f18-8512-e09ff35cc208 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.379447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22735e3-4a72-4f18-8512-e09ff35cc208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:19.379764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22735e3-4a72-4f18-8512-e09ff35cc208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.381420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22735e3-4a72-4f18-8512-e09ff35cc208 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.389963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326e6f7-c865-4ed2-a7a1-295d9ddd3060 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.395540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf2b4b-bf7c-4b35-9a9f-9b127d46d8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.396095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf2b4b-bf7c-4b35-9a9f-9b127d46d8ef admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.396374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf2b4b-bf7c-4b35-9a9f-9b127d46d8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.405040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 779/1564] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:19.405304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf2b4b-bf7c-4b35-9a9f-9b127d46d8ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.405304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf2b4b-bf7c-4b35-9a9f-9b127d46d8ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:19.405508 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22735e3-4a72-4f18-8512-e09ff35cc208 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.405616 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf2b4b-bf7c-4b35-9a9f-9b127d46d8ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.405616 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf2b4b-bf7c-4b35-9a9f-9b127d46d8ef admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.415744 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 786/1565] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:19.415744 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf2b4b-bf7c-4b35-9a9f-9b127d46d8ef admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.416237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22735e3-4a72-4f18-8512-e09ff35cc208 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.422709 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d6a7d-ae79-41f7-9fa7-873fcda012f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.425244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d6a7d-ae79-41f7-9fa7-873fcda012f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.425531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d6a7d-ae79-41f7-9fa7-873fcda012f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.425810 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d6a7d-ae79-41f7-9fa7-873fcda012f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.426509 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d6a7d-ae79-41f7-9fa7-873fcda012f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:19.426914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d6a7d-ae79-41f7-9fa7-873fcda012f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.429243 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d6a7d-ae79-41f7-9fa7-873fcda012f2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.433723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf2b4b-bf7c-4b35-9a9f-9b127d46d8ef admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.438806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24458e3c-0f5e-4ee2-af0b-0edd8d99e762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.439466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458e3c-0f5e-4ee2-af0b-0edd8d99e762 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.439733 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458e3c-0f5e-4ee2-af0b-0edd8d99e762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.440008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458e3c-0f5e-4ee2-af0b-0edd8d99e762 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.440813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24458e3c-0f5e-4ee2-af0b-0edd8d99e762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.441954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: WARNING py.warnings [None req-24458e3c-0f5e-4ee2-af0b-0edd8d99e762 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:07:19.441954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: warnings.warn(msg) Aug 19 21:07:19.441954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: Aug 19 21:07:19.443068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 780/1566] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:19.443343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24458e3c-0f5e-4ee2-af0b-0edd8d99e762 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.445637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87f71-3762-4e6d-8323-cf68bbe1e1cf None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.445637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87f71-3762-4e6d-8323-cf68bbe1e1cf None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.446011 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87f71-3762-4e6d-8323-cf68bbe1e1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.475159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-18b87f71-3762-4e6d-8323-cf68bbe1e1cf None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:19.477025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-18b87f71-3762-4e6d-8323-cf68bbe1e1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:19.483124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 787/1567] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:19.484684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24458e3c-0f5e-4ee2-af0b-0edd8d99e762 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.489649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 781/1568] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:19.490715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b87f71-3762-4e6d-8323-cf68bbe1e1cf None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.503302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b87f71-3762-4e6d-8323-cf68bbe1e1cf None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.583266 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24458e3c-0f5e-4ee2-af0b-0edd8d99e762 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.588819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49994f40-724c-498c-b427-c474c2aef5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.589123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24521497-9d26-4767-aad9-c9b9f525bd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.589568 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24521497-9d26-4767-aad9-c9b9f525bd35 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.589760 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49994f40-724c-498c-b427-c474c2aef5df admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.589945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24521497-9d26-4767-aad9-c9b9f525bd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.590216 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24521497-9d26-4767-aad9-c9b9f525bd35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.590422 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49994f40-724c-498c-b427-c474c2aef5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.590683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49994f40-724c-498c-b427-c474c2aef5df admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.590892 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24521497-9d26-4767-aad9-c9b9f525bd35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.591839 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49994f40-724c-498c-b427-c474c2aef5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.592751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24521497-9d26-4767-aad9-c9b9f525bd35 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.594302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49994f40-724c-498c-b427-c474c2aef5df admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.623314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 788/1569] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:19.624616 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283feba-6102-4fc8-9df6-f9766275b278 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.624919 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283feba-6102-4fc8-9df6-f9766275b278 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.625199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283feba-6102-4fc8-9df6-f9766275b278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.631145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 782/1570] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:19.631145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49994f40-724c-498c-b427-c474c2aef5df admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.653348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-f283feba-6102-4fc8-9df6-f9766275b278 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:19.654619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f283feba-6102-4fc8-9df6-f9766275b278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:19.712810 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49994f40-724c-498c-b427-c474c2aef5df admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.718549 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d79fd-a195-43c7-bd23-13c93f009ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.719192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d79fd-a195-43c7-bd23-13c93f009ebe admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.719477 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d79fd-a195-43c7-bd23-13c93f009ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.719749 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d79fd-a195-43c7-bd23-13c93f009ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.720393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d79fd-a195-43c7-bd23-13c93f009ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.722379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d79fd-a195-43c7-bd23-13c93f009ebe admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.730389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 789/1571] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:19.731199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283feba-6102-4fc8-9df6-f9766275b278 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.750991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283feba-6102-4fc8-9df6-f9766275b278 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.758040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e9a92-f7ce-4499-bb37-5e22c288837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.758867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e9a92-f7ce-4499-bb37-5e22c288837f admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.759263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e9a92-f7ce-4499-bb37-5e22c288837f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.759649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e9a92-f7ce-4499-bb37-5e22c288837f admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.760402 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e9a92-f7ce-4499-bb37-5e22c288837f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.760611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 783/1572] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:19.761433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d79fd-a195-43c7-bd23-13c93f009ebe admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.764088 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e9a92-f7ce-4499-bb37-5e22c288837f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.798388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:19.802642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 790/1573] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:19.802642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e9a92-f7ce-4499-bb37-5e22c288837f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.832297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:19.839457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d79fd-a195-43c7-bd23-13c93f009ebe admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.880609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e9a92-f7ce-4499-bb37-5e22c288837f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.885696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f423193-53dd-4367-b994-12b296734aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.886540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f423193-53dd-4367-b994-12b296734aae admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.886826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f423193-53dd-4367-b994-12b296734aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.887145 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f423193-53dd-4367-b994-12b296734aae admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.887962 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f423193-53dd-4367-b994-12b296734aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.890146 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f423193-53dd-4367-b994-12b296734aae admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.907882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555009b7-c093-4acc-9626-5085d8f715e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.908440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555009b7-c093-4acc-9626-5085d8f715e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.908696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555009b7-c093-4acc-9626-5085d8f715e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.909050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555009b7-c093-4acc-9626-5085d8f715e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.909682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555009b7-c093-4acc-9626-5085d8f715e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.911675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555009b7-c093-4acc-9626-5085d8f715e0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.918016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 791/1574] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:19.918016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f423193-53dd-4367-b994-12b296734aae admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.930126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f423193-53dd-4367-b994-12b296734aae admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:19.934853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91ff49-a9ff-48d9-9b60-40e62b1b2f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:19.935479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91ff49-a9ff-48d9-9b60-40e62b1b2f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:19.935710 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91ff49-a9ff-48d9-9b60-40e62b1b2f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:19.935988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91ff49-a9ff-48d9-9b60-40e62b1b2f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:19.936710 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91ff49-a9ff-48d9-9b60-40e62b1b2f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:19.937018 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91ff49-a9ff-48d9-9b60-40e62b1b2f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:19.938926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91ff49-a9ff-48d9-9b60-40e62b1b2f87 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:19.952121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 784/1575] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:19.952919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555009b7-c093-4acc-9626-5085d8f715e0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.957760 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 792/1576] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:19.959186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91ff49-a9ff-48d9-9b60-40e62b1b2f87 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:19.973911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91ff49-a9ff-48d9-9b60-40e62b1b2f87 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.031190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555009b7-c093-4acc-9626-5085d8f715e0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.036423 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c9614-41f5-4370-a2d2-95f098252591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.037091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c9614-41f5-4370-a2d2-95f098252591 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.037400 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c9614-41f5-4370-a2d2-95f098252591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.037670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c9614-41f5-4370-a2d2-95f098252591 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.038490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c9614-41f5-4370-a2d2-95f098252591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.039849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-1c2c9614-41f5-4370-a2d2-95f098252591 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:07:20.039849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 19 21:07:20.039849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: Aug 19 21:07:20.041062 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c9614-41f5-4370-a2d2-95f098252591 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.045780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c698912-74a5-4ea8-8e60-957c1f0077c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.046425 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c698912-74a5-4ea8-8e60-957c1f0077c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.046697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c698912-74a5-4ea8-8e60-957c1f0077c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.047035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c698912-74a5-4ea8-8e60-957c1f0077c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.047692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c698912-74a5-4ea8-8e60-957c1f0077c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.049606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c698912-74a5-4ea8-8e60-957c1f0077c7 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.065073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 785/1577] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:20.066530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c9614-41f5-4370-a2d2-95f098252591 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.072493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 793/1578] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:19 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:20.073165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c698912-74a5-4ea8-8e60-957c1f0077c7 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.082570 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c698912-74a5-4ea8-8e60-957c1f0077c7 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.087373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f1d20-17fd-4ed8-a460-7cb28f177649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.087999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f1d20-17fd-4ed8-a460-7cb28f177649 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.088281 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f1d20-17fd-4ed8-a460-7cb28f177649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.088568 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f1d20-17fd-4ed8-a460-7cb28f177649 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.089175 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f1d20-17fd-4ed8-a460-7cb28f177649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.091270 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f1d20-17fd-4ed8-a460-7cb28f177649 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.117483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 794/1579] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:20 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:20.117483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f1d20-17fd-4ed8-a460-7cb28f177649 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.127215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f1d20-17fd-4ed8-a460-7cb28f177649 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.130291 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:20.134995 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d18c3-f272-4dd4-a744-4e2bd07d47b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.136790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d18c3-f272-4dd4-a744-4e2bd07d47b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.137065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d18c3-f272-4dd4-a744-4e2bd07d47b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.137413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c9614-41f5-4370-a2d2-95f098252591 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.139080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d18c3-f272-4dd4-a744-4e2bd07d47b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.139931 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d18c3-f272-4dd4-a744-4e2bd07d47b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.141665 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83372d0-9e12-4b06-b515-a1725255c9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.142283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83372d0-9e12-4b06-b515-a1725255c9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.142406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d18c3-f272-4dd4-a744-4e2bd07d47b7 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.142579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83372d0-9e12-4b06-b515-a1725255c9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.142866 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83372d0-9e12-4b06-b515-a1725255c9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.153593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83372d0-9e12-4b06-b515-a1725255c9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.155154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83372d0-9e12-4b06-b515-a1725255c9b4 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.166981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 786/1580] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:20.167762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83372d0-9e12-4b06-b515-a1725255c9b4 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.172029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 795/1581] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:20 2022] POST /identity/v3/users => generated 284 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:20.173461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d18c3-f272-4dd4-a744-4e2bd07d47b7 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.177871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83372d0-9e12-4b06-b515-a1725255c9b4 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.186593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20eaa0a-5dac-40ad-ae40-7afc2592c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.186593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eaa0a-5dac-40ad-ae40-7afc2592c748 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.188770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d18c3-f272-4dd4-a744-4e2bd07d47b7 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.189701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eaa0a-5dac-40ad-ae40-7afc2592c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.189984 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eaa0a-5dac-40ad-ae40-7afc2592c748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.190724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20eaa0a-5dac-40ad-ae40-7afc2592c748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.192311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20eaa0a-5dac-40ad-ae40-7afc2592c748 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.202240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18410a-4a4f-4e38-88cf-e32ed65c56e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.207121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18410a-4a4f-4e38-88cf-e32ed65c56e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.207440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18410a-4a4f-4e38-88cf-e32ed65c56e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.207697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18410a-4a4f-4e38-88cf-e32ed65c56e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.210801 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18410a-4a4f-4e38-88cf-e32ed65c56e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.210977 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 787/1582] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:20.210977 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20eaa0a-5dac-40ad-ae40-7afc2592c748 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.211137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18410a-4a4f-4e38-88cf-e32ed65c56e6 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.231131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20eaa0a-5dac-40ad-ae40-7afc2592c748 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.237695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207eab2-5686-4dfb-ae50-b589bd33af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.238611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207eab2-5686-4dfb-ae50-b589bd33af09 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.239141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207eab2-5686-4dfb-ae50-b589bd33af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.239546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207eab2-5686-4dfb-ae50-b589bd33af09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.240419 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 796/1583] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:20 2022] POST /identity/v3/users => generated 287 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:20.240919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207eab2-5686-4dfb-ae50-b589bd33af09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.242959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18410a-4a4f-4e38-88cf-e32ed65c56e6 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.244964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207eab2-5686-4dfb-ae50-b589bd33af09 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.262153 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18410a-4a4f-4e38-88cf-e32ed65c56e6 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.270762 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486290b-fd69-40d7-b428-c66acb64ea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.271624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486290b-fd69-40d7-b428-c66acb64ea0a admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.272029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486290b-fd69-40d7-b428-c66acb64ea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.272473 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486290b-fd69-40d7-b428-c66acb64ea0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.276242 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486290b-fd69-40d7-b428-c66acb64ea0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.279483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486290b-fd69-40d7-b428-c66acb64ea0a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.295675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 788/1584] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:20 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:20.297096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207eab2-5686-4dfb-ae50-b589bd33af09 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.312165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 797/1585] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:20.313817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486290b-fd69-40d7-b428-c66acb64ea0a admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.326913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486290b-fd69-40d7-b428-c66acb64ea0a admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.364238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=85,keystone:INSERT=15 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:20.416896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd48b7-e438-42df-a6f6-abb7aee6ada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.418853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd48b7-e438-42df-a6f6-abb7aee6ada3 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.419228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd48b7-e438-42df-a6f6-abb7aee6ada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.419845 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd48b7-e438-42df-a6f6-abb7aee6ada3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.420865 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd48b7-e438-42df-a6f6-abb7aee6ada3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.423182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207eab2-5686-4dfb-ae50-b589bd33af09 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.423599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd48b7-e438-42df-a6f6-abb7aee6ada3 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.431531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a7803-dd71-4fca-935b-689ffc7754c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.432470 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a7803-dd71-4fca-935b-689ffc7754c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.432653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a7803-dd71-4fca-935b-689ffc7754c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.432986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a7803-dd71-4fca-935b-689ffc7754c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.433879 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a7803-dd71-4fca-935b-689ffc7754c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.436325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a7803-dd71-4fca-935b-689ffc7754c1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.438390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 798/1586] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:20.442895 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd48b7-e438-42df-a6f6-abb7aee6ada3 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.452154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 789/1587] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:20.456788 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a7803-dd71-4fca-935b-689ffc7754c1 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.458726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd48b7-e438-42df-a6f6-abb7aee6ada3 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.465515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c447940-51fd-48a6-a7a9-5ffe170367c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.467094 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447940-51fd-48a6-a7a9-5ffe170367c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.467405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447940-51fd-48a6-a7a9-5ffe170367c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.467689 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447940-51fd-48a6-a7a9-5ffe170367c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.468340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c447940-51fd-48a6-a7a9-5ffe170367c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.469983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c447940-51fd-48a6-a7a9-5ffe170367c0 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.476117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a7803-dd71-4fca-935b-689ffc7754c1 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.483984 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a86cc7-831a-49cb-97bb-1f167d973f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.484918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a86cc7-831a-49cb-97bb-1f167d973f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.485927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a86cc7-831a-49cb-97bb-1f167d973f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.485927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a86cc7-831a-49cb-97bb-1f167d973f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.486896 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a86cc7-831a-49cb-97bb-1f167d973f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.488408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 799/1588] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:20.489841 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a86cc7-831a-49cb-97bb-1f167d973f7a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.489971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c447940-51fd-48a6-a7a9-5ffe170367c0 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.509512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 790/1589] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:20.510896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c447940-51fd-48a6-a7a9-5ffe170367c0 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.511098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a86cc7-831a-49cb-97bb-1f167d973f7a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.519219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7956d-0062-4be2-bdf6-e48bf532d6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.520566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7956d-0062-4be2-bdf6-e48bf532d6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.521218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7956d-0062-4be2-bdf6-e48bf532d6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.521884 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7956d-0062-4be2-bdf6-e48bf532d6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.524566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7956d-0062-4be2-bdf6-e48bf532d6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.528679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7956d-0062-4be2-bdf6-e48bf532d6e6 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.534652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a86cc7-831a-49cb-97bb-1f167d973f7a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.544719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6327a99-b779-4aee-bdad-489582368823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.545717 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6327a99-b779-4aee-bdad-489582368823 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.546193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6327a99-b779-4aee-bdad-489582368823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.546656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6327a99-b779-4aee-bdad-489582368823 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.547768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6327a99-b779-4aee-bdad-489582368823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.551337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 800/1590] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:20.551656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6327a99-b779-4aee-bdad-489582368823 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.553357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7956d-0062-4be2-bdf6-e48bf532d6e6 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.576375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7956d-0062-4be2-bdf6-e48bf532d6e6 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.592655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 791/1591] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:20 2022] POST /identity/v3/users => generated 286 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:20.594077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6327a99-b779-4aee-bdad-489582368823 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.596250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f07584-84cc-4bb0-8a4e-97ebbff04454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.597414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f07584-84cc-4bb0-8a4e-97ebbff04454 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.597890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f07584-84cc-4bb0-8a4e-97ebbff04454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.598359 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f07584-84cc-4bb0-8a4e-97ebbff04454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.599868 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f07584-84cc-4bb0-8a4e-97ebbff04454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.603875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f07584-84cc-4bb0-8a4e-97ebbff04454 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.611560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6327a99-b779-4aee-bdad-489582368823 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.619599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313999-9ed2-408c-9c62-d23c71a729c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.621731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313999-9ed2-408c-9c62-d23c71a729c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.622195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313999-9ed2-408c-9c62-d23c71a729c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.622806 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313999-9ed2-408c-9c62-d23c71a729c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.623720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a313999-9ed2-408c-9c62-d23c71a729c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.625815 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a313999-9ed2-408c-9c62-d23c71a729c0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.630712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 801/1592] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:20.633909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f07584-84cc-4bb0-8a4e-97ebbff04454 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.642375 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 792/1593] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:20.643607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313999-9ed2-408c-9c62-d23c71a729c0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.654944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f07584-84cc-4bb0-8a4e-97ebbff04454 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.660560 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de64821-60b0-4d2f-b5d8-57c513ce804e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.661353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de64821-60b0-4d2f-b5d8-57c513ce804e admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.661675 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de64821-60b0-4d2f-b5d8-57c513ce804e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.661949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de64821-60b0-4d2f-b5d8-57c513ce804e admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.662825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de64821-60b0-4d2f-b5d8-57c513ce804e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.665284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de64821-60b0-4d2f-b5d8-57c513ce804e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.666787 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313999-9ed2-408c-9c62-d23c71a729c0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.676507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2f9ff-98de-44c6-b4fc-da374cabb95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.677530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2f9ff-98de-44c6-b4fc-da374cabb95b admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.678467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2f9ff-98de-44c6-b4fc-da374cabb95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.679865 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2f9ff-98de-44c6-b4fc-da374cabb95b admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.681170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2f9ff-98de-44c6-b4fc-da374cabb95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.682589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 802/1594] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:20.683701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de64821-60b0-4d2f-b5d8-57c513ce804e admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.685498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2f9ff-98de-44c6-b4fc-da374cabb95b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.696148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de64821-60b0-4d2f-b5d8-57c513ce804e admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.702886 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5df84-51bf-4283-851f-74a3b69d7e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.704053 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5df84-51bf-4283-851f-74a3b69d7e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.704526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5df84-51bf-4283-851f-74a3b69d7e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.704985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5df84-51bf-4283-851f-74a3b69d7e66 admin admin] PATH_INFO: `/v3/projects/9e57baaa87ad42dd9f48e4bfe8ee4cf5/users/32bc4cb848c446ab8d4d330f9e2f0022/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.717029 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 793/1595] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:20.719180 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2f9ff-98de-44c6-b4fc-da374cabb95b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.724675 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5df84-51bf-4283-851f-74a3b69d7e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e57baaa87ad42dd9f48e4bfe8ee4cf5, user_id=32bc4cb848c446ab8d4d330f9e2f0022, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.728106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5df84-51bf-4283-851f-74a3b69d7e66 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.743994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2f9ff-98de-44c6-b4fc-da374cabb95b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.751279 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 803/1596] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:20 2022] PUT /identity/v3/projects/9e57baaa87ad42dd9f48e4bfe8ee4cf5/users/32bc4cb848c446ab8d4d330f9e2f0022/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:20.752355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5df84-51bf-4283-851f-74a3b69d7e66 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.861865 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723c54d-4f9d-417c-b3e2-1d9b47abe593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.862889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723c54d-4f9d-417c-b3e2-1d9b47abe593 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.863362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723c54d-4f9d-417c-b3e2-1d9b47abe593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.863828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723c54d-4f9d-417c-b3e2-1d9b47abe593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.864949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723c54d-4f9d-417c-b3e2-1d9b47abe593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.868393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723c54d-4f9d-417c-b3e2-1d9b47abe593 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.872296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:20.879740 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5df84-51bf-4283-851f-74a3b69d7e66 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.893257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92543ec9-ba35-4262-bb46-c951ed2c20bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.893257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92543ec9-ba35-4262-bb46-c951ed2c20bd admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.893257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92543ec9-ba35-4262-bb46-c951ed2c20bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.893257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92543ec9-ba35-4262-bb46-c951ed2c20bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.894124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92543ec9-ba35-4262-bb46-c951ed2c20bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.894464 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 794/1597] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:20.895127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92543ec9-ba35-4262-bb46-c951ed2c20bd admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.895585 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723c54d-4f9d-417c-b3e2-1d9b47abe593 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.912165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723c54d-4f9d-417c-b3e2-1d9b47abe593 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.916339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 804/1598] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:20.916339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92543ec9-ba35-4262-bb46-c951ed2c20bd admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:20.922947 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c350b-e14a-470c-8597-bba80d3506f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.924019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c350b-e14a-470c-8597-bba80d3506f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.924489 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c350b-e14a-470c-8597-bba80d3506f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.924919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c350b-e14a-470c-8597-bba80d3506f2 admin admin] PATH_INFO: `/v3/projects/a2a8b69a2eaa427e8d300ea67d2f7d6e/users/467666e0a8d64f649526e84fdcc1a7ef/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.931472 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92543ec9-ba35-4262-bb46-c951ed2c20bd admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:20.939485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e1251-3a1e-4f1b-a1b2-9ed9ad7fe2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:20.940640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e1251-3a1e-4f1b-a1b2-9ed9ad7fe2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:20.941445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e1251-3a1e-4f1b-a1b2-9ed9ad7fe2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:20.941588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e1251-3a1e-4f1b-a1b2-9ed9ad7fe2a6 admin admin] PATH_INFO: `/v3/projects/46cb2c907f00426aa3569007308075fe/users/fa3abf6b7b044a1b8ad16aef5413a0f5/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:20.953618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c350b-e14a-470c-8597-bba80d3506f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a8b69a2eaa427e8d300ea67d2f7d6e, user_id=467666e0a8d64f649526e84fdcc1a7ef, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.960073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c350b-e14a-470c-8597-bba80d3506f2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.981415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e1251-3a1e-4f1b-a1b2-9ed9ad7fe2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46cb2c907f00426aa3569007308075fe, user_id=fa3abf6b7b044a1b8ad16aef5413a0f5, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:20.986836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e1251-3a1e-4f1b-a1b2-9ed9ad7fe2a6 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:20.989378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 795/1599] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:20 2022] PUT /identity/v3/projects/a2a8b69a2eaa427e8d300ea67d2f7d6e/users/467666e0a8d64f649526e84fdcc1a7ef/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:20.993490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c350b-e14a-470c-8597-bba80d3506f2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:21.023422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 805/1600] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:20 2022] PUT /identity/v3/projects/46cb2c907f00426aa3569007308075fe/users/fa3abf6b7b044a1b8ad16aef5413a0f5/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:21.023422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e1251-3a1e-4f1b-a1b2-9ed9ad7fe2a6 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:21.077390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:21.123098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c350b-e14a-470c-8597-bba80d3506f2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:21.123505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e1251-3a1e-4f1b-a1b2-9ed9ad7fe2a6 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:21.129647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f5fae-101d-4d5c-991e-327aff236a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:21.130497 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f5fae-101d-4d5c-991e-327aff236a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:21.131699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f5fae-101d-4d5c-991e-327aff236a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:21.131699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f5fae-101d-4d5c-991e-327aff236a3d admin admin] PATH_INFO: `/v3/projects/e36380ee7bf34fe38f3be4ba286eb7e2/users/191ce2888fbb4ea68826afb108e23584/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:21.132096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c83cf-0f75-4578-acad-a40cbda64ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:21.132598 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c83cf-0f75-4578-acad-a40cbda64ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:21.133298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c83cf-0f75-4578-acad-a40cbda64ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:21.133790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c83cf-0f75-4578-acad-a40cbda64ac2 admin admin] PATH_INFO: `/v3/projects/5bf0dca14a9f4d95962fd8a51aa49588/users/03a34b888e8e4a3ca64c9f6fb5f2673d/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:21.154839 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c83cf-0f75-4578-acad-a40cbda64ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf0dca14a9f4d95962fd8a51aa49588, user_id=03a34b888e8e4a3ca64c9f6fb5f2673d, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:21.156376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f5fae-101d-4d5c-991e-327aff236a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36380ee7bf34fe38f3be4ba286eb7e2, user_id=191ce2888fbb4ea68826afb108e23584, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:21.157548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c83cf-0f75-4578-acad-a40cbda64ac2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:21.161804 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f5fae-101d-4d5c-991e-327aff236a3d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:21.181939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 796/1601] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:20 2022] PUT /identity/v3/projects/5bf0dca14a9f4d95962fd8a51aa49588/users/03a34b888e8e4a3ca64c9f6fb5f2673d/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:21.183409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd6d07-19e1-4423-a1d5-2d4d3d016181 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:21.183701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd6d07-19e1-4423-a1d5-2d4d3d016181 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:21.184594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd6d07-19e1-4423-a1d5-2d4d3d016181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:21.218799 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 806/1602] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:21 2022] PUT /identity/v3/projects/e36380ee7bf34fe38f3be4ba286eb7e2/users/191ce2888fbb4ea68826afb108e23584/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:21.218799 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f5fae-101d-4d5c-991e-327aff236a3d admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:21.219480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-aafd6d07-19e1-4423-a1d5-2d4d3d016181 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:21.221140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-aafd6d07-19e1-4423-a1d5-2d4d3d016181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:21.294002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f5fae-101d-4d5c-991e-327aff236a3d admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:21.299413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de326c5-4b8f-4172-a6ea-2f74ad135a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:21.300333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de326c5-4b8f-4172-a6ea-2f74ad135a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:21.300797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de326c5-4b8f-4172-a6ea-2f74ad135a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:21.301231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de326c5-4b8f-4172-a6ea-2f74ad135a87 admin admin] PATH_INFO: `/v3/projects/706aaeb0d5644b00966b4ae643a44c82/users/c8fd17b07b664698a8cc73dd7f67f489/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:21.319889 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de326c5-4b8f-4172-a6ea-2f74ad135a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=706aaeb0d5644b00966b4ae643a44c82, user_id=c8fd17b07b664698a8cc73dd7f67f489, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:21.323165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de326c5-4b8f-4172-a6ea-2f74ad135a87 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:21.328682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 797/1603] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:21.330353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd6d07-19e1-4423-a1d5-2d4d3d016181 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:21.343142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 807/1604] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:21 2022] PUT /identity/v3/projects/706aaeb0d5644b00966b4ae643a44c82/users/c8fd17b07b664698a8cc73dd7f67f489/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:21.343870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd6d07-19e1-4423-a1d5-2d4d3d016181 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:21.344700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e46e-eb70-4528-840c-0798fb20ef14 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:21.345061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e46e-eb70-4528-840c-0798fb20ef14 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:21.345431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e46e-eb70-4528-840c-0798fb20ef14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:21.368490 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-cbb5e46e-eb70-4528-840c-0798fb20ef14 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:21.370779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cbb5e46e-eb70-4528-840c-0798fb20ef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:21.416785 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:21.426976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccb02f-c209-4b6a-a31c-3fd796890605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:21.428273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccb02f-c209-4b6a-a31c-3fd796890605 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:21.429337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccb02f-c209-4b6a-a31c-3fd796890605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:21.430195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccb02f-c209-4b6a-a31c-3fd796890605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:21.431690 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccb02f-c209-4b6a-a31c-3fd796890605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:21.435951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccb02f-c209-4b6a-a31c-3fd796890605 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:21.453759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 808/1605] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:21.455342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a3c6-01f6-4e0f-bc5b-b2c4133b1a0a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:21.455636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a3c6-01f6-4e0f-bc5b-b2c4133b1a0a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:21.455920 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a3c6-01f6-4e0f-bc5b-b2c4133b1a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:21.458370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 798/1606] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:21.460727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356e6ed-d3b3-4ed6-a4f9-f71e371b6169 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:21.461300 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356e6ed-d3b3-4ed6-a4f9-f71e371b6169 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:21.461873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356e6ed-d3b3-4ed6-a4f9-f71e371b6169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:21.481916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-da19a3c6-01f6-4e0f-bc5b-b2c4133b1a0a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:21.483711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-da19a3c6-01f6-4e0f-bc5b-b2c4133b1a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:21.497611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4356e6ed-d3b3-4ed6-a4f9-f71e371b6169 None None] MFA Rules not processed for user `03a34b888e8e4a3ca64c9f6fb5f2673d`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:21.501283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4356e6ed-d3b3-4ed6-a4f9-f71e371b6169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:21.507524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 809/1607] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:21.509389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe3874-5806-43ee-b535-c8886e406643 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:21.509832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe3874-5806-43ee-b535-c8886e406643 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:21.510120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe3874-5806-43ee-b535-c8886e406643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:21.559214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-37fe3874-5806-43ee-b535-c8886e406643 None None] MFA Rules not processed for user `191ce2888fbb4ea68826afb108e23584`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:21.561344 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-37fe3874-5806-43ee-b535-c8886e406643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:21.589364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:21.608814 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 799/1608] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:21.608814 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356e6ed-d3b3-4ed6-a4f9-f71e371b6169 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:21.610425 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4356e6ed-d3b3-4ed6-a4f9-f71e371b6169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:21.722619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356e6ed-d3b3-4ed6-a4f9-f71e371b6169 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:21.732384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 810/1609] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:21.735589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af287ae2-d3c3-43ed-b1f0-3b6ff4721dbd None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:21.743407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f401d-a64c-4616-ae49-37ca79647b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:21.743850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f401d-a64c-4616-ae49-37ca79647b8b service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:21.745836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f401d-a64c-4616-ae49-37ca79647b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:21.746220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f401d-a64c-4616-ae49-37ca79647b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:21.756406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af287ae2-d3c3-43ed-b1f0-3b6ff4721dbd None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:21.757521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af287ae2-d3c3-43ed-b1f0-3b6ff4721dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:21.776237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f401d-a64c-4616-ae49-37ca79647b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:21.777710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f401d-a64c-4616-ae49-37ca79647b8b service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:21.792801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 800/1610] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:21.793668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f401d-a64c-4616-ae49-37ca79647b8b service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:21.811199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f401d-a64c-4616-ae49-37ca79647b8b service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:21.816892 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-af287ae2-d3c3-43ed-b1f0-3b6ff4721dbd None None] MFA Rules not processed for user `c8fd17b07b664698a8cc73dd7f67f489`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:21.818857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-af287ae2-d3c3-43ed-b1f0-3b6ff4721dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:21.824696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be80094-cc06-447f-beb7-6862e6868a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:21.825432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be80094-cc06-447f-beb7-6862e6868a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:21.825852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be80094-cc06-447f-beb7-6862e6868a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:21.826134 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be80094-cc06-447f-beb7-6862e6868a65 admin admin] PATH_INFO: `/v3/projects/481565495c53451c8546815b8325d557/users/9a961f491bb14b13a3de34d4afc7fa86/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:21.872970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be80094-cc06-447f-beb7-6862e6868a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481565495c53451c8546815b8325d557, user_id=9a961f491bb14b13a3de34d4afc7fa86, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:21.887653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be80094-cc06-447f-beb7-6862e6868a65 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:21.926556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 811/1611] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:21.927693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af287ae2-d3c3-43ed-b1f0-3b6ff4721dbd None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:21.928440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 801/1612] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:21 2022] PUT /identity/v3/projects/481565495c53451c8546815b8325d557/users/9a961f491bb14b13a3de34d4afc7fa86/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:21.930208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be80094-cc06-447f-beb7-6862e6868a65 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:21.954993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af287ae2-d3c3-43ed-b1f0-3b6ff4721dbd None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:22.021312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052d009-10b1-4bd3-87a9-adf9e1ad449c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:22.023688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052d009-10b1-4bd3-87a9-adf9e1ad449c service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:22.023688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052d009-10b1-4bd3-87a9-adf9e1ad449c service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:22.023688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052d009-10b1-4bd3-87a9-adf9e1ad449c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:22.098260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be80094-cc06-447f-beb7-6862e6868a65 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:22.109409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67150040-d0b7-414c-a1a5-a75054d99088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:22.110148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67150040-d0b7-414c-a1a5-a75054d99088 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:22.111028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:22.111592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67150040-d0b7-414c-a1a5-a75054d99088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:22.111900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67150040-d0b7-414c-a1a5-a75054d99088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:22.116590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052d009-10b1-4bd3-87a9-adf9e1ad449c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:22.118657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052d009-10b1-4bd3-87a9-adf9e1ad449c service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:22.139016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 812/1613] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:22.142172 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb705-321a-4f12-b817-49785a57c4a9 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:22.144803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb705-321a-4f12-b817-49785a57c4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:22.145100 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb705-321a-4f12-b817-49785a57c4a9 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:22.146645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67150040-d0b7-414c-a1a5-a75054d99088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:22.151788 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 813/1614] 10.222.0.17 () {54 vars in 962 bytes} [Fri Aug 19 21:07:22 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:07:22.153036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bb705-321a-4f12-b817-49785a57c4a9 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:22.164951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67150040-d0b7-414c-a1a5-a75054d99088 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:22.198769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 802/1615] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:22.200697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67150040-d0b7-414c-a1a5-a75054d99088 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:22.217138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:22.233249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67150040-d0b7-414c-a1a5-a75054d99088 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:22.247700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3020f-4dfc-44f6-9df5-7d5fcf6078d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:22.249237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3020f-4dfc-44f6-9df5-7d5fcf6078d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:22.249732 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3020f-4dfc-44f6-9df5-7d5fcf6078d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:22.250215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3020f-4dfc-44f6-9df5-7d5fcf6078d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:22.251812 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3020f-4dfc-44f6-9df5-7d5fcf6078d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:22.260855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3020f-4dfc-44f6-9df5-7d5fcf6078d8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:22.326327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bb705-321a-4f12-b817-49785a57c4a9 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:22.336447 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76001024-f575-4b26-b81d-f3d3818d753f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:22.337220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76001024-f575-4b26-b81d-f3d3818d753f service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:22.340743 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76001024-f575-4b26-b81d-f3d3818d753f service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:22.341193 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76001024-f575-4b26-b81d-f3d3818d753f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:22.341582 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 803/1616] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:22 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:22.343513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc42de-719c-46b5-836b-305c6c3b1014 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:22.343852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc42de-719c-46b5-836b-305c6c3b1014 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:22.344512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc42de-719c-46b5-836b-305c6c3b1014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:22.389589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-febc42de-719c-46b5-836b-305c6c3b1014 None None] MFA Rules not processed for user `9a961f491bb14b13a3de34d4afc7fa86`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:22.391330 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-febc42de-719c-46b5-836b-305c6c3b1014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:22.447674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76001024-f575-4b26-b81d-f3d3818d753f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:22.449291 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76001024-f575-4b26-b81d-f3d3818d753f service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:22.472107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 814/1617] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:22.481300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c2b25-b0c7-4046-b212-fb7a5de5bc9a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:22.481523 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c2b25-b0c7-4046-b212-fb7a5de5bc9a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:22.481808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c2b25-b0c7-4046-b212-fb7a5de5bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:22.514207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 804/1618] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:22.514207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc42de-719c-46b5-836b-305c6c3b1014 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:22.689273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-460c2b25-b0c7-4046-b212-fb7a5de5bc9a None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:22.689273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-460c2b25-b0c7-4046-b212-fb7a5de5bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:22.696540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc42de-719c-46b5-836b-305c6c3b1014 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:22.708152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33772df-fbe6-4549-bc70-6ac3a966cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:22.709170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33772df-fbe6-4549-bc70-6ac3a966cb83 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:22.710084 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33772df-fbe6-4549-bc70-6ac3a966cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:22.711175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33772df-fbe6-4549-bc70-6ac3a966cb83 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:22.711952 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33772df-fbe6-4549-bc70-6ac3a966cb83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:22.715043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33772df-fbe6-4549-bc70-6ac3a966cb83 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:22.763702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 805/1619] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:22 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:22.765099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3856a-f2e2-4d5f-a5ef-a542f7eb9cbb None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:22.765402 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3856a-f2e2-4d5f-a5ef-a542f7eb9cbb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:22.765946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3856a-f2e2-4d5f-a5ef-a542f7eb9cbb None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:22.774956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 806/1620] 10.222.0.17 () {54 vars in 962 bytes} [Fri Aug 19 21:07:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:07:22.776247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3856a-f2e2-4d5f-a5ef-a542f7eb9cbb None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:22.806023 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3856a-f2e2-4d5f-a5ef-a542f7eb9cbb None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:22.816758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60e507-fcd9-4a00-ad94-67d781350b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:22.817707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60e507-fcd9-4a00-ad94-67d781350b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:22.818329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60e507-fcd9-4a00-ad94-67d781350b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:22.819148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60e507-fcd9-4a00-ad94-67d781350b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:22.821811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60e507-fcd9-4a00-ad94-67d781350b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:22.825506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60e507-fcd9-4a00-ad94-67d781350b90 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:22.842014 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 815/1621] 10.222.0.17 () {58 vars in 1059 bytes} [Fri Aug 19 21:07:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:22.843352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02ee17-bd0e-4f8f-9247-7815b892a8ac None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:22.843632 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02ee17-bd0e-4f8f-9247-7815b892a8ac None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:22.843912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02ee17-bd0e-4f8f-9247-7815b892a8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:22.859513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 807/1622] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:22.861692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60e507-fcd9-4a00-ad94-67d781350b90 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:22.885673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60e507-fcd9-4a00-ad94-67d781350b90 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:22.887193 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-1f02ee17-bd0e-4f8f-9247-7815b892a8ac None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:22.891249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1f02ee17-bd0e-4f8f-9247-7815b892a8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:22.900321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6713a9c-74e3-40da-965e-09e495896199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:22.901543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6713a9c-74e3-40da-965e-09e495896199 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:22.902911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6713a9c-74e3-40da-965e-09e495896199 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:22.903449 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6713a9c-74e3-40da-965e-09e495896199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:22.914773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 816/1623] 10.222.0.17 () {58 vars in 1059 bytes} [Fri Aug 19 21:07:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:22.915605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02ee17-bd0e-4f8f-9247-7815b892a8ac None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:22.940206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02ee17-bd0e-4f8f-9247-7815b892a8ac None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:22.950925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047add60-e7a9-4a03-abf6-129426a10f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:22.951620 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047add60-e7a9-4a03-abf6-129426a10f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:22.951907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047add60-e7a9-4a03-abf6-129426a10f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:22.952187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047add60-e7a9-4a03-abf6-129426a10f03 admin admin] PATH_INFO: `/v3/projects/8fa0d92cad0b46e393c8031dff9a4e74/users/bdbf834e86984bb2bc463efee94e01aa/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:22.987664 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047add60-e7a9-4a03-abf6-129426a10f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa0d92cad0b46e393c8031dff9a4e74, user_id=bdbf834e86984bb2bc463efee94e01aa, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:22.990818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047add60-e7a9-4a03-abf6-129426a10f03 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:23.009868 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:23.018486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:23.025074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 817/1624] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:22 2022] PUT /identity/v3/projects/8fa0d92cad0b46e393c8031dff9a4e74/users/bdbf834e86984bb2bc463efee94e01aa/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:23.025074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047add60-e7a9-4a03-abf6-129426a10f03 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:23.041123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6713a9c-74e3-40da-965e-09e495896199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:23.042885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6713a9c-74e3-40da-965e-09e495896199 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:23.076896 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 808/1625] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:23.078222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6713a9c-74e3-40da-965e-09e495896199 service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:23.091616 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6713a9c-74e3-40da-965e-09e495896199 service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:23.198583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047add60-e7a9-4a03-abf6-129426a10f03 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:23.206768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6a7f4-bdb2-4bdd-a7da-92060c1f6772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:23.207652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6a7f4-bdb2-4bdd-a7da-92060c1f6772 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:23.208275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cf63e-fbee-4130-93de-9587e12d67e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:23.208519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6a7f4-bdb2-4bdd-a7da-92060c1f6772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:23.208970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6a7f4-bdb2-4bdd-a7da-92060c1f6772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:23.209077 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cf63e-fbee-4130-93de-9587e12d67e2 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:23.209556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cf63e-fbee-4130-93de-9587e12d67e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:23.210940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cf63e-fbee-4130-93de-9587e12d67e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:23.211922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6a7f4-bdb2-4bdd-a7da-92060c1f6772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:23.214001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6a7f4-bdb2-4bdd-a7da-92060c1f6772 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:23.231027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 809/1626] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:23.235048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6a7f4-bdb2-4bdd-a7da-92060c1f6772 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:23.251087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6a7f4-bdb2-4bdd-a7da-92060c1f6772 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:23.266320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe59c6d-f8f2-4399-ae04-8bd0bee2f9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:23.267480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe59c6d-f8f2-4399-ae04-8bd0bee2f9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:23.268096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe59c6d-f8f2-4399-ae04-8bd0bee2f9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:23.268878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe59c6d-f8f2-4399-ae04-8bd0bee2f9cd admin admin] PATH_INFO: `/v3/projects/8fa0d92cad0b46e393c8031dff9a4e74/users/bdbf834e86984bb2bc463efee94e01aa/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:23.272127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe59c6d-f8f2-4399-ae04-8bd0bee2f9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa0d92cad0b46e393c8031dff9a4e74, user_id=bdbf834e86984bb2bc463efee94e01aa, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:23.278110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe59c6d-f8f2-4399-ae04-8bd0bee2f9cd admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:23.313668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cf63e-fbee-4130-93de-9587e12d67e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:23.316043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cf63e-fbee-4130-93de-9587e12d67e2 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:23.334526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 818/1628] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:23.338827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 810/1628] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:23 2022] PUT /identity/v3/projects/8fa0d92cad0b46e393c8031dff9a4e74/users/bdbf834e86984bb2bc463efee94e01aa/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:23.346773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacddcc9-1231-4e6f-a930-d8d034eb159b None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:23.347224 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacddcc9-1231-4e6f-a930-d8d034eb159b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:23.347513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacddcc9-1231-4e6f-a930-d8d034eb159b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:23.400699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-bacddcc9-1231-4e6f-a930-d8d034eb159b None None] MFA Rules not processed for user `bdbf834e86984bb2bc463efee94e01aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:23.402500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-bacddcc9-1231-4e6f-a930-d8d034eb159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:23.555380 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 819/1629] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:23.559468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe59c6d-f8f2-4399-ae04-8bd0bee2f9cd admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:23.716449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231e60-7fc8-4b2d-a042-036c5eec4ee3 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:23.716818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231e60-7fc8-4b2d-a042-036c5eec4ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:23.717112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231e60-7fc8-4b2d-a042-036c5eec4ee3 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:23.719035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 820/1630] 10.222.0.17 () {54 vars in 912 bytes} [Fri Aug 19 21:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:07:23.724087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09337cb-4e20-409c-9878-1f51215d7996 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:23.724378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09337cb-4e20-409c-9878-1f51215d7996 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:23.724654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09337cb-4e20-409c-9878-1f51215d7996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:23.752636 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe59c6d-f8f2-4399-ae04-8bd0bee2f9cd admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:23.756661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0313c-47a1-4f66-b6f1-4dbbdd898924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:23.757694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0313c-47a1-4f66-b6f1-4dbbdd898924 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:23.757926 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0313c-47a1-4f66-b6f1-4dbbdd898924 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:23.758163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0313c-47a1-4f66-b6f1-4dbbdd898924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:23.763733 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e09337cb-4e20-409c-9878-1f51215d7996 None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:23.767341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e09337cb-4e20-409c-9878-1f51215d7996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:23.778862 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0313c-47a1-4f66-b6f1-4dbbdd898924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:23.780378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0313c-47a1-4f66-b6f1-4dbbdd898924 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:23.794289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 811/1631] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:23.830347 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:23.975247 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 821/1632] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:07:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:07:23.995040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0313c-47a1-4f66-b6f1-4dbbdd898924 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:24.011432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0313c-47a1-4f66-b6f1-4dbbdd898924 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:24.020001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6bb0a-9c86-4477-ae90-fc6f2494205e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:24.020708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6bb0a-9c86-4477-ae90-fc6f2494205e service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:24.020952 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6bb0a-9c86-4477-ae90-fc6f2494205e service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:24.021220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6bb0a-9c86-4477-ae90-fc6f2494205e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:24.036935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5dfe8-073e-4982-9435-8d42c39b8beb None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:24.037730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5dfe8-073e-4982-9435-8d42c39b8beb None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:24.039327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5dfe8-073e-4982-9435-8d42c39b8beb None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:24.042028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 822/1633] 10.222.0.17 () {54 vars in 912 bytes} [Fri Aug 19 21:07:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:07:24.049061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db3201-d6c2-4fa3-85cc-402d0612252b None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:24.049595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db3201-d6c2-4fa3-85cc-402d0612252b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:24.049979 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db3201-d6c2-4fa3-85cc-402d0612252b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:24.095132 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6bb0a-9c86-4477-ae90-fc6f2494205e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:24.103928 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6bb0a-9c86-4477-ae90-fc6f2494205e service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:24.140277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-29db3201-d6c2-4fa3-85cc-402d0612252b None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:24.142408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-29db3201-d6c2-4fa3-85cc-402d0612252b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:24.147946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 812/1634] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:24.180382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 823/1635] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:07:24.247465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6bb0a-9c86-4477-ae90-fc6f2494205e service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:24.266800 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6bb0a-9c86-4477-ae90-fc6f2494205e service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:24.280490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445cdc9-0ce5-4b5e-8e13-15a0e77f0fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:24.281123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445cdc9-0ce5-4b5e-8e13-15a0e77f0fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:24.281409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445cdc9-0ce5-4b5e-8e13-15a0e77f0fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:24.281687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445cdc9-0ce5-4b5e-8e13-15a0e77f0fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:24.318015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445cdc9-0ce5-4b5e-8e13-15a0e77f0fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:24.319771 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445cdc9-0ce5-4b5e-8e13-15a0e77f0fc3 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:24.372432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 813/1636] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:25.939783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db3201-d6c2-4fa3-85cc-402d0612252b None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:26.149083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db3201-d6c2-4fa3-85cc-402d0612252b None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:26.179407 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:26.182415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:26.182759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:26.183058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] PATH_INFO: `/v3/users/c8fd17b07b664698a8cc73dd7f67f489` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:26.187618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8fd17b07b664698a8cc73dd7f67f489)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:26.191275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: WARNING py.warnings [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:07:26.191275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: warnings.warn(msg) Aug 19 21:07:26.191275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: Aug 19 21:07:26.198769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:26.401394 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8fd17b07b664698a8cc73dd7f67f489'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:26.422176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8fd17b07b664698a8cc73dd7f67f489'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:26.423916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8fd17b07b664698a8cc73dd7f67f489'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:26.425221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8fd17b07b664698a8cc73dd7f67f489'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:26.474579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8fd17b07b664698a8cc73dd7f67f489'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:26.501015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 824/1637] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:07:25 2022] DELETE /identity/v3/users/c8fd17b07b664698a8cc73dd7f67f489 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:26.502784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725161dc-e4ec-4a18-851e-63aca885171c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:26.503313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725161dc-e4ec-4a18-851e-63aca885171c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:26.503752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725161dc-e4ec-4a18-851e-63aca885171c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:26.580563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-725161dc-e4ec-4a18-851e-63aca885171c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:26.582551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-725161dc-e4ec-4a18-851e-63aca885171c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:26.737898 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:26.791530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 814/1638] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:07:26.856507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:26.857980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:26.936332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:27.125903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a8044-0f56-4f1a-92a0-5c112fd0be79 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:27.146346 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a30934-3018-4006-8e42-6399114134a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:27.147216 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a30934-3018-4006-8e42-6399114134a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:27.148188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a30934-3018-4006-8e42-6399114134a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:27.148682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a30934-3018-4006-8e42-6399114134a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:27.174123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a30934-3018-4006-8e42-6399114134a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:27.179302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a30934-3018-4006-8e42-6399114134a0 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:27.209882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 825/1639] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:28.775151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725161dc-e4ec-4a18-851e-63aca885171c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:28.776638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-725161dc-e4ec-4a18-851e-63aca885171c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:28.806194 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725161dc-e4ec-4a18-851e-63aca885171c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:28.824834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:28.827086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:28.827378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:28.828516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] PATH_INFO: `/v3/users/9a961f491bb14b13a3de34d4afc7fa86` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:28.831347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a961f491bb14b13a3de34d4afc7fa86)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:28.836768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:29.040523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a961f491bb14b13a3de34d4afc7fa86'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:29.103079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a961f491bb14b13a3de34d4afc7fa86'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:29.122867 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a961f491bb14b13a3de34d4afc7fa86'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:29.124074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a961f491bb14b13a3de34d4afc7fa86'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:29.124398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a961f491bb14b13a3de34d4afc7fa86'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:29.146201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 815/1640] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:07:28 2022] DELETE /identity/v3/users/9a961f491bb14b13a3de34d4afc7fa86 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:29.152179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e966e9d-136c-4c32-8a68-06a7b65b5eb2 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:29.153036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e966e9d-136c-4c32-8a68-06a7b65b5eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:29.153036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e966e9d-136c-4c32-8a68-06a7b65b5eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:29.193176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-5e966e9d-136c-4c32-8a68-06a7b65b5eb2 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:29.194709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5e966e9d-136c-4c32-8a68-06a7b65b5eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:29.337202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 826/1641] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:29.481733 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:29.483348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:29.647373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca343c5-a504-4fb1-86a3-fb4e2e5d89be admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:29.652103 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc2738-881b-4386-8c31-9eaff7efab9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:29.652888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc2738-881b-4386-8c31-9eaff7efab9e service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:29.653445 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc2738-881b-4386-8c31-9eaff7efab9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:29.653869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc2738-881b-4386-8c31-9eaff7efab9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:29.665321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc2738-881b-4386-8c31-9eaff7efab9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:29.668582 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc2738-881b-4386-8c31-9eaff7efab9e service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:29.724706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 816/1642] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:30.298596 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e966e9d-136c-4c32-8a68-06a7b65b5eb2 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:30.300318 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5e966e9d-136c-4c32-8a68-06a7b65b5eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:30.326783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e966e9d-136c-4c32-8a68-06a7b65b5eb2 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:30.356541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:30.357302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:30.361695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:30.362661 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] PATH_INFO: `/v3/projects/706aaeb0d5644b00966b4ae643a44c82` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:30.365131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=706aaeb0d5644b00966b4ae643a44c82)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:30.368669 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:30.499879 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706aaeb0d5644b00966b4ae643a44c82', 'request_id': 'req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:30.517703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706aaeb0d5644b00966b4ae643a44c82', 'request_id': 'req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:30.549115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706aaeb0d5644b00966b4ae643a44c82', 'request_id': 'req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:30.566218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] The token cache is being invalidate because project 706aaeb0d5644b00966b4ae643a44c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:07:30.567292 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:30.568305 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:30.570614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 827/1643] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:07:30 2022] DELETE /identity/v3/projects/706aaeb0d5644b00966b4ae643a44c82 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:30.574360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc2738-881b-4386-8c31-9eaff7efab9e service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:30.587901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc2738-881b-4386-8c31-9eaff7efab9e service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:30.744747 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:30.745416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:30.745699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:30.745974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] PATH_INFO: `/v3/users/bdbf834e86984bb2bc463efee94e01aa` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:30.751384 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdbf834e86984bb2bc463efee94e01aa)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:30.754050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:30.769719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:30.866724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdbf834e86984bb2bc463efee94e01aa'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:30.893442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdbf834e86984bb2bc463efee94e01aa'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:30.915949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdbf834e86984bb2bc463efee94e01aa'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:30.917197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdbf834e86984bb2bc463efee94e01aa'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:30.918040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdbf834e86984bb2bc463efee94e01aa'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:30.961249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 817/1644] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:07:30 2022] DELETE /identity/v3/users/bdbf834e86984bb2bc463efee94e01aa => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:31.796985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:31.798624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:31.821201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39bd5f-b56d-4db0-8974-8b0e52d9ed62 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:31.909835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:31.911310 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:32.025691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:32.045956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fca927-3ec5-4206-aa9e-ee8ca13c18f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:32.046630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca927-3ec5-4206-aa9e-ee8ca13c18f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:32.050141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca927-3ec5-4206-aa9e-ee8ca13c18f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:32.051094 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca927-3ec5-4206-aa9e-ee8ca13c18f9 admin admin] PATH_INFO: `/v3/users/03a34b888e8e4a3ca64c9f6fb5f2673d` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:32.052722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fca927-3ec5-4206-aa9e-ee8ca13c18f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a34b888e8e4a3ca64c9f6fb5f2673d)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:32.065267 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fca927-3ec5-4206-aa9e-ee8ca13c18f9 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:32.076161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184795d-b48c-4bba-82db-825614983e07 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:32.092294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063017c3-4fe5-46e9-b513-caf18f99379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:32.093194 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063017c3-4fe5-46e9-b513-caf18f99379b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:32.093645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063017c3-4fe5-46e9-b513-caf18f99379b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:32.094077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063017c3-4fe5-46e9-b513-caf18f99379b admin admin] PATH_INFO: `/v3/projects/481565495c53451c8546815b8325d557` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:32.095496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063017c3-4fe5-46e9-b513-caf18f99379b admin admin] RBAC: Authorizing `identity:delete_project(project_id=481565495c53451c8546815b8325d557)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:32.096711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: WARNING py.warnings [None req-063017c3-4fe5-46e9-b513-caf18f99379b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:07:32.096711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: warnings.warn(msg) Aug 19 21:07:32.096711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: Aug 19 21:07:32.098256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063017c3-4fe5-46e9-b513-caf18f99379b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:32.210688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-063017c3-4fe5-46e9-b513-caf18f99379b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481565495c53451c8546815b8325d557', 'request_id': 'req-063017c3-4fe5-46e9-b513-caf18f99379b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:32.218397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-063017c3-4fe5-46e9-b513-caf18f99379b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481565495c53451c8546815b8325d557', 'request_id': 'req-063017c3-4fe5-46e9-b513-caf18f99379b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:32.245436 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-063017c3-4fe5-46e9-b513-caf18f99379b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481565495c53451c8546815b8325d557', 'request_id': 'req-063017c3-4fe5-46e9-b513-caf18f99379b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:32.259447 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-84fca927-3ec5-4206-aa9e-ee8ca13c18f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a34b888e8e4a3ca64c9f6fb5f2673d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:32.284798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-84fca927-3ec5-4206-aa9e-ee8ca13c18f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a34b888e8e4a3ca64c9f6fb5f2673d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:32.285621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-84fca927-3ec5-4206-aa9e-ee8ca13c18f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a34b888e8e4a3ca64c9f6fb5f2673d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:32.286481 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-84fca927-3ec5-4206-aa9e-ee8ca13c18f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a34b888e8e4a3ca64c9f6fb5f2673d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:32.308487 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-063017c3-4fe5-46e9-b513-caf18f99379b admin admin] The token cache is being invalidate because project 481565495c53451c8546815b8325d557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:07:32.308788 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-063017c3-4fe5-46e9-b513-caf18f99379b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:32.311251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-063017c3-4fe5-46e9-b513-caf18f99379b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:32.313011 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 818/1645] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:07:31 2022] DELETE /identity/v3/projects/481565495c53451c8546815b8325d557 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:32.318117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194c4c3-afcb-46ce-a664-b7f7e8b6609e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:32.318650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194c4c3-afcb-46ce-a664-b7f7e8b6609e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:32.319130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194c4c3-afcb-46ce-a664-b7f7e8b6609e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:32.343396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-84fca927-3ec5-4206-aa9e-ee8ca13c18f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a34b888e8e4a3ca64c9f6fb5f2673d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:32.349848 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8194c4c3-afcb-46ce-a664-b7f7e8b6609e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:32.353040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8194c4c3-afcb-46ce-a664-b7f7e8b6609e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:32.371718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:32.401678 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 828/1646] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:07:31 2022] DELETE /identity/v3/users/03a34b888e8e4a3ca64c9f6fb5f2673d => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:32.405329 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00b361-6219-4ca2-8325-965a0162caaa None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:32.405710 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00b361-6219-4ca2-8325-965a0162caaa None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:32.405969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00b361-6219-4ca2-8325-965a0162caaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:32.458298 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-fd00b361-6219-4ca2-8325-965a0162caaa None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:32.459576 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-fd00b361-6219-4ca2-8325-965a0162caaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:32.566446 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 819/1647] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:07:32.576787 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfba550-7166-42ed-8df2-5de4080e7a8a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:32.577288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfba550-7166-42ed-8df2-5de4080e7a8a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:32.577693 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfba550-7166-42ed-8df2-5de4080e7a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:32.622624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-cbfba550-7166-42ed-8df2-5de4080e7a8a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:32.625384 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cbfba550-7166-42ed-8df2-5de4080e7a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:32.679107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 829/1648] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:32.733310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00b361-6219-4ca2-8325-965a0162caaa None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:32.735993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-fd00b361-6219-4ca2-8325-965a0162caaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:32.776654 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 820/1649] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:07:32.783200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfba550-7166-42ed-8df2-5de4080e7a8a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:32.801804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfba550-7166-42ed-8df2-5de4080e7a8a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:32.809762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c91c20-b7d0-4015-bdc4-45df54bd5054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:32.811655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c91c20-b7d0-4015-bdc4-45df54bd5054 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:32.812131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c91c20-b7d0-4015-bdc4-45df54bd5054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:32.812731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c91c20-b7d0-4015-bdc4-45df54bd5054 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:32.813578 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c91c20-b7d0-4015-bdc4-45df54bd5054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:32.814075 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c91c20-b7d0-4015-bdc4-45df54bd5054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:32.819614 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c91c20-b7d0-4015-bdc4-45df54bd5054 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:32.849413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 821/1650] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:32.861435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c91c20-b7d0-4015-bdc4-45df54bd5054 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:32.886773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c91c20-b7d0-4015-bdc4-45df54bd5054 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:32.899787 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e041d45-2482-4299-89fb-f13a98a2043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:32.901150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e041d45-2482-4299-89fb-f13a98a2043e admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:32.901716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e041d45-2482-4299-89fb-f13a98a2043e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:32.902882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e041d45-2482-4299-89fb-f13a98a2043e admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:32.903934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e041d45-2482-4299-89fb-f13a98a2043e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:32.906678 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e041d45-2482-4299-89fb-f13a98a2043e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:32.989481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 822/1651] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:32 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:32.995981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e041d45-2482-4299-89fb-f13a98a2043e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:32.999946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00b361-6219-4ca2-8325-965a0162caaa None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:33.063266 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:33.155781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029e285-b712-4181-9083-8799a1577fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:33.157612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e285-b712-4181-9083-8799a1577fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:33.157957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e285-b712-4181-9083-8799a1577fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:33.158239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e285-b712-4181-9083-8799a1577fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:33.270811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e041d45-2482-4299-89fb-f13a98a2043e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:33.285302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2de6e1-5de3-4576-9fd9-b893b875ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:33.286114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2de6e1-5de3-4576-9fd9-b893b875ee91 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:33.286492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2de6e1-5de3-4576-9fd9-b893b875ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:33.286896 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2de6e1-5de3-4576-9fd9-b893b875ee91 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:33.287659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2de6e1-5de3-4576-9fd9-b893b875ee91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:33.290405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2de6e1-5de3-4576-9fd9-b893b875ee91 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:33.350026 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029e285-b712-4181-9083-8799a1577fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:33.352593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029e285-b712-4181-9083-8799a1577fc4 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:33.355692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 823/1652] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:32 2022] POST /identity/v3/users => generated 283 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:33.356991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e1206-6bf4-4b09-803f-ea8e08da1adb None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:33.357376 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e1206-6bf4-4b09-803f-ea8e08da1adb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:33.359512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e1206-6bf4-4b09-803f-ea8e08da1adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:33.370429 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 830/1653] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:33.371428 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029e285-b712-4181-9083-8799a1577fc4 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:33.383759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029e285-b712-4181-9083-8799a1577fc4 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:33.389129 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa50aa-ab69-47c7-8daa-aaf46625d41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:33.389929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa50aa-ab69-47c7-8daa-aaf46625d41e admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:33.390212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa50aa-ab69-47c7-8daa-aaf46625d41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:33.390491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa50aa-ab69-47c7-8daa-aaf46625d41e admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:33.392247 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa50aa-ab69-47c7-8daa-aaf46625d41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:33.393935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa50aa-ab69-47c7-8daa-aaf46625d41e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:33.404251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:33.426250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 831/1654] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:33.426881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9e8e1206-6bf4-4b09-803f-ea8e08da1adb None None] MFA Rules not processed for user `8b4a6b0dc41d446f8c46bd5097f6b254`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:33.428090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa50aa-ab69-47c7-8daa-aaf46625d41e admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:33.431340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9e8e1206-6bf4-4b09-803f-ea8e08da1adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:33.442625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa50aa-ab69-47c7-8daa-aaf46625d41e admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:33.454890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d9fbe-02f3-40ed-beb6-68eefa26e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:33.455956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d9fbe-02f3-40ed-beb6-68eefa26e765 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:33.456274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d9fbe-02f3-40ed-beb6-68eefa26e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:33.457025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d9fbe-02f3-40ed-beb6-68eefa26e765 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:33.458187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d9fbe-02f3-40ed-beb6-68eefa26e765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:33.462287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d9fbe-02f3-40ed-beb6-68eefa26e765 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:33.483069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 832/1655] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:33.484086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d9fbe-02f3-40ed-beb6-68eefa26e765 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:33.509107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d9fbe-02f3-40ed-beb6-68eefa26e765 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:33.515631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefa0cb-c223-476b-a2f6-7741a48b165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:33.516668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefa0cb-c223-476b-a2f6-7741a48b165a admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:33.517017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefa0cb-c223-476b-a2f6-7741a48b165a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:33.518228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefa0cb-c223-476b-a2f6-7741a48b165a admin admin] PATH_INFO: `/v3/projects/ce184ea697c04374b78038acccb5b377/users/4f276891e1a3427a9c056ecd19ca823d/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:33.546477 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefa0cb-c223-476b-a2f6-7741a48b165a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce184ea697c04374b78038acccb5b377, user_id=4f276891e1a3427a9c056ecd19ca823d, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:33.551404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefa0cb-c223-476b-a2f6-7741a48b165a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:33.583760 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 833/1656] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:33 2022] PUT /identity/v3/projects/ce184ea697c04374b78038acccb5b377/users/4f276891e1a3427a9c056ecd19ca823d/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:33.590051 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3910bb1-7c78-4cba-8068-23ebbf66a50d None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:33.590519 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3910bb1-7c78-4cba-8068-23ebbf66a50d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:33.591339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3910bb1-7c78-4cba-8068-23ebbf66a50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:33.610874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 824/1657] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:33.629665 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e1206-6bf4-4b09-803f-ea8e08da1adb None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:33.634488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9e8e1206-6bf4-4b09-803f-ea8e08da1adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:33.681202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-c3910bb1-7c78-4cba-8068-23ebbf66a50d None None] MFA Rules not processed for user `4f276891e1a3427a9c056ecd19ca823d`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:33.685838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c3910bb1-7c78-4cba-8068-23ebbf66a50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:33.878243 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e1206-6bf4-4b09-803f-ea8e08da1adb None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:33.896135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 834/1658] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:33.898272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3910bb1-7c78-4cba-8068-23ebbf66a50d None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:33.900409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c3910bb1-7c78-4cba-8068-23ebbf66a50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:33.963185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:34.088261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83e341-d662-4ed7-9df2-70a43d55fa4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:34.092693 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83e341-d662-4ed7-9df2-70a43d55fa4c service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:34.093826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83e341-d662-4ed7-9df2-70a43d55fa4c service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:34.095215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83e341-d662-4ed7-9df2-70a43d55fa4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:34.113121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3910bb1-7c78-4cba-8068-23ebbf66a50d None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:34.138424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:34.141873 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:34.143603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:34.145729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90 admin admin] PATH_INFO: `/v3/projects/8fa0d92cad0b46e393c8031dff9a4e74` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:34.151164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa0d92cad0b46e393c8031dff9a4e74)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:34.158062 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:34.209492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:34.273377 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83e341-d662-4ed7-9df2-70a43d55fa4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:34.276166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83e341-d662-4ed7-9df2-70a43d55fa4c service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:34.303165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa0d92cad0b46e393c8031dff9a4e74', 'request_id': 'req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:34.313778 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 825/1659] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:34.317892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83e341-d662-4ed7-9df2-70a43d55fa4c service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:34.323628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa0d92cad0b46e393c8031dff9a4e74', 'request_id': 'req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:34.344817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa0d92cad0b46e393c8031dff9a4e74', 'request_id': 'req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:34.355721 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83e341-d662-4ed7-9df2-70a43d55fa4c service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:34.389999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90 admin admin] The token cache is being invalidate because project 8fa0d92cad0b46e393c8031dff9a4e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:07:34.390513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:34.392409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-7ecb9419-f5e6-4144-84d4-83ec0a8b0b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:34.403789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 835/1660] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:07:33 2022] DELETE /identity/v3/projects/8fa0d92cad0b46e393c8031dff9a4e74 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:34.406190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1326ad3-1066-4c1d-b15c-32c9d6af563e None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:34.406668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1326ad3-1066-4c1d-b15c-32c9d6af563e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:34.407187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1326ad3-1066-4c1d-b15c-32c9d6af563e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:34.474158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-b1326ad3-1066-4c1d-b15c-32c9d6af563e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:34.478005 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b1326ad3-1066-4c1d-b15c-32c9d6af563e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:34.638098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09c47d-c335-449a-9198-575dd7212a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:34.641581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c47d-c335-449a-9198-575dd7212a52 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:34.643874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c47d-c335-449a-9198-575dd7212a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:34.647599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c47d-c335-449a-9198-575dd7212a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:34.651059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09c47d-c335-449a-9198-575dd7212a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:34.661132 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09c47d-c335-449a-9198-575dd7212a52 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:34.757538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 836/1661] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:34.763407 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8bb66-d453-4b5b-9a6c-3b42f49d69ff None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:34.767165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8bb66-d453-4b5b-9a6c-3b42f49d69ff None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:34.767869 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8bb66-d453-4b5b-9a6c-3b42f49d69ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:34.781920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 826/1662] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:34 2022] POST /identity/v3/projects => generated 363 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:34.792655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09c47d-c335-449a-9198-575dd7212a52 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:34.799701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5b09c47d-c335-449a-9198-575dd7212a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:34.849565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-c6a8bb66-d453-4b5b-9a6c-3b42f49d69ff None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:34.851863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c6a8bb66-d453-4b5b-9a6c-3b42f49d69ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:34.963735 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09c47d-c335-449a-9198-575dd7212a52 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:34.976155 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450de69-4678-41d8-a59e-0c98526f0a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:34.977193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450de69-4678-41d8-a59e-0c98526f0a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:34.977466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450de69-4678-41d8-a59e-0c98526f0a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:34.977741 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450de69-4678-41d8-a59e-0c98526f0a19 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:34.978388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450de69-4678-41d8-a59e-0c98526f0a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:34.980368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450de69-4678-41d8-a59e-0c98526f0a19 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:34.985894 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:35.032998 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 827/1663] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:34 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:35.034016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450de69-4678-41d8-a59e-0c98526f0a19 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:35.044915 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 837/1664] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:35.046628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8bb66-d453-4b5b-9a6c-3b42f49d69ff None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:35.067190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8bb66-d453-4b5b-9a6c-3b42f49d69ff None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:35.073825 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450de69-4678-41d8-a59e-0c98526f0a19 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:35.078016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bf97f-1164-4e72-b9ed-ea00c3d60d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:35.079902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bf97f-1164-4e72-b9ed-ea00c3d60d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:35.080468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bf97f-1164-4e72-b9ed-ea00c3d60d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:35.081501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bf97f-1164-4e72-b9ed-ea00c3d60d4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:35.083664 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bf97f-1164-4e72-b9ed-ea00c3d60d4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:35.084227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bf97f-1164-4e72-b9ed-ea00c3d60d4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:35.088980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bf97f-1164-4e72-b9ed-ea00c3d60d4b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:35.098047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371062af-c8a2-430e-8011-3d0443c57b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:35.098688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371062af-c8a2-430e-8011-3d0443c57b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:35.099143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371062af-c8a2-430e-8011-3d0443c57b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:35.099420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371062af-c8a2-430e-8011-3d0443c57b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:35.100093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371062af-c8a2-430e-8011-3d0443c57b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:35.102426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371062af-c8a2-430e-8011-3d0443c57b3b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:35.134639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 838/1665] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:35.136045 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bf97f-1164-4e72-b9ed-ea00c3d60d4b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:35.149542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7b1bf97f-1164-4e72-b9ed-ea00c3d60d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:35.173648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bf97f-1164-4e72-b9ed-ea00c3d60d4b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:35.192234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:35.192893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:35.193175 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:35.193518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] PATH_INFO: `/v3/users/191ce2888fbb4ea68826afb108e23584` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:35.194921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191ce2888fbb4ea68826afb108e23584)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:35.197055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:35.236791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 828/1666] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:35.238241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371062af-c8a2-430e-8011-3d0443c57b3b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:35.274905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371062af-c8a2-430e-8011-3d0443c57b3b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:35.283268 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee00f9-f794-44fa-8c36-6b335975d235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:35.285096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee00f9-f794-44fa-8c36-6b335975d235 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:35.286111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee00f9-f794-44fa-8c36-6b335975d235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:35.286472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee00f9-f794-44fa-8c36-6b335975d235 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:35.287439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee00f9-f794-44fa-8c36-6b335975d235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:35.293281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee00f9-f794-44fa-8c36-6b335975d235 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:35.308292 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191ce2888fbb4ea68826afb108e23584'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:35.321863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191ce2888fbb4ea68826afb108e23584'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:35.322815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191ce2888fbb4ea68826afb108e23584'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:35.323237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191ce2888fbb4ea68826afb108e23584'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:35.352348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191ce2888fbb4ea68826afb108e23584'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:35.360281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 829/1667] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:35 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:35.362083 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee00f9-f794-44fa-8c36-6b335975d235 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:35.365988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-58ee00f9-f794-44fa-8c36-6b335975d235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:35.382623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 839/1668] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:07:35 2022] DELETE /identity/v3/users/191ce2888fbb4ea68826afb108e23584 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:35.383515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:35.384903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:35.430367 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:35.548218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f27eee-db3d-4d96-b40e-ce8928111841 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:35.550950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee00f9-f794-44fa-8c36-6b335975d235 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:35.560894 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9dcd2-c24f-4908-9ff7-0719903a2ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:35.561684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9dcd2-c24f-4908-9ff7-0719903a2ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:35.562046 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9dcd2-c24f-4908-9ff7-0719903a2ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:35.562161 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c66fa-5f07-4ddb-9351-a4553d6ac0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:35.562440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9dcd2-c24f-4908-9ff7-0719903a2ea2 admin admin] PATH_INFO: `/v3/projects/9be412be0b734607beb2bebfd395afc5/users/dcae9bf9ba3f4fdd93f0261d9ac79ce8/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:35.562784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c66fa-5f07-4ddb-9351-a4553d6ac0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:35.563067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c66fa-5f07-4ddb-9351-a4553d6ac0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:35.563338 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c66fa-5f07-4ddb-9351-a4553d6ac0a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:35.563981 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c66fa-5f07-4ddb-9351-a4553d6ac0a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:35.565958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c66fa-5f07-4ddb-9351-a4553d6ac0a7 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:35.609022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9dcd2-c24f-4908-9ff7-0719903a2ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be412be0b734607beb2bebfd395afc5, user_id=dcae9bf9ba3f4fdd93f0261d9ac79ce8, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:35.613860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 840/1669] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:35 2022] POST /identity/v3/users => generated 282 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:35.613860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c015714-2eb0-4dfe-a3c6-d3e5f0f75bf2 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:35.613860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c015714-2eb0-4dfe-a3c6-d3e5f0f75bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:35.613860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c015714-2eb0-4dfe-a3c6-d3e5f0f75bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:35.618803 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9dcd2-c24f-4908-9ff7-0719903a2ea2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:35.659983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 830/1670] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:35 2022] PUT /identity/v3/projects/9be412be0b734607beb2bebfd395afc5/users/dcae9bf9ba3f4fdd93f0261d9ac79ce8/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:35.660500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-0c015714-2eb0-4dfe-a3c6-d3e5f0f75bf2 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:35.661050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9dcd2-c24f-4908-9ff7-0719903a2ea2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:35.661918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0c015714-2eb0-4dfe-a3c6-d3e5f0f75bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:35.736065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:35.805351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 841/1671] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:35.806226 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c015714-2eb0-4dfe-a3c6-d3e5f0f75bf2 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:35.825330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c015714-2eb0-4dfe-a3c6-d3e5f0f75bf2 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:35.838942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7ab59-5e8f-4883-a7da-301e8e6eb5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:35.838942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7ab59-5e8f-4883-a7da-301e8e6eb5fd admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:35.838942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7ab59-5e8f-4883-a7da-301e8e6eb5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:35.838942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7ab59-5e8f-4883-a7da-301e8e6eb5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:35.839232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7ab59-5e8f-4883-a7da-301e8e6eb5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:35.840572 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7ab59-5e8f-4883-a7da-301e8e6eb5fd admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:35.861342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 842/1672] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:35.862234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7ab59-5e8f-4883-a7da-301e8e6eb5fd admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:35.876422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e0c7ab59-5e8f-4883-a7da-301e8e6eb5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:35.889783 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9dcd2-c24f-4908-9ff7-0719903a2ea2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:35.905603 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01088087-d638-4105-9f23-26ab2622a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:35.909560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01088087-d638-4105-9f23-26ab2622a7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:35.909857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01088087-d638-4105-9f23-26ab2622a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:35.910132 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01088087-d638-4105-9f23-26ab2622a7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:35.913129 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01088087-d638-4105-9f23-26ab2622a7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:35.924364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01088087-d638-4105-9f23-26ab2622a7f5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:35.948047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 831/1673] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:35.949241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01088087-d638-4105-9f23-26ab2622a7f5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:35.956457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-01088087-d638-4105-9f23-26ab2622a7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:35.990147 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01088087-d638-4105-9f23-26ab2622a7f5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:35.994183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7ab59-5e8f-4883-a7da-301e8e6eb5fd admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:36.003115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42c626-9079-45b8-87f7-466e4dfefb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:36.008965 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42c626-9079-45b8-87f7-466e4dfefb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:36.009327 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42c626-9079-45b8-87f7-466e4dfefb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:36.009497 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f7794-0119-45ee-95ac-509d77b8b316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:36.009631 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42c626-9079-45b8-87f7-466e4dfefb06 admin admin] PATH_INFO: `/v3/projects/5bf0dca14a9f4d95962fd8a51aa49588` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:36.010337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f7794-0119-45ee-95ac-509d77b8b316 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:36.010439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f7794-0119-45ee-95ac-509d77b8b316 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:36.010679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f7794-0119-45ee-95ac-509d77b8b316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:36.011973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42c626-9079-45b8-87f7-466e4dfefb06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf0dca14a9f4d95962fd8a51aa49588)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:36.016643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42c626-9079-45b8-87f7-466e4dfefb06 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:36.026824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f7794-0119-45ee-95ac-509d77b8b316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:36.028002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f7794-0119-45ee-95ac-509d77b8b316 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:36.054993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 843/1674] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:36.055779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f7794-0119-45ee-95ac-509d77b8b316 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:36.076164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f7794-0119-45ee-95ac-509d77b8b316 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:36.091621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd10ba7-56bf-4acd-b19a-3b8bc4131ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:36.092331 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd10ba7-56bf-4acd-b19a-3b8bc4131ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:36.092633 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd10ba7-56bf-4acd-b19a-3b8bc4131ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:36.092900 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd10ba7-56bf-4acd-b19a-3b8bc4131ee5 admin admin] PATH_INFO: `/v3/projects/9be412be0b734607beb2bebfd395afc5/users/dcae9bf9ba3f4fdd93f0261d9ac79ce8/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:36.095034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd10ba7-56bf-4acd-b19a-3b8bc4131ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be412be0b734607beb2bebfd395afc5, user_id=dcae9bf9ba3f4fdd93f0261d9ac79ce8, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:36.097770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd10ba7-56bf-4acd-b19a-3b8bc4131ee5 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:36.120183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 844/1675] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:36 2022] PUT /identity/v3/projects/9be412be0b734607beb2bebfd395afc5/users/dcae9bf9ba3f4fdd93f0261d9ac79ce8/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:36.121688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd10ba7-56bf-4acd-b19a-3b8bc4131ee5 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:36.155017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-cb42c626-9079-45b8-87f7-466e4dfefb06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf0dca14a9f4d95962fd8a51aa49588', 'request_id': 'req-cb42c626-9079-45b8-87f7-466e4dfefb06'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:36.176972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-cb42c626-9079-45b8-87f7-466e4dfefb06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf0dca14a9f4d95962fd8a51aa49588', 'request_id': 'req-cb42c626-9079-45b8-87f7-466e4dfefb06'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:36.197473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-cb42c626-9079-45b8-87f7-466e4dfefb06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf0dca14a9f4d95962fd8a51aa49588', 'request_id': 'req-cb42c626-9079-45b8-87f7-466e4dfefb06'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:36.228726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-cb42c626-9079-45b8-87f7-466e4dfefb06 admin admin] The token cache is being invalidate because project 5bf0dca14a9f4d95962fd8a51aa49588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:07:36.229645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-cb42c626-9079-45b8-87f7-466e4dfefb06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:36.232847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-cb42c626-9079-45b8-87f7-466e4dfefb06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:36.240068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 832/1676] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:07:35 2022] DELETE /identity/v3/projects/5bf0dca14a9f4d95962fd8a51aa49588 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:36.245989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee50cf-8a55-4c95-96b8-d4adfcfb23f7 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:36.246912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee50cf-8a55-4c95-96b8-d4adfcfb23f7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:36.247231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee50cf-8a55-4c95-96b8-d4adfcfb23f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:36.274908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd10ba7-56bf-4acd-b19a-3b8bc4131ee5 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:36.328206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-68ee50cf-8a55-4c95-96b8-d4adfcfb23f7 None None] MFA Rules not processed for user `dcae9bf9ba3f4fdd93f0261d9ac79ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:36.329904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-68ee50cf-8a55-4c95-96b8-d4adfcfb23f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:36.338537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:36.422076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee1a17-47e6-4913-9f48-1b9dde1d001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:36.422726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee1a17-47e6-4913-9f48-1b9dde1d001c admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:36.423036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee1a17-47e6-4913-9f48-1b9dde1d001c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:36.423314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee1a17-47e6-4913-9f48-1b9dde1d001c admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:36.423981 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee1a17-47e6-4913-9f48-1b9dde1d001c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:36.425610 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee1a17-47e6-4913-9f48-1b9dde1d001c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:36.453457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 845/1677] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:36.455367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e44ee0-e986-4a9c-ae5a-420c3d2a073a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:36.455531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e44ee0-e986-4a9c-ae5a-420c3d2a073a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:36.455725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e44ee0-e986-4a9c-ae5a-420c3d2a073a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:36.481716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:36.520636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-12e44ee0-e986-4a9c-ae5a-420c3d2a073a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:36.523130 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-12e44ee0-e986-4a9c-ae5a-420c3d2a073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:36.562892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 833/1678] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:36.570890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 846/1679] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:36.571555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee50cf-8a55-4c95-96b8-d4adfcfb23f7 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:36.572758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-68ee50cf-8a55-4c95-96b8-d4adfcfb23f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:36.576966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde987e-d6c2-4c92-94ca-07e4909b2e3c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:36.577470 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde987e-d6c2-4c92-94ca-07e4909b2e3c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:36.577938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde987e-d6c2-4c92-94ca-07e4909b2e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:36.605822 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee50cf-8a55-4c95-96b8-d4adfcfb23f7 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:36.619379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0af48-410d-419e-b0cf-f5c40f490bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:36.620121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0af48-410d-419e-b0cf-f5c40f490bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:36.620410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0af48-410d-419e-b0cf-f5c40f490bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:36.620693 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0af48-410d-419e-b0cf-f5c40f490bb3 admin admin] PATH_INFO: `/v3/projects/c938c9c7b76543209617771170d25464/users/9f133534154846458c01707d5b33581f/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:36.644013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-6dde987e-d6c2-4c92-94ca-07e4909b2e3c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:36.646157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6dde987e-d6c2-4c92-94ca-07e4909b2e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:36.651910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0af48-410d-419e-b0cf-f5c40f490bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c938c9c7b76543209617771170d25464, user_id=9f133534154846458c01707d5b33581f, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:36.658978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0af48-410d-419e-b0cf-f5c40f490bb3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:36.690266 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 834/1680] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:36 2022] PUT /identity/v3/projects/c938c9c7b76543209617771170d25464/users/9f133534154846458c01707d5b33581f/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:36.691364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0af48-410d-419e-b0cf-f5c40f490bb3 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:36.704707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-93d0af48-410d-419e-b0cf-f5c40f490bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:36.704968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 847/1681] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:07:36.704968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd7e3f-2a06-4f8a-a192-8405e00bf168 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:36.704968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd7e3f-2a06-4f8a-a192-8405e00bf168 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:36.705173 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd7e3f-2a06-4f8a-a192-8405e00bf168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:36.816767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-dbfd7e3f-2a06-4f8a-a192-8405e00bf168 None None] MFA Rules not processed for user `9f133534154846458c01707d5b33581f`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:36.818364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-dbfd7e3f-2a06-4f8a-a192-8405e00bf168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:36.837400 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0af48-410d-419e-b0cf-f5c40f490bb3 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:36.853492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f528897-04a4-4de7-ab06-3118c8a8069f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:36.854076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528897-04a4-4de7-ab06-3118c8a8069f service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:36.854366 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528897-04a4-4de7-ab06-3118c8a8069f service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:36.854647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528897-04a4-4de7-ab06-3118c8a8069f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:37.012055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 848/1682] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:37.012922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd7e3f-2a06-4f8a-a192-8405e00bf168 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:37.084063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f528897-04a4-4de7-ab06-3118c8a8069f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:37.088120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f528897-04a4-4de7-ab06-3118c8a8069f service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:37.152261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 835/1683] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:37.153970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f528897-04a4-4de7-ab06-3118c8a8069f service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:37.183947 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd7e3f-2a06-4f8a-a192-8405e00bf168 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:37.197251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ceaf-1045-4c26-af91-018f4731ba6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:37.198039 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ceaf-1045-4c26-af91-018f4731ba6b admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:37.198329 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ceaf-1045-4c26-af91-018f4731ba6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:37.198611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ceaf-1045-4c26-af91-018f4731ba6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:37.199314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30ceaf-1045-4c26-af91-018f4731ba6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:37.199629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30ceaf-1045-4c26-af91-018f4731ba6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:37.201286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30ceaf-1045-4c26-af91-018f4731ba6b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:37.208678 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f528897-04a4-4de7-ab06-3118c8a8069f service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:37.242582 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 849/1684] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:37.246393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3c11f-dbf7-4b6b-8879-e9b73db347a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:37.246554 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ceaf-1045-4c26-af91-018f4731ba6b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:37.246846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3c11f-dbf7-4b6b-8879-e9b73db347a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:37.247094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3c11f-dbf7-4b6b-8879-e9b73db347a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:37.247367 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3c11f-dbf7-4b6b-8879-e9b73db347a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:37.248681 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3c11f-dbf7-4b6b-8879-e9b73db347a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:37.250613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3c11f-dbf7-4b6b-8879-e9b73db347a7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:37.263752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ceaf-1045-4c26-af91-018f4731ba6b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:37.282642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a444f-d369-4e58-aca1-6d83d7b34a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:37.283373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a444f-d369-4e58-aca1-6d83d7b34a1d admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:37.283790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a444f-d369-4e58-aca1-6d83d7b34a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:37.284613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a444f-d369-4e58-aca1-6d83d7b34a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:37.286089 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a444f-d369-4e58-aca1-6d83d7b34a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:37.290975 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a444f-d369-4e58-aca1-6d83d7b34a1d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:37.334359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 836/1685] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:37 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:37.347832 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3c11f-dbf7-4b6b-8879-e9b73db347a7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:37.366078 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 850/1686] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:37 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:37.368550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a444f-d369-4e58-aca1-6d83d7b34a1d admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:37.376728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:37.543987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:37.562501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3c11f-dbf7-4b6b-8879-e9b73db347a7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:37.567929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a444f-d369-4e58-aca1-6d83d7b34a1d admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:37.573380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f59d0-fc0c-4026-a2a2-a67f0628e1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:37.574024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f59d0-fc0c-4026-a2a2-a67f0628e1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:37.574288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f59d0-fc0c-4026-a2a2-a67f0628e1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:37.574561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f59d0-fc0c-4026-a2a2-a67f0628e1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:37.575229 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f59d0-fc0c-4026-a2a2-a67f0628e1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:37.577895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f59d0-fc0c-4026-a2a2-a67f0628e1b5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:37.587619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abad988-7355-4891-afca-66d7aeec0b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:37.588274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abad988-7355-4891-afca-66d7aeec0b7c admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:37.588559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abad988-7355-4891-afca-66d7aeec0b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:37.588839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abad988-7355-4891-afca-66d7aeec0b7c admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:37.589484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abad988-7355-4891-afca-66d7aeec0b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:37.591458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abad988-7355-4891-afca-66d7aeec0b7c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:37.645632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 837/1687] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:37 2022] POST /identity/v3/users => generated 289 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:37.647052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84e9e6-3a2f-48a4-adf9-ccf3beb3fa90 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:37.647381 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84e9e6-3a2f-48a4-adf9-ccf3beb3fa90 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:37.647762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84e9e6-3a2f-48a4-adf9-ccf3beb3fa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:37.656684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 851/1688] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:37 2022] POST /identity/v3/users => generated 290 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:37.657874 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abad988-7355-4891-afca-66d7aeec0b7c admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:37.660473 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3abad988-7355-4891-afca-66d7aeec0b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:37.675597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abad988-7355-4891-afca-66d7aeec0b7c admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:37.686265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:37.687213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:37.687675 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:37.688116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] PATH_INFO: `/v3/projects/e36380ee7bf34fe38f3be4ba286eb7e2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:37.689558 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36380ee7bf34fe38f3be4ba286eb7e2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:37.691863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:37.725845 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ba84e9e6-3a2f-48a4-adf9-ccf3beb3fa90 None None] MFA Rules not processed for user `32bc4cb848c446ab8d4d330f9e2f0022`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:37.727165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ba84e9e6-3a2f-48a4-adf9-ccf3beb3fa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:37.853066 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36380ee7bf34fe38f3be4ba286eb7e2', 'request_id': 'req-aa8c019a-c03c-48a7-a331-0b59d7707b08'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:37.870024 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36380ee7bf34fe38f3be4ba286eb7e2', 'request_id': 'req-aa8c019a-c03c-48a7-a331-0b59d7707b08'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:37.886054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36380ee7bf34fe38f3be4ba286eb7e2', 'request_id': 'req-aa8c019a-c03c-48a7-a331-0b59d7707b08'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:37.910273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] The token cache is being invalidate because project e36380ee7bf34fe38f3be4ba286eb7e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:07:37.910627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:37.911291 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:37.913309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 852/1689] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:07:37 2022] DELETE /identity/v3/projects/e36380ee7bf34fe38f3be4ba286eb7e2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:37.914111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:37.919996 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:37.960329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 838/1690] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:37.961647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84e9e6-3a2f-48a4-adf9-ccf3beb3fa90 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:37.965141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ba84e9e6-3a2f-48a4-adf9-ccf3beb3fa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:38.009770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84e9e6-3a2f-48a4-adf9-ccf3beb3fa90 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:38.139003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c019a-c03c-48a7-a331-0b59d7707b08 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:38.152923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94447d-194c-4128-97b1-52c76cdc302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:38.153737 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94447d-194c-4128-97b1-52c76cdc302e admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:38.154172 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94447d-194c-4128-97b1-52c76cdc302e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:38.154608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94447d-194c-4128-97b1-52c76cdc302e admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:38.155439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94447d-194c-4128-97b1-52c76cdc302e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:38.157227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94447d-194c-4128-97b1-52c76cdc302e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:38.194269 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 853/1691] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:38.199026 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703368e4-aa1c-434f-b6bc-54e6f776497f None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:38.199319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703368e4-aa1c-434f-b6bc-54e6f776497f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:38.199603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703368e4-aa1c-434f-b6bc-54e6f776497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:38.248865 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-703368e4-aa1c-434f-b6bc-54e6f776497f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:38.250101 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-703368e4-aa1c-434f-b6bc-54e6f776497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:38.265526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5ccbd-9768-4d8d-a374-15f81a5cf70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:38.266870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5ccbd-9768-4d8d-a374-15f81a5cf70c admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:38.267389 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5ccbd-9768-4d8d-a374-15f81a5cf70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:38.267874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5ccbd-9768-4d8d-a374-15f81a5cf70c admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:38.269038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5ccbd-9768-4d8d-a374-15f81a5cf70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:38.277270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5ccbd-9768-4d8d-a374-15f81a5cf70c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:38.278795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 854/1692] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:38.279552 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703368e4-aa1c-434f-b6bc-54e6f776497f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:38.291706 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-703368e4-aa1c-434f-b6bc-54e6f776497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:38.326218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 839/1693] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:38.326218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5ccbd-9768-4d8d-a374-15f81a5cf70c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:38.343544 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1aa5ccbd-9768-4d8d-a374-15f81a5cf70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:38.383749 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5ccbd-9768-4d8d-a374-15f81a5cf70c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:38.413501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab5d39-4083-4102-82f5-1f8e0d57a50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:38.414325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab5d39-4083-4102-82f5-1f8e0d57a50b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:38.414613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab5d39-4083-4102-82f5-1f8e0d57a50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:38.415336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab5d39-4083-4102-82f5-1f8e0d57a50b admin admin] PATH_INFO: `/v3/users/4f276891e1a3427a9c056ecd19ca823d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:38.417742 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab5d39-4083-4102-82f5-1f8e0d57a50b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f276891e1a3427a9c056ecd19ca823d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:38.420062 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab5d39-4083-4102-82f5-1f8e0d57a50b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:38.421917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:38.458971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:38.480133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703368e4-aa1c-434f-b6bc-54e6f776497f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:38.486812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28cccf-5732-4be9-8393-16bd36c415b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:38.487457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28cccf-5732-4be9-8393-16bd36c415b6 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:38.487737 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28cccf-5732-4be9-8393-16bd36c415b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:38.488019 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28cccf-5732-4be9-8393-16bd36c415b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:38.585673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d8ab5d39-4083-4102-82f5-1f8e0d57a50b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f276891e1a3427a9c056ecd19ca823d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:38.648275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d8ab5d39-4083-4102-82f5-1f8e0d57a50b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f276891e1a3427a9c056ecd19ca823d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:38.649792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28cccf-5732-4be9-8393-16bd36c415b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:38.652789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28cccf-5732-4be9-8393-16bd36c415b6 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:38.671206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d8ab5d39-4083-4102-82f5-1f8e0d57a50b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f276891e1a3427a9c056ecd19ca823d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:38.672015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d8ab5d39-4083-4102-82f5-1f8e0d57a50b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f276891e1a3427a9c056ecd19ca823d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:38.673255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d8ab5d39-4083-4102-82f5-1f8e0d57a50b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f276891e1a3427a9c056ecd19ca823d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:38.675054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 855/1694] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:38.677675 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28cccf-5732-4be9-8393-16bd36c415b6 service nova] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:38.702620 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28cccf-5732-4be9-8393-16bd36c415b6 service nova] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:38.716220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94580f-e3ad-424a-b38a-11820fd7c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:38.717207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94580f-e3ad-424a-b38a-11820fd7c8be admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:38.717498 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94580f-e3ad-424a-b38a-11820fd7c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:38.717838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94580f-e3ad-424a-b38a-11820fd7c8be admin admin] PATH_INFO: `/v3/projects/261134730b954efc83dc84e6b8be76f8/users/8593ec7293a34819a6231a0aa8308160/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:38.723211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 840/1695] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:07:38 2022] DELETE /identity/v3/users/4f276891e1a3427a9c056ecd19ca823d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:38.724605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfd26f-5113-49c8-a071-7a921c3e6108 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:38.724900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfd26f-5113-49c8-a071-7a921c3e6108 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:38.728291 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfd26f-5113-49c8-a071-7a921c3e6108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:38.771248 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94580f-e3ad-424a-b38a-11820fd7c8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=261134730b954efc83dc84e6b8be76f8, user_id=8593ec7293a34819a6231a0aa8308160, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:38.778396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94580f-e3ad-424a-b38a-11820fd7c8be admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:38.779811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-77bfd26f-5113-49c8-a071-7a921c3e6108 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:38.781458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-77bfd26f-5113-49c8-a071-7a921c3e6108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:38.808052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 856/1696] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:38 2022] PUT /identity/v3/projects/261134730b954efc83dc84e6b8be76f8/users/8593ec7293a34819a6231a0aa8308160/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:38.809376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94580f-e3ad-424a-b38a-11820fd7c8be admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:38.811439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ce94580f-e3ad-424a-b38a-11820fd7c8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:38.948578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94580f-e3ad-424a-b38a-11820fd7c8be admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:38.965451 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b773663-551b-4b00-9471-efebcca4a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:38.966609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b773663-551b-4b00-9471-efebcca4a72d admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:38.967308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b773663-551b-4b00-9471-efebcca4a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:38.967308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b773663-551b-4b00-9471-efebcca4a72d admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:38.967910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b773663-551b-4b00-9471-efebcca4a72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:38.975149 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b773663-551b-4b00-9471-efebcca4a72d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:39.024878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 841/1697] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:39.026413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c1014-c87f-47a8-a495-e88e6d8505d0 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:39.026683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c1014-c87f-47a8-a495-e88e6d8505d0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:39.026986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c1014-c87f-47a8-a495-e88e6d8505d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:39.035712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 857/1698] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:39.037531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b773663-551b-4b00-9471-efebcca4a72d admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:39.043582 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9b773663-551b-4b00-9471-efebcca4a72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:39.081219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-de4c1014-c87f-47a8-a495-e88e6d8505d0 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:39.083101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-de4c1014-c87f-47a8-a495-e88e6d8505d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:39.090525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b773663-551b-4b00-9471-efebcca4a72d admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:39.099333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 842/1699] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:39.100855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c1014-c87f-47a8-a495-e88e6d8505d0 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:39.106228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2a49d-11c5-4473-9599-50b3542071b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:39.107038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2a49d-11c5-4473-9599-50b3542071b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:39.107899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2a49d-11c5-4473-9599-50b3542071b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:39.107899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2a49d-11c5-4473-9599-50b3542071b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:39.108542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2a49d-11c5-4473-9599-50b3542071b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:39.113174 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2a49d-11c5-4473-9599-50b3542071b9 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:39.131722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c1014-c87f-47a8-a495-e88e6d8505d0 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:39.137404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 858/1700] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:39.140391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2a49d-11c5-4473-9599-50b3542071b9 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:39.150036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1e82f-a229-471c-8bb9-c5579b2bd968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:39.150682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1e82f-a229-471c-8bb9-c5579b2bd968 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:39.150990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1e82f-a229-471c-8bb9-c5579b2bd968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:39.151439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1e82f-a229-471c-8bb9-c5579b2bd968 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:39.152260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1e82f-a229-471c-8bb9-c5579b2bd968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:39.152714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1e82f-a229-471c-8bb9-c5579b2bd968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:39.161250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1e82f-a229-471c-8bb9-c5579b2bd968 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:39.164519 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2a49d-11c5-4473-9599-50b3542071b9 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:39.179924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7f9f0-26d4-442a-8ae0-7b1a3f8f9179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:39.180855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7f9f0-26d4-442a-8ae0-7b1a3f8f9179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:39.181214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7f9f0-26d4-442a-8ae0-7b1a3f8f9179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:39.181566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7f9f0-26d4-442a-8ae0-7b1a3f8f9179 admin admin] PATH_INFO: `/v3/projects/67aaca28d3a0459f99d1b3af71c29dd3/users/05ce6ce975964b53b25b2c44fd430e8d/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:39.202345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 843/1701] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:39.203633 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1e82f-a229-471c-8bb9-c5579b2bd968 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:39.221800 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7f9f0-26d4-442a-8ae0-7b1a3f8f9179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67aaca28d3a0459f99d1b3af71c29dd3, user_id=05ce6ce975964b53b25b2c44fd430e8d, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:39.223740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1e82f-a229-471c-8bb9-c5579b2bd968 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:39.226473 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7f9f0-26d4-442a-8ae0-7b1a3f8f9179 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:39.234121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d35c26-eabd-4331-b6af-99bd17397ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:39.236160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d35c26-eabd-4331-b6af-99bd17397ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:39.236913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d35c26-eabd-4331-b6af-99bd17397ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:39.237812 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d35c26-eabd-4331-b6af-99bd17397ea2 admin admin] PATH_INFO: `/v3/projects/261134730b954efc83dc84e6b8be76f8/users/8593ec7293a34819a6231a0aa8308160/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:39.243253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d35c26-eabd-4331-b6af-99bd17397ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261134730b954efc83dc84e6b8be76f8, user_id=8593ec7293a34819a6231a0aa8308160, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:39.246184 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d35c26-eabd-4331-b6af-99bd17397ea2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:39.286113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 844/1702] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:39 2022] PUT /identity/v3/projects/261134730b954efc83dc84e6b8be76f8/users/8593ec7293a34819a6231a0aa8308160/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:39.287245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d35c26-eabd-4331-b6af-99bd17397ea2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:39.298985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 859/1703] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:39 2022] PUT /identity/v3/projects/67aaca28d3a0459f99d1b3af71c29dd3/users/05ce6ce975964b53b25b2c44fd430e8d/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:39.298985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7f9f0-26d4-442a-8ae0-7b1a3f8f9179 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:39.299879 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-09d35c26-eabd-4331-b6af-99bd17397ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:39.369229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:39.454258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7f9f0-26d4-442a-8ae0-7b1a3f8f9179 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:39.463110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d35c26-eabd-4331-b6af-99bd17397ea2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:39.472489 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9387-0a80-48b2-b593-19ce786460f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:39.473529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9387-0a80-48b2-b593-19ce786460f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:39.474092 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9387-0a80-48b2-b593-19ce786460f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:39.474483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9387-0a80-48b2-b593-19ce786460f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:39.502668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:39.573678 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b10c0-a37b-45ba-b4c0-389e8b559b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:39.574325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b10c0-a37b-45ba-b4c0-389e8b559b7b admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:39.574609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b10c0-a37b-45ba-b4c0-389e8b559b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:39.574957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b10c0-a37b-45ba-b4c0-389e8b559b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:39.575617 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b10c0-a37b-45ba-b4c0-389e8b559b7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:39.589541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b10c0-a37b-45ba-b4c0-389e8b559b7b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:39.659574 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9387-0a80-48b2-b593-19ce786460f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:39.670511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9387-0a80-48b2-b593-19ce786460f4 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:39.677732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 860/1704] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:39 2022] POST /identity/v3/projects => generated 373 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:39.683219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58b4d0-ad38-4562-a97e-2c24f414abb4 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:39.683510 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58b4d0-ad38-4562-a97e-2c24f414abb4 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:39.683816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58b4d0-ad38-4562-a97e-2c24f414abb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:39.721522 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 845/1705] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:39.723392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f483c-bded-49d6-9e0f-42e1eacf9351 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:39.727144 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f483c-bded-49d6-9e0f-42e1eacf9351 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:39.728968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f483c-bded-49d6-9e0f-42e1eacf9351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:39.745219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-fe58b4d0-ad38-4562-a97e-2c24f414abb4 None None] MFA Rules not processed for user `8593ec7293a34819a6231a0aa8308160`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:39.748593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-fe58b4d0-ad38-4562-a97e-2c24f414abb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:39.824008 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2f4f483c-bded-49d6-9e0f-42e1eacf9351 None None] MFA Rules not processed for user `05ce6ce975964b53b25b2c44fd430e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:39.825264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2f4f483c-bded-49d6-9e0f-42e1eacf9351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:39.909979 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 861/1706] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:39.913773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58b4d0-ad38-4562-a97e-2c24f414abb4 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:40.029421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:40.040836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 846/1707] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:40.048216 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f483c-bded-49d6-9e0f-42e1eacf9351 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:40.055509 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2f4f483c-bded-49d6-9e0f-42e1eacf9351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:40.063605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58b4d0-ad38-4562-a97e-2c24f414abb4 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:40.089717 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65192472-64d5-4bf3-a07e-5108026767cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:40.090476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65192472-64d5-4bf3-a07e-5108026767cf admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:40.092494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65192472-64d5-4bf3-a07e-5108026767cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:40.092796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65192472-64d5-4bf3-a07e-5108026767cf admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:40.094622 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65192472-64d5-4bf3-a07e-5108026767cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:40.102405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65192472-64d5-4bf3-a07e-5108026767cf admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:40.158352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 862/1708] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:39 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:40.158352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65192472-64d5-4bf3-a07e-5108026767cf admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:40.182355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65192472-64d5-4bf3-a07e-5108026767cf admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:40.197362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfda029-637a-4444-9b84-8c989a998f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:40.198164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfda029-637a-4444-9b84-8c989a998f0c admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:40.198457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfda029-637a-4444-9b84-8c989a998f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:40.198754 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfda029-637a-4444-9b84-8c989a998f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:40.199405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfda029-637a-4444-9b84-8c989a998f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:40.206342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfda029-637a-4444-9b84-8c989a998f0c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:40.229157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f483c-bded-49d6-9e0f-42e1eacf9351 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:40.245217 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20ebb-c451-4c70-9a42-dc881ec5a602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:40.246040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20ebb-c451-4c70-9a42-dc881ec5a602 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:40.246330 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20ebb-c451-4c70-9a42-dc881ec5a602 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:40.246894 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20ebb-c451-4c70-9a42-dc881ec5a602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:40.274581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf20ebb-c451-4c70-9a42-dc881ec5a602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:40.276013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf20ebb-c451-4c70-9a42-dc881ec5a602 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:40.281856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 863/1709] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:40 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:40.282872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfda029-637a-4444-9b84-8c989a998f0c admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:40.312139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 847/1710] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:40.313153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20ebb-c451-4c70-9a42-dc881ec5a602 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:40.353593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20ebb-c451-4c70-9a42-dc881ec5a602 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:40.418458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:40.447826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfda029-637a-4444-9b84-8c989a998f0c admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:40.453919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60270619-7ee3-403b-ad8a-a9f4f779da20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:40.456359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60270619-7ee3-403b-ad8a-a9f4f779da20 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:40.456831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60270619-7ee3-403b-ad8a-a9f4f779da20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:40.457343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60270619-7ee3-403b-ad8a-a9f4f779da20 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:40.458255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60270619-7ee3-403b-ad8a-a9f4f779da20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:40.461485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60270619-7ee3-403b-ad8a-a9f4f779da20 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:40.463729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547a243-7b0e-48b4-b605-0bf1b9072a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:40.464491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547a243-7b0e-48b4-b605-0bf1b9072a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:40.465441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547a243-7b0e-48b4-b605-0bf1b9072a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:40.465441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547a243-7b0e-48b4-b605-0bf1b9072a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:40.466094 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547a243-7b0e-48b4-b605-0bf1b9072a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:40.468176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547a243-7b0e-48b4-b605-0bf1b9072a30 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:40.499637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 864/1711] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:40.499637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547a243-7b0e-48b4-b605-0bf1b9072a30 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:40.525074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 848/1712] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:40 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:40.526116 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60270619-7ee3-403b-ad8a-a9f4f779da20 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:40.544672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60270619-7ee3-403b-ad8a-a9f4f779da20 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:40.567795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21065ca5-7575-4657-ae88-b6a526eb3925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:40.568446 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21065ca5-7575-4657-ae88-b6a526eb3925 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:40.568732 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21065ca5-7575-4657-ae88-b6a526eb3925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:40.569625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21065ca5-7575-4657-ae88-b6a526eb3925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:40.570543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21065ca5-7575-4657-ae88-b6a526eb3925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:40.572228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21065ca5-7575-4657-ae88-b6a526eb3925 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:40.594135 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 849/1713] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:40.595121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21065ca5-7575-4657-ae88-b6a526eb3925 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:40.610567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547a243-7b0e-48b4-b605-0bf1b9072a30 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:40.626097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21065ca5-7575-4657-ae88-b6a526eb3925 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:40.632324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4054e-da4d-4fef-a51d-9350d4791b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:40.632324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4054e-da4d-4fef-a51d-9350d4791b9c service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:40.632583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4054e-da4d-4fef-a51d-9350d4791b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:40.632786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4054e-da4d-4fef-a51d-9350d4791b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:40.637570 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4ec4054e-da4d-4fef-a51d-9350d4791b9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:40.652008 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cd483-f6b4-4a0e-93fc-9ce625009291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:40.653059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cd483-f6b4-4a0e-93fc-9ce625009291 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:40.653579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cd483-f6b4-4a0e-93fc-9ce625009291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:40.653957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cd483-f6b4-4a0e-93fc-9ce625009291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:40.654880 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cd483-f6b4-4a0e-93fc-9ce625009291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:40.656555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cd483-f6b4-4a0e-93fc-9ce625009291 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:40.683543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 850/1714] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:40.684744 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cd483-f6b4-4a0e-93fc-9ce625009291 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:40.712495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cd483-f6b4-4a0e-93fc-9ce625009291 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:40.721138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f3d05-5c38-44fc-8b21-ea8b47b52541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:40.721928 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f3d05-5c38-44fc-8b21-ea8b47b52541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:40.722318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f3d05-5c38-44fc-8b21-ea8b47b52541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:40.722664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f3d05-5c38-44fc-8b21-ea8b47b52541 admin admin] PATH_INFO: `/v3/projects/36895692e727456a86c0151a64a9c600/users/f79d3ef7ae534fab9f23f0045a4bf325/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:40.780942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f3d05-5c38-44fc-8b21-ea8b47b52541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36895692e727456a86c0151a64a9c600, user_id=f79d3ef7ae534fab9f23f0045a4bf325, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:40.781513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4054e-da4d-4fef-a51d-9350d4791b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:40.784489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4054e-da4d-4fef-a51d-9350d4791b9c service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:40.786550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f3d05-5c38-44fc-8b21-ea8b47b52541 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:40.824082 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 865/1715] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:40.825573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 851/1716] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:40 2022] PUT /identity/v3/projects/36895692e727456a86c0151a64a9c600/users/f79d3ef7ae534fab9f23f0045a4bf325/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:40.826530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd3d20-c7bd-40ea-962b-9d9eada0c0a0 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:40.826859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd3d20-c7bd-40ea-962b-9d9eada0c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:40.827160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd3d20-c7bd-40ea-962b-9d9eada0c0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:40.828055 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f3d05-5c38-44fc-8b21-ea8b47b52541 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:40.846133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:40.912530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-85fd3d20-c7bd-40ea-962b-9d9eada0c0a0 None None] MFA Rules not processed for user `fa3abf6b7b044a1b8ad16aef5413a0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:40.917749 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-85fd3d20-c7bd-40ea-962b-9d9eada0c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:41.045186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f3d05-5c38-44fc-8b21-ea8b47b52541 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:41.068051 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dd3b8-e30a-4e4c-9146-2dd3bdb102d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:41.068767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dd3b8-e30a-4e4c-9146-2dd3bdb102d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:41.069087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dd3b8-e30a-4e4c-9146-2dd3bdb102d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:41.069372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dd3b8-e30a-4e4c-9146-2dd3bdb102d9 admin admin] PATH_INFO: `/v3/projects/1ef3038d445c43eb869400c1d78caede/users/d1134c8208ce406b812b7e9702117d12/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:41.122170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 866/1717] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:41.124108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447deb5-d35e-45fd-85d8-ef82ea3b0714 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:41.124666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447deb5-d35e-45fd-85d8-ef82ea3b0714 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:41.125522 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447deb5-d35e-45fd-85d8-ef82ea3b0714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:41.143542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dd3b8-e30a-4e4c-9146-2dd3bdb102d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef3038d445c43eb869400c1d78caede, user_id=d1134c8208ce406b812b7e9702117d12, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:41.149416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dd3b8-e30a-4e4c-9146-2dd3bdb102d9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:41.191265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-f447deb5-d35e-45fd-85d8-ef82ea3b0714 None None] MFA Rules not processed for user `f79d3ef7ae534fab9f23f0045a4bf325`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:41.192649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f447deb5-d35e-45fd-85d8-ef82ea3b0714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:41.193837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 852/1718] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:40 2022] PUT /identity/v3/projects/1ef3038d445c43eb869400c1d78caede/users/d1134c8208ce406b812b7e9702117d12/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:41.203465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bfc42-18c1-4fbb-8427-8520afe4fafb None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:41.203751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bfc42-18c1-4fbb-8427-8520afe4fafb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:41.204030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bfc42-18c1-4fbb-8427-8520afe4fafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:41.273522 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8e3bfc42-18c1-4fbb-8427-8520afe4fafb None None] MFA Rules not processed for user `fa3abf6b7b044a1b8ad16aef5413a0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:41.274759 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8e3bfc42-18c1-4fbb-8427-8520afe4fafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:41.315055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 867/1719] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:41.316451 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447deb5-d35e-45fd-85d8-ef82ea3b0714 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:41.465158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447deb5-d35e-45fd-85d8-ef82ea3b0714 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:41.466696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 853/1720] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:41.467751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bfc42-18c1-4fbb-8427-8520afe4fafb None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:41.471069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8e3bfc42-18c1-4fbb-8427-8520afe4fafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:41.476596 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ef83-7b77-4fae-a843-a040a3d5218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:41.477402 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ef83-7b77-4fae-a843-a040a3d5218f admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:41.478579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ef83-7b77-4fae-a843-a040a3d5218f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:41.479429 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ef83-7b77-4fae-a843-a040a3d5218f admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:41.479922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8ef83-7b77-4fae-a843-a040a3d5218f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:41.483900 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8ef83-7b77-4fae-a843-a040a3d5218f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:41.503554 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 868/1721] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:41.504646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ef83-7b77-4fae-a843-a040a3d5218f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:41.508223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f2b8ef83-7b77-4fae-a843-a040a3d5218f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:41.539809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:41.546709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:41.647987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ef83-7b77-4fae-a843-a040a3d5218f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:41.656229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6e29f-e30e-49c6-9df0-46dae1044d53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:41.657520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e29f-e30e-49c6-9df0-46dae1044d53 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:41.658220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e29f-e30e-49c6-9df0-46dae1044d53 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:41.658696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e29f-e30e-49c6-9df0-46dae1044d53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:41.677345 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6e29f-e30e-49c6-9df0-46dae1044d53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:41.681084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6e29f-e30e-49c6-9df0-46dae1044d53 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:41.682285 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bfc42-18c1-4fbb-8427-8520afe4fafb None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:41.695846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 869/1722] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:41.697676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110eee7-fb64-4f38-ae1e-592b7e4a4374 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:41.698109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110eee7-fb64-4f38-ae1e-592b7e4a4374 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:41.698401 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110eee7-fb64-4f38-ae1e-592b7e4a4374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:41.710841 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7789e-e8ce-4cd4-972e-19cfe249b971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:41.711592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7789e-e8ce-4cd4-972e-19cfe249b971 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:41.714339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7789e-e8ce-4cd4-972e-19cfe249b971 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:41.714639 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7789e-e8ce-4cd4-972e-19cfe249b971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:41.722070 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-9110eee7-fb64-4f38-ae1e-592b7e4a4374 None None] MFA Rules not processed for user `8b4a6b0dc41d446f8c46bd5097f6b254`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:41.723568 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9110eee7-fb64-4f38-ae1e-592b7e4a4374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:41.748762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7789e-e8ce-4cd4-972e-19cfe249b971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:41.750773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7789e-e8ce-4cd4-972e-19cfe249b971 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:41.762010 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 854/1723] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:41.763804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7789e-e8ce-4cd4-972e-19cfe249b971 service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:41.791019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7789e-e8ce-4cd4-972e-19cfe249b971 service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:41.803770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 870/1724] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:41.804781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110eee7-fb64-4f38-ae1e-592b7e4a4374 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:41.805576 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c1600-f625-400d-bbf1-297f5afc74d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:41.806198 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9110eee7-fb64-4f38-ae1e-592b7e4a4374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:41.808295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c1600-f625-400d-bbf1-297f5afc74d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:41.808762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c1600-f625-400d-bbf1-297f5afc74d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:41.810007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c1600-f625-400d-bbf1-297f5afc74d3 admin admin] PATH_INFO: `/v3/projects/1ef3038d445c43eb869400c1d78caede/users/d1134c8208ce406b812b7e9702117d12/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:41.815676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c1600-f625-400d-bbf1-297f5afc74d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef3038d445c43eb869400c1d78caede, user_id=d1134c8208ce406b812b7e9702117d12, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:41.823067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110eee7-fb64-4f38-ae1e-592b7e4a4374 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:41.828221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:41.828951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:41.829588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:41.829938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] PATH_INFO: `/v3/projects/ce184ea697c04374b78038acccb5b377` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:41.831329 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce184ea697c04374b78038acccb5b377)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:41.831825 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c1600-f625-400d-bbf1-297f5afc74d3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:41.836896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:41.881469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 855/1725] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:41 2022] PUT /identity/v3/projects/1ef3038d445c43eb869400c1d78caede/users/d1134c8208ce406b812b7e9702117d12/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:41.892877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ece0f8-0459-4ce4-99e1-015d5008b2cd None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:41.893390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ece0f8-0459-4ce4-99e1-015d5008b2cd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:41.893851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ece0f8-0459-4ce4-99e1-015d5008b2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:42.011462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d4ece0f8-0459-4ce4-99e1-015d5008b2cd None None] MFA Rules not processed for user `d1134c8208ce406b812b7e9702117d12`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:42.012829 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d4ece0f8-0459-4ce4-99e1-015d5008b2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:42.020531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce184ea697c04374b78038acccb5b377', 'request_id': 'req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:42.040875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce184ea697c04374b78038acccb5b377', 'request_id': 'req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:42.057110 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce184ea697c04374b78038acccb5b377', 'request_id': 'req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:42.110986 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] The token cache is being invalidate because project ce184ea697c04374b78038acccb5b377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:07:42.110986 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:42.116843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:42.124144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 871/1726] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:07:41 2022] DELETE /identity/v3/projects/ce184ea697c04374b78038acccb5b377 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:42.125193 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:42.132993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:42.238159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:42.258097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 856/1727] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:07:42.272211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ece0f8-0459-4ce4-99e1-015d5008b2cd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:42.273958 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d4ece0f8-0459-4ce4-99e1-015d5008b2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:42.326703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2e1b0-5087-43c9-92e0-0a5187f599b9 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:42.348018 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1be384-daba-4628-8eed-eb920836e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:42.348688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1be384-daba-4628-8eed-eb920836e44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:42.348976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1be384-daba-4628-8eed-eb920836e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:42.349257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1be384-daba-4628-8eed-eb920836e44a admin admin] PATH_INFO: `/v3/users/dcae9bf9ba3f4fdd93f0261d9ac79ce8` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:42.358385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1be384-daba-4628-8eed-eb920836e44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcae9bf9ba3f4fdd93f0261d9ac79ce8)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:42.364998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1be384-daba-4628-8eed-eb920836e44a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:42.499839 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ece0f8-0459-4ce4-99e1-015d5008b2cd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:42.514172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe91eb-2e7a-42d2-9c7a-ac5bd486e7dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:42.514859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe91eb-2e7a-42d2-9c7a-ac5bd486e7dd service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:42.515034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe91eb-2e7a-42d2-9c7a-ac5bd486e7dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:42.515313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe91eb-2e7a-42d2-9c7a-ac5bd486e7dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:42.526096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b9fe91eb-2e7a-42d2-9c7a-ac5bd486e7dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:42.547038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5a1be384-daba-4628-8eed-eb920836e44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcae9bf9ba3f4fdd93f0261d9ac79ce8'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:42.572421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5a1be384-daba-4628-8eed-eb920836e44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcae9bf9ba3f4fdd93f0261d9ac79ce8'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:42.573269 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5a1be384-daba-4628-8eed-eb920836e44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcae9bf9ba3f4fdd93f0261d9ac79ce8'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:42.574768 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5a1be384-daba-4628-8eed-eb920836e44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcae9bf9ba3f4fdd93f0261d9ac79ce8'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:42.623043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5a1be384-daba-4628-8eed-eb920836e44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcae9bf9ba3f4fdd93f0261d9ac79ce8'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:42.648217 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:42.672996 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 872/1728] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:07:42 2022] DELETE /identity/v3/users/dcae9bf9ba3f4fdd93f0261d9ac79ce8 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:42.733929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe91eb-2e7a-42d2-9c7a-ac5bd486e7dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:42.735457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe91eb-2e7a-42d2-9c7a-ac5bd486e7dd service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:42.757739 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 857/1729] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:42.904110 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69033f2-e417-46fe-bc11-2717a74480f1 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:42.904917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69033f2-e417-46fe-bc11-2717a74480f1 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:42.905748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69033f2-e417-46fe-bc11-2717a74480f1 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:42.914254 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 873/1730] 10.222.0.17 () {54 vars in 912 bytes} [Fri Aug 19 21:07:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:07:42.933740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc65766-edd5-4cbb-969c-cd63acf76ebd None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:42.934320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc65766-edd5-4cbb-969c-cd63acf76ebd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:42.934847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc65766-edd5-4cbb-969c-cd63acf76ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:43.031803 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4dc65766-edd5-4cbb-969c-cd63acf76ebd None None] MFA Rules not processed for user `95b17424a40b475480403eb9f4f3f88f`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:43.033033 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4dc65766-edd5-4cbb-969c-cd63acf76ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:43.168170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 858/1731] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:07:43.265625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69033f2-e417-46fe-bc11-2717a74480f1 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:43.268535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c69033f2-e417-46fe-bc11-2717a74480f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:43.299950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69033f2-e417-46fe-bc11-2717a74480f1 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:43.312095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaf68d-871b-475f-81d8-c2b354480a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:43.312780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaf68d-871b-475f-81d8-c2b354480a21 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:43.316355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaf68d-871b-475f-81d8-c2b354480a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:43.318991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaf68d-871b-475f-81d8-c2b354480a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:43.340851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeaf68d-871b-475f-81d8-c2b354480a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:43.345665 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeaf68d-871b-475f-81d8-c2b354480a21 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:43.372740 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 874/1732] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:07:43.674436 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472579-30c2-44aa-bd6b-33744b48ae81 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:43.674932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472579-30c2-44aa-bd6b-33744b48ae81 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:43.674932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472579-30c2-44aa-bd6b-33744b48ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:43.739151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-df472579-30c2-44aa-bd6b-33744b48ae81 None None] MFA Rules not processed for user `467666e0a8d64f649526e84fdcc1a7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:43.744171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-df472579-30c2-44aa-bd6b-33744b48ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:43.866061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930336b-068d-44d3-8ea0-cb0e72fd8da0 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:43.866841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930336b-068d-44d3-8ea0-cb0e72fd8da0 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:43.867036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930336b-068d-44d3-8ea0-cb0e72fd8da0 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:43.868475 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 875/1733] 10.222.0.17 () {54 vars in 912 bytes} [Fri Aug 19 21:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:07:43.894176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661fba7-0667-4bda-9847-a565feba4b40 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:43.894480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661fba7-0667-4bda-9847-a565feba4b40 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:43.894771 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661fba7-0667-4bda-9847-a565feba4b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:43.953770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-a661fba7-0667-4bda-9847-a565feba4b40 None None] MFA Rules not processed for user `95b17424a40b475480403eb9f4f3f88f`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:43.956420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a661fba7-0667-4bda-9847-a565feba4b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:43.963270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 859/1734] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:43.975026 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472579-30c2-44aa-bd6b-33744b48ae81 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:43.989286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-df472579-30c2-44aa-bd6b-33744b48ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:43.993000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 876/1735] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:07:43.998649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d5acf-4cdf-4ad7-8052-863163679fea None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:44.005245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d5acf-4cdf-4ad7-8052-863163679fea None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:44.006690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d5acf-4cdf-4ad7-8052-863163679fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:44.063723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e15d5acf-4cdf-4ad7-8052-863163679fea None None] MFA Rules not processed for user `467666e0a8d64f649526e84fdcc1a7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:44.069993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e15d5acf-4cdf-4ad7-8052-863163679fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:44.081711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 877/1736] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:44.082668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d5acf-4cdf-4ad7-8052-863163679fea None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:44.084445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e15d5acf-4cdf-4ad7-8052-863163679fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:44.101493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d5acf-4cdf-4ad7-8052-863163679fea None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:44.106255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b50b67-a256-4461-b268-b439b06bbccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:44.106937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b50b67-a256-4461-b268-b439b06bbccc service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:44.107275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b50b67-a256-4461-b268-b439b06bbccc service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:44.107557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b50b67-a256-4461-b268-b439b06bbccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:44.119683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b50b67-a256-4461-b268-b439b06bbccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:44.121599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b50b67-a256-4461-b268-b439b06bbccc service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:44.153124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 878/1737] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:44.156288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:44.197069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472579-30c2-44aa-bd6b-33744b48ae81 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:44.210843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:44.212902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:44.228340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:44.228743 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] PATH_INFO: `/v3/projects/9be412be0b734607beb2bebfd395afc5` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:44.235437 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be412be0b734607beb2bebfd395afc5)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:44.247447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:44.371120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be412be0b734607beb2bebfd395afc5', 'request_id': 'req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:44.386031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be412be0b734607beb2bebfd395afc5', 'request_id': 'req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:44.408640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be412be0b734607beb2bebfd395afc5', 'request_id': 'req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:44.439086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] The token cache is being invalidate because project 9be412be0b734607beb2bebfd395afc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:07:44.440085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:44.441604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:44.449341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 860/1738] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:07:43 2022] DELETE /identity/v3/projects/9be412be0b734607beb2bebfd395afc5 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:07:44.454381 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d207e-935b-4252-bde1-99ee5e225422 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:44.454860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d207e-935b-4252-bde1-99ee5e225422 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:44.455152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d207e-935b-4252-bde1-99ee5e225422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:44.491233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7f4d207e-935b-4252-bde1-99ee5e225422 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:44.497143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7f4d207e-935b-4252-bde1-99ee5e225422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:44.593283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:44.594988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:44.719472 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 879/1739] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:44.720340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d207e-935b-4252-bde1-99ee5e225422 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:44.724582 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7f4d207e-935b-4252-bde1-99ee5e225422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:44.765640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:44.807724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfe7a6-ea81-4422-a74c-f7bed4f9625b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:44.821103 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b209e4-6d9b-4c3b-bd4f-15fde9627577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:44.821897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b209e4-6d9b-4c3b-bd4f-15fde9627577 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:44.822190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b209e4-6d9b-4c3b-bd4f-15fde9627577 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:44.822473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b209e4-6d9b-4c3b-bd4f-15fde9627577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:44.824581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-02b209e4-6d9b-4c3b-bd4f-15fde9627577 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:44.880066 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d207e-935b-4252-bde1-99ee5e225422 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:44.886329 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b58934-83a9-4357-880a-6f48a51e8033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:44.888112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b58934-83a9-4357-880a-6f48a51e8033 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:44.888645 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b58934-83a9-4357-880a-6f48a51e8033 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:44.889181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b58934-83a9-4357-880a-6f48a51e8033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:44.899021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-68b58934-83a9-4357-880a-6f48a51e8033 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:44.932231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b209e4-6d9b-4c3b-bd4f-15fde9627577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:44.934398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b209e4-6d9b-4c3b-bd4f-15fde9627577 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:44.949582 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 861/1740] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:07:44.951357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d732e60-c1e4-4e49-a452-c875f8103eed None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:44.951983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d732e60-c1e4-4e49-a452-c875f8103eed None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:44.952365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d732e60-c1e4-4e49-a452-c875f8103eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:44.980691 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9d732e60-c1e4-4e49-a452-c875f8103eed None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:44.982384 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9d732e60-c1e4-4e49-a452-c875f8103eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:45.028257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 862/1741] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:45.031857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c31715-f5de-461c-9201-a2c0772cfee4 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:45.032165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c31715-f5de-461c-9201-a2c0772cfee4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:45.032445 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c31715-f5de-461c-9201-a2c0772cfee4 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:45.035326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 863/1742] 10.222.0.17 () {54 vars in 961 bytes} [Fri Aug 19 21:07:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:07:45.037002 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c31715-f5de-461c-9201-a2c0772cfee4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:45.039587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d0c31715-f5de-461c-9201-a2c0772cfee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:45.063649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c31715-f5de-461c-9201-a2c0772cfee4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:45.068870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:45.069961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:45.070378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:45.070862 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] PATH_INFO: `/v3/users/9f133534154846458c01707d5b33581f` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:45.072211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f133534154846458c01707d5b33581f)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:45.074279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:45.084140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b58934-83a9-4357-880a-6f48a51e8033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:45.088177 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b58934-83a9-4357-880a-6f48a51e8033 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:45.126956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:45.132489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 880/1743] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:45.133430 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b58934-83a9-4357-880a-6f48a51e8033 service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:45.171307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b58934-83a9-4357-880a-6f48a51e8033 service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:45.180461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c61d96-9873-433b-a494-ea791ea6d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:45.181409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c61d96-9873-433b-a494-ea791ea6d65d admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:45.181889 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c61d96-9873-433b-a494-ea791ea6d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:45.182571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c61d96-9873-433b-a494-ea791ea6d65d admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:45.183559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c61d96-9873-433b-a494-ea791ea6d65d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:45.184688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c61d96-9873-433b-a494-ea791ea6d65d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:45.187202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c61d96-9873-433b-a494-ea791ea6d65d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:45.219660 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 881/1744] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:45.223527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06a8cd-0e51-4704-b274-12809db4a97a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:45.224327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06a8cd-0e51-4704-b274-12809db4a97a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:45.224891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06a8cd-0e51-4704-b274-12809db4a97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:45.237937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f133534154846458c01707d5b33581f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:45.276031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f133534154846458c01707d5b33581f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:45.289055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ea06a8cd-0e51-4704-b274-12809db4a97a None None] MFA Rules not processed for user `be0a8d40d21048afa4ce94706e3625c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:45.291407 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ea06a8cd-0e51-4704-b274-12809db4a97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:45.294414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f133534154846458c01707d5b33581f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:45.296031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f133534154846458c01707d5b33581f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:45.296705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f133534154846458c01707d5b33581f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:45.334447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 864/1745] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:07:45 2022] DELETE /identity/v3/users/9f133534154846458c01707d5b33581f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:45.334447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:45.338943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:45.508349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 882/1746] 10.222.0.17 () {58 vars in 1058 bytes} [Fri Aug 19 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:45.509759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb4311-1f7b-4016-b3f9-73ee0f555b5f None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:45.510056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb4311-1f7b-4016-b3f9-73ee0f555b5f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:45.510341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb4311-1f7b-4016-b3f9-73ee0f555b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:45.562632 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-31cb4311-1f7b-4016-b3f9-73ee0f555b5f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:45.583218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-31cb4311-1f7b-4016-b3f9-73ee0f555b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:45.592013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86693f8c-736c-45db-98bb-fe37156c5e4e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:45.610888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a50ff9-64b7-43f5-95d2-f1189275f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:45.611523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a50ff9-64b7-43f5-95d2-f1189275f423 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:45.611805 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a50ff9-64b7-43f5-95d2-f1189275f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:45.612255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a50ff9-64b7-43f5-95d2-f1189275f423 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:45.612707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a50ff9-64b7-43f5-95d2-f1189275f423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:45.614113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 883/1747] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:45.615240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a50ff9-64b7-43f5-95d2-f1189275f423 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:45.616963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb4311-1f7b-4016-b3f9-73ee0f555b5f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:45.706144 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 865/1748] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:45 2022] POST /identity/v3/projects => generated 379 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:45.716416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a50ff9-64b7-43f5-95d2-f1189275f423 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:45.719592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:45.721068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-55a50ff9-64b7-43f5-95d2-f1189275f423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:45.782052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb4311-1f7b-4016-b3f9-73ee0f555b5f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:45.955318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a50ff9-64b7-43f5-95d2-f1189275f423 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:45.969475 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069dae5-e823-44f2-b66f-c1e0d35dd179 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:45.970118 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069dae5-e823-44f2-b66f-c1e0d35dd179 service placement] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:45.970408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069dae5-e823-44f2-b66f-c1e0d35dd179 service placement] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:45.970691 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069dae5-e823-44f2-b66f-c1e0d35dd179 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:45.973074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f5b9e-e3b3-4a50-b81e-dc48d44c2b74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:45.973686 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f5b9e-e3b3-4a50-b81e-dc48d44c2b74 service placement] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:45.973973 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f5b9e-e3b3-4a50-b81e-dc48d44c2b74 service placement] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:45.974252 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f5b9e-e3b3-4a50-b81e-dc48d44c2b74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:45.975413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1069dae5-e823-44f2-b66f-c1e0d35dd179 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:45.979362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d78f5b9e-e3b3-4a50-b81e-dc48d44c2b74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:46.002603 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069dae5-e823-44f2-b66f-c1e0d35dd179 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:46.004279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069dae5-e823-44f2-b66f-c1e0d35dd179 service placement] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:46.010721 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f5b9e-e3b3-4a50-b81e-dc48d44c2b74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:46.012495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:46.015582 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f5b9e-e3b3-4a50-b81e-dc48d44c2b74 service placement] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:46.033479 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 866/1749] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:46.035895 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 884/1750] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:46.036950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f5b9e-e3b3-4a50-b81e-dc48d44c2b74 service placement] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:46.038214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33abad-e6df-4d3a-8868-35bb27989b69 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:46.039465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d78f5b9e-e3b3-4a50-b81e-dc48d44c2b74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:46.039893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33abad-e6df-4d3a-8868-35bb27989b69 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:46.040202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33abad-e6df-4d3a-8868-35bb27989b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:46.065158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-fb33abad-e6df-4d3a-8868-35bb27989b69 None None] MFA Rules not processed for user `32bc4cb848c446ab8d4d330f9e2f0022`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:46.068133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fb33abad-e6df-4d3a-8868-35bb27989b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:46.196610 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f5b9e-e3b3-4a50-b81e-dc48d44c2b74 service placement] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:46.204553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8246e5e-d8d0-4bcc-a38a-d887f3c69db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:46.207046 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8246e5e-d8d0-4bcc-a38a-d887f3c69db1 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:46.207621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8246e5e-d8d0-4bcc-a38a-d887f3c69db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:46.208245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8246e5e-d8d0-4bcc-a38a-d887f3c69db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:46.240267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 867/1751] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:46.244029 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33abad-e6df-4d3a-8868-35bb27989b69 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:46.393519 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8246e5e-d8d0-4bcc-a38a-d887f3c69db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:46.396273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8246e5e-d8d0-4bcc-a38a-d887f3c69db1 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:46.450854 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 885/1752] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:46.451932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8246e5e-d8d0-4bcc-a38a-d887f3c69db1 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:46.456167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f8246e5e-d8d0-4bcc-a38a-d887f3c69db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:46.463524 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33abad-e6df-4d3a-8868-35bb27989b69 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:46.474463 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52405f-9cb3-424c-9c7f-aec5c2083f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:46.476628 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52405f-9cb3-424c-9c7f-aec5c2083f63 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:46.476924 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52405f-9cb3-424c-9c7f-aec5c2083f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:46.477270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52405f-9cb3-424c-9c7f-aec5c2083f63 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:46.479016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52405f-9cb3-424c-9c7f-aec5c2083f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:46.485069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52405f-9cb3-424c-9c7f-aec5c2083f63 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:46.512113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8246e5e-d8d0-4bcc-a38a-d887f3c69db1 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:46.531228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bf0eb-3ed7-4835-9131-b894704854b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:46.533135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bf0eb-3ed7-4835-9131-b894704854b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:46.533730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bf0eb-3ed7-4835-9131-b894704854b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:46.534785 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 868/1753] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:46 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:46.534959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bf0eb-3ed7-4835-9131-b894704854b2 admin admin] PATH_INFO: `/v3/users/f79d3ef7ae534fab9f23f0045a4bf325` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:46.539733 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52405f-9cb3-424c-9c7f-aec5c2083f63 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:46.543091 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bf0eb-3ed7-4835-9131-b894704854b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f79d3ef7ae534fab9f23f0045a4bf325)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:46.549747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bf0eb-3ed7-4835-9131-b894704854b2 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:46.571039 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52405f-9cb3-424c-9c7f-aec5c2083f63 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:46.592298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2bbc8-cb40-4759-8a6c-9f32635d925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:46.594558 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2bbc8-cb40-4759-8a6c-9f32635d925a admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:46.596708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2bbc8-cb40-4759-8a6c-9f32635d925a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:46.597177 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2bbc8-cb40-4759-8a6c-9f32635d925a admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:46.598074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2bbc8-cb40-4759-8a6c-9f32635d925a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:46.603971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2bbc8-cb40-4759-8a6c-9f32635d925a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:46.638056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:46.659383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 869/1754] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:07:46.668183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2bbc8-cb40-4759-8a6c-9f32635d925a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:46.730061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2bbc8-cb40-4759-8a6c-9f32635d925a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:46.751334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cb732-bce5-4c3d-bc02-b43b61324bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:46.755706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cb732-bce5-4c3d-bc02-b43b61324bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:46.755706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cb732-bce5-4c3d-bc02-b43b61324bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:46.755706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cb732-bce5-4c3d-bc02-b43b61324bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:46.757860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cb732-bce5-4c3d-bc02-b43b61324bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:46.758529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cb732-bce5-4c3d-bc02-b43b61324bd7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:46.773306 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-871bf0eb-3ed7-4835-9131-b894704854b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f79d3ef7ae534fab9f23f0045a4bf325'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:46.792905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 870/1755] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:46.797814 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cb732-bce5-4c3d-bc02-b43b61324bd7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:46.802494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-871bf0eb-3ed7-4835-9131-b894704854b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f79d3ef7ae534fab9f23f0045a4bf325'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:46.803243 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-871bf0eb-3ed7-4835-9131-b894704854b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f79d3ef7ae534fab9f23f0045a4bf325'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:46.803872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-871bf0eb-3ed7-4835-9131-b894704854b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f79d3ef7ae534fab9f23f0045a4bf325'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:46.842787 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cb732-bce5-4c3d-bc02-b43b61324bd7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:46.854078 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-871bf0eb-3ed7-4835-9131-b894704854b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f79d3ef7ae534fab9f23f0045a4bf325'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:46.855038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97439ba0-c331-45bf-8853-57c904d9ba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:46.859816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97439ba0-c331-45bf-8853-57c904d9ba17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:46.861722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97439ba0-c331-45bf-8853-57c904d9ba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:46.861876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97439ba0-c331-45bf-8853-57c904d9ba17 admin admin] PATH_INFO: `/v3/projects/41a4621b41c441749adb93db4a09c25a/users/40006409ee7c47c587c071ff67949bda/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:46.894839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 886/1756] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:07:46 2022] DELETE /identity/v3/users/f79d3ef7ae534fab9f23f0045a4bf325 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:46.912813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae1315-56be-4042-8001-23fbabf4809c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:46.913113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae1315-56be-4042-8001-23fbabf4809c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:46.913574 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae1315-56be-4042-8001-23fbabf4809c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:46.934409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97439ba0-c331-45bf-8853-57c904d9ba17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a4621b41c441749adb93db4a09c25a, user_id=40006409ee7c47c587c071ff67949bda, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:46.948571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97439ba0-c331-45bf-8853-57c904d9ba17 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:46.956543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-05ae1315-56be-4042-8001-23fbabf4809c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:46.958350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-05ae1315-56be-4042-8001-23fbabf4809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:47.005822 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 871/1757] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:46 2022] PUT /identity/v3/projects/41a4621b41c441749adb93db4a09c25a/users/40006409ee7c47c587c071ff67949bda/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:47.020719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879af22-6112-4e20-a6e9-df28958e1239 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:47.021015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879af22-6112-4e20-a6e9-df28958e1239 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:47.021300 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879af22-6112-4e20-a6e9-df28958e1239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:47.155799 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4879af22-6112-4e20-a6e9-df28958e1239 None None] MFA Rules not processed for user `40006409ee7c47c587c071ff67949bda`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:47.157121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4879af22-6112-4e20-a6e9-df28958e1239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:47.167804 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 887/1758] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:47.226642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae1315-56be-4042-8001-23fbabf4809c None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:47.232068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-05ae1315-56be-4042-8001-23fbabf4809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:47.331842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:47.395905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 872/1759] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:47.413134 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879af22-6112-4e20-a6e9-df28958e1239 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:47.419716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4879af22-6112-4e20-a6e9-df28958e1239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:47.560898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae1315-56be-4042-8001-23fbabf4809c None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:47.667970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879af22-6112-4e20-a6e9-df28958e1239 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:47.687171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc6f77-64fc-4b1f-bfa9-a92057827482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:47.690188 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc6f77-64fc-4b1f-bfa9-a92057827482 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:47.693028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc6f77-64fc-4b1f-bfa9-a92057827482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:47.694837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc6f77-64fc-4b1f-bfa9-a92057827482 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:47.696909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc6f77-64fc-4b1f-bfa9-a92057827482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:47.708922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc6f77-64fc-4b1f-bfa9-a92057827482 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:47.724732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:47.736179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4398360-52a7-46df-82c2-a9dc4a48f1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:47.737279 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4398360-52a7-46df-82c2-a9dc4a48f1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:47.741965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4398360-52a7-46df-82c2-a9dc4a48f1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:47.743459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4398360-52a7-46df-82c2-a9dc4a48f1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:47.780067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 873/1760] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:47 2022] POST /identity/v3/projects => generated 381 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:47.781610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc6f77-64fc-4b1f-bfa9-a92057827482 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:47.783356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4398360-52a7-46df-82c2-a9dc4a48f1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:47.789503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4398360-52a7-46df-82c2-a9dc4a48f1a9 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:47.879291 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 888/1761] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:47.963247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc6f77-64fc-4b1f-bfa9-a92057827482 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:47.972922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0f8f5-8b91-4871-ab76-26f80d22ab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:47.973569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0f8f5-8b91-4871-ab76-26f80d22ab67 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:47.973857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0f8f5-8b91-4871-ab76-26f80d22ab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:47.974139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0f8f5-8b91-4871-ab76-26f80d22ab67 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:47.977513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0f8f5-8b91-4871-ab76-26f80d22ab67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:47.979835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0f8f5-8b91-4871-ab76-26f80d22ab67 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:48.029881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4398360-52a7-46df-82c2-a9dc4a48f1a9 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:48.031880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e4398360-52a7-46df-82c2-a9dc4a48f1a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:48.071146 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4398360-52a7-46df-82c2-a9dc4a48f1a9 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:48.087041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a97bb-60f6-435c-8d29-2aba5671242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:48.088032 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a97bb-60f6-435c-8d29-2aba5671242c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:48.088476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a97bb-60f6-435c-8d29-2aba5671242c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:48.088944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a97bb-60f6-435c-8d29-2aba5671242c admin admin] PATH_INFO: `/v3/projects/c938c9c7b76543209617771170d25464` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:48.091396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a97bb-60f6-435c-8d29-2aba5671242c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c938c9c7b76543209617771170d25464)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:48.095937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 874/1762] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:47 2022] POST /identity/v3/users => generated 297 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:48.097087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0f8f5-8b91-4871-ab76-26f80d22ab67 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:48.102220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a97bb-60f6-435c-8d29-2aba5671242c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:48.140192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0f8f5-8b91-4871-ab76-26f80d22ab67 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:48.174891 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9be690-dbb4-4f55-a221-2622e485f264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:48.175557 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9be690-dbb4-4f55-a221-2622e485f264 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:48.175844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9be690-dbb4-4f55-a221-2622e485f264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:48.176446 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9be690-dbb4-4f55-a221-2622e485f264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:48.176885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9be690-dbb4-4f55-a221-2622e485f264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:48.179541 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9be690-dbb4-4f55-a221-2622e485f264 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:48.220899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 875/1763] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:48.223320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9be690-dbb4-4f55-a221-2622e485f264 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:48.261302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9be690-dbb4-4f55-a221-2622e485f264 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:48.316317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-149a97bb-60f6-435c-8d29-2aba5671242c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c938c9c7b76543209617771170d25464', 'request_id': 'req-149a97bb-60f6-435c-8d29-2aba5671242c'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:48.346530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-149a97bb-60f6-435c-8d29-2aba5671242c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c938c9c7b76543209617771170d25464', 'request_id': 'req-149a97bb-60f6-435c-8d29-2aba5671242c'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:48.378857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-149a97bb-60f6-435c-8d29-2aba5671242c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c938c9c7b76543209617771170d25464', 'request_id': 'req-149a97bb-60f6-435c-8d29-2aba5671242c'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:48.465839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-149a97bb-60f6-435c-8d29-2aba5671242c admin admin] The token cache is being invalidate because project c938c9c7b76543209617771170d25464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:07:48.466146 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-149a97bb-60f6-435c-8d29-2aba5671242c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:48.481049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-149a97bb-60f6-435c-8d29-2aba5671242c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:48.490541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 889/1764] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:07:48 2022] DELETE /identity/v3/projects/c938c9c7b76543209617771170d25464 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:48.490541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb042f03-4865-41f7-9088-cf2c835e7513 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:48.490541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb042f03-4865-41f7-9088-cf2c835e7513 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:48.490541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb042f03-4865-41f7-9088-cf2c835e7513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:48.529639 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:48.539367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-cb042f03-4865-41f7-9088-cf2c835e7513 None None] MFA Rules not processed for user `467666e0a8d64f649526e84fdcc1a7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:48.541353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cb042f03-4865-41f7-9088-cf2c835e7513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:48.573709 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfbc8e-7285-43f9-8149-d3033e53f256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:48.577440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfbc8e-7285-43f9-8149-d3033e53f256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:48.577916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfbc8e-7285-43f9-8149-d3033e53f256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:48.578630 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfbc8e-7285-43f9-8149-d3033e53f256 admin admin] PATH_INFO: `/v3/projects/ebb8624d726a42ce9b060b781cd2878b/users/be699d7507e04e23b70f098ba274330b/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:48.658902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfbc8e-7285-43f9-8149-d3033e53f256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb8624d726a42ce9b060b781cd2878b, user_id=be699d7507e04e23b70f098ba274330b, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:48.668981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfbc8e-7285-43f9-8149-d3033e53f256 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:48.719959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 876/1765] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:48 2022] PUT /identity/v3/projects/ebb8624d726a42ce9b060b781cd2878b/users/be699d7507e04e23b70f098ba274330b/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:48.721094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfbc8e-7285-43f9-8149-d3033e53f256 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:48.728023 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c6dfbc8e-7285-43f9-8149-d3033e53f256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:48.764943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 890/1766] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:48.764943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb042f03-4865-41f7-9088-cf2c835e7513 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:48.782367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cb042f03-4865-41f7-9088-cf2c835e7513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:48.820809 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb042f03-4865-41f7-9088-cf2c835e7513 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:48.924728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfbc8e-7285-43f9-8149-d3033e53f256 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:48.940849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:48.941571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:48.941965 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:48.942245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] PATH_INFO: `/v3/users/8593ec7293a34819a6231a0aa8308160` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:48.945351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8593ec7293a34819a6231a0aa8308160)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:48.951289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:49.062268 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8593ec7293a34819a6231a0aa8308160'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:49.089651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3f26d-0444-4436-8ef4-5696fca7fa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:49.090298 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3f26d-0444-4436-8ef4-5696fca7fa98 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:49.090578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3f26d-0444-4436-8ef4-5696fca7fa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:49.090886 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3f26d-0444-4436-8ef4-5696fca7fa98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:49.091774 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3f26d-0444-4436-8ef4-5696fca7fa98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:49.092441 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8593ec7293a34819a6231a0aa8308160'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:49.093697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3f26d-0444-4436-8ef4-5696fca7fa98 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:49.108093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8593ec7293a34819a6231a0aa8308160'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:49.108853 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8593ec7293a34819a6231a0aa8308160'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:49.109685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8593ec7293a34819a6231a0aa8308160'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:49.141298 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 891/1768] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:49.143104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 877/1768] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:07:48 2022] DELETE /identity/v3/users/8593ec7293a34819a6231a0aa8308160 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:49.143541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3f26d-0444-4436-8ef4-5696fca7fa98 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:49.144267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:49.150104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:49.152819 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e3a3f26d-0444-4436-8ef4-5696fca7fa98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:49.199488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3f26d-0444-4436-8ef4-5696fca7fa98 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:49.237114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:49.361754 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:49.423062 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3d80e-77d1-4181-9238-736473897a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:49.423827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3d80e-77d1-4181-9238-736473897a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:49.424001 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3d80e-77d1-4181-9238-736473897a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:49.424278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3d80e-77d1-4181-9238-736473897a9c admin admin] PATH_INFO: `/v3/projects/36895692e727456a86c0151a64a9c600` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:49.426550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3d80e-77d1-4181-9238-736473897a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=36895692e727456a86c0151a64a9c600)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:49.429318 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3d80e-77d1-4181-9238-736473897a9c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:49.434186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fa922-afdc-4ebf-a34d-90f0231a30ce admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:49.445327 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70828-b581-41bc-88f3-ebb023fd96ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:49.446088 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70828-b581-41bc-88f3-ebb023fd96ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:49.446377 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70828-b581-41bc-88f3-ebb023fd96ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:49.446656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70828-b581-41bc-88f3-ebb023fd96ef admin admin] PATH_INFO: `/v3/projects/ebb8624d726a42ce9b060b781cd2878b/users/be699d7507e04e23b70f098ba274330b/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:49.452937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70828-b581-41bc-88f3-ebb023fd96ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb8624d726a42ce9b060b781cd2878b, user_id=be699d7507e04e23b70f098ba274330b, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:49.459356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70828-b581-41bc-88f3-ebb023fd96ef admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:49.496818 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 878/1769] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:49 2022] PUT /identity/v3/projects/ebb8624d726a42ce9b060b781cd2878b/users/be699d7507e04e23b70f098ba274330b/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:07:49.504888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111995b-26e1-4bf2-b363-986bee2708d2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:49.505196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111995b-26e1-4bf2-b363-986bee2708d2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:49.505463 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111995b-26e1-4bf2-b363-986bee2708d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:49.620920 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-b0e3d80e-77d1-4181-9238-736473897a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36895692e727456a86c0151a64a9c600', 'request_id': 'req-b0e3d80e-77d1-4181-9238-736473897a9c'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:49.646874 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-b0e3d80e-77d1-4181-9238-736473897a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36895692e727456a86c0151a64a9c600', 'request_id': 'req-b0e3d80e-77d1-4181-9238-736473897a9c'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:49.663124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8111995b-26e1-4bf2-b363-986bee2708d2 None None] MFA Rules not processed for user `be699d7507e04e23b70f098ba274330b`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:49.671150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8111995b-26e1-4bf2-b363-986bee2708d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:49.671758 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-b0e3d80e-77d1-4181-9238-736473897a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36895692e727456a86c0151a64a9c600', 'request_id': 'req-b0e3d80e-77d1-4181-9238-736473897a9c'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:49.706722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-b0e3d80e-77d1-4181-9238-736473897a9c admin admin] The token cache is being invalidate because project 36895692e727456a86c0151a64a9c600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:07:49.710184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-b0e3d80e-77d1-4181-9238-736473897a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:49.713646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-b0e3d80e-77d1-4181-9238-736473897a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:49.728449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 892/1770] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:07:49 2022] DELETE /identity/v3/projects/36895692e727456a86c0151a64a9c600 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:49.728449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902c0b-eed8-4e2e-a5a2-c54156567f56 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:49.729055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902c0b-eed8-4e2e-a5a2-c54156567f56 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:49.732023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902c0b-eed8-4e2e-a5a2-c54156567f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:49.807209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-89902c0b-eed8-4e2e-a5a2-c54156567f56 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:49.809939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-89902c0b-eed8-4e2e-a5a2-c54156567f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:49.929165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 879/1771] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:49.943593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111995b-26e1-4bf2-b363-986bee2708d2 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:49.947597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8111995b-26e1-4bf2-b363-986bee2708d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:50.003863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 893/1772] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:50.010627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a7422-ae5c-45ae-b60e-a162a3a8dc96 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:50.011084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a7422-ae5c-45ae-b60e-a162a3a8dc96 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:50.011279 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a7422-ae5c-45ae-b60e-a162a3a8dc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:50.084634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-626a7422-ae5c-45ae-b60e-a162a3a8dc96 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:50.086150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-626a7422-ae5c-45ae-b60e-a162a3a8dc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:50.101467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 894/1773] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:07:50.107578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a7422-ae5c-45ae-b60e-a162a3a8dc96 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:50.131232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a7422-ae5c-45ae-b60e-a162a3a8dc96 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:50.151751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509e27e-7d59-4bd6-9700-ce964ee93338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:50.152315 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111995b-26e1-4bf2-b363-986bee2708d2 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:50.152786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509e27e-7d59-4bd6-9700-ce964ee93338 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:50.152786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509e27e-7d59-4bd6-9700-ce964ee93338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:50.153016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509e27e-7d59-4bd6-9700-ce964ee93338 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:50.153597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509e27e-7d59-4bd6-9700-ce964ee93338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:50.153903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509e27e-7d59-4bd6-9700-ce964ee93338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:50.155567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509e27e-7d59-4bd6-9700-ce964ee93338 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:50.162411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0556fb-6091-4e50-bb56-1cffc3d2fb56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:50.164191 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0556fb-6091-4e50-bb56-1cffc3d2fb56 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:50.164725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0556fb-6091-4e50-bb56-1cffc3d2fb56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:50.170361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0556fb-6091-4e50-bb56-1cffc3d2fb56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:50.199136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0556fb-6091-4e50-bb56-1cffc3d2fb56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:50.201316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 895/1774] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:50.204615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0556fb-6091-4e50-bb56-1cffc3d2fb56 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:50.206187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509e27e-7d59-4bd6-9700-ce964ee93338 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:50.236863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509e27e-7d59-4bd6-9700-ce964ee93338 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:50.260634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 880/1775] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:50.271445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a87366-86ab-4c04-8f87-ea66ba773114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:50.272648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a87366-86ab-4c04-8f87-ea66ba773114 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:50.273050 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a87366-86ab-4c04-8f87-ea66ba773114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:50.273329 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a87366-86ab-4c04-8f87-ea66ba773114 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:50.287057 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a87366-86ab-4c04-8f87-ea66ba773114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:50.287207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0556fb-6091-4e50-bb56-1cffc3d2fb56 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:50.288777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ab0556fb-6091-4e50-bb56-1cffc3d2fb56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:50.298016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a87366-86ab-4c04-8f87-ea66ba773114 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:50.330569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0556fb-6091-4e50-bb56-1cffc3d2fb56 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:50.348756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:50.354083 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:50.356251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:50.358156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] PATH_INFO: `/v3/projects/261134730b954efc83dc84e6b8be76f8` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:50.385394 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=261134730b954efc83dc84e6b8be76f8)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:50.404350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:50.412662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 896/1776] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:50 2022] POST /identity/v3/projects => generated 403 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:50.415935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a87366-86ab-4c04-8f87-ea66ba773114 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:50.418989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-97a87366-86ab-4c04-8f87-ea66ba773114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:50.447530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:50.590425 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261134730b954efc83dc84e6b8be76f8', 'request_id': 'req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:50.615134 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261134730b954efc83dc84e6b8be76f8', 'request_id': 'req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:50.656938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:50.676913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261134730b954efc83dc84e6b8be76f8', 'request_id': 'req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:50.682222 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a87366-86ab-4c04-8f87-ea66ba773114 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:50.749163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] The token cache is being invalidate because project 261134730b954efc83dc84e6b8be76f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:07:50.749784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:50.753188 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:50.764922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 881/1777] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:07:50 2022] DELETE /identity/v3/projects/261134730b954efc83dc84e6b8be76f8 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:07:50.768225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:50.790790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:51.047483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd39c5f-9b22-44b2-a933-d37e71bad542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:51.051349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39c5f-9b22-44b2-a933-d37e71bad542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:51.051648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39c5f-9b22-44b2-a933-d37e71bad542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:51.051940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39c5f-9b22-44b2-a933-d37e71bad542 admin admin] PATH_INFO: `/v3/users/05ce6ce975964b53b25b2c44fd430e8d` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:51.059969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd39c5f-9b22-44b2-a933-d37e71bad542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ce6ce975964b53b25b2c44fd430e8d)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:51.068120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd39c5f-9b22-44b2-a933-d37e71bad542 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:51.126772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6279-0d3e-4b7a-8821-6adc66b70cb0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:51.156542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b537ba1-5699-4327-977a-09397afecc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:51.157218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537ba1-5699-4327-977a-09397afecc50 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:51.157449 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537ba1-5699-4327-977a-09397afecc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:51.158352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537ba1-5699-4327-977a-09397afecc50 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:51.159042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b537ba1-5699-4327-977a-09397afecc50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:51.163759 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b537ba1-5699-4327-977a-09397afecc50 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:51.246003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 882/1778] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:50 2022] POST /identity/v3/users => generated 302 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:51.247951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad6081-e88f-462f-a6ce-0c464c8dc2bc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:51.250038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad6081-e88f-462f-a6ce-0c464c8dc2bc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:51.250554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad6081-e88f-462f-a6ce-0c464c8dc2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:51.252757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-afd39c5f-9b22-44b2-a933-d37e71bad542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ce6ce975964b53b25b2c44fd430e8d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:51.265971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-afd39c5f-9b22-44b2-a933-d37e71bad542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ce6ce975964b53b25b2c44fd430e8d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:51.267627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-afd39c5f-9b22-44b2-a933-d37e71bad542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ce6ce975964b53b25b2c44fd430e8d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:51.268185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-afd39c5f-9b22-44b2-a933-d37e71bad542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ce6ce975964b53b25b2c44fd430e8d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:51.290725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-afd39c5f-9b22-44b2-a933-d37e71bad542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ce6ce975964b53b25b2c44fd430e8d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:51.314910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 897/1779] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:07:50 2022] DELETE /identity/v3/users/05ce6ce975964b53b25b2c44fd430e8d => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:51.316691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b304-7a49-4b58-8030-c9833914df34 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:51.316976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b304-7a49-4b58-8030-c9833914df34 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:51.317320 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b304-7a49-4b58-8030-c9833914df34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:51.382667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-85ad6081-e88f-462f-a6ce-0c464c8dc2bc None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:51.397003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:51.401367 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-85ad6081-e88f-462f-a6ce-0c464c8dc2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:51.404417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-2216b304-7a49-4b58-8030-c9833914df34 None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:51.406144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2216b304-7a49-4b58-8030-c9833914df34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:51.546471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 898/1780] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:51.565808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b304-7a49-4b58-8030-c9833914df34 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:51.571114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2216b304-7a49-4b58-8030-c9833914df34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:51.652781 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 883/1781] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:51.654646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17a2ce-cd57-4e8c-9c04-e761f889bf46 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:51.655192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17a2ce-cd57-4e8c-9c04-e761f889bf46 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:51.655721 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17a2ce-cd57-4e8c-9c04-e761f889bf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:51.721816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8e17a2ce-cd57-4e8c-9c04-e761f889bf46 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:51.724677 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8e17a2ce-cd57-4e8c-9c04-e761f889bf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:51.753739 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 884/1782] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:51.755116 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17a2ce-cd57-4e8c-9c04-e761f889bf46 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:51.760990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8e17a2ce-cd57-4e8c-9c04-e761f889bf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:51.801492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b304-7a49-4b58-8030-c9833914df34 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:51.807652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb09a69-3e87-4735-a348-3db5a243a8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:51.808787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb09a69-3e87-4735-a348-3db5a243a8ba admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:51.809071 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb09a69-3e87-4735-a348-3db5a243a8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:51.809347 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb09a69-3e87-4735-a348-3db5a243a8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:51.810026 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb09a69-3e87-4735-a348-3db5a243a8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:51.811852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb09a69-3e87-4735-a348-3db5a243a8ba admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:51.828927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 899/1783] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:51.833869 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f594247-e7db-4c86-8b70-bd8edd9deef2 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:51.834159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f594247-e7db-4c86-8b70-bd8edd9deef2 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:51.835869 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f594247-e7db-4c86-8b70-bd8edd9deef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:51.869013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-4f594247-e7db-4c86-8b70-bd8edd9deef2 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:51.873923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4f594247-e7db-4c86-8b70-bd8edd9deef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:51.888597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 900/1784] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:51.889950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f594247-e7db-4c86-8b70-bd8edd9deef2 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:51.907983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f594247-e7db-4c86-8b70-bd8edd9deef2 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:51.920430 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097981e-0b38-42d8-b7e2-67f36d5117f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:51.922297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097981e-0b38-42d8-b7e2-67f36d5117f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:51.922297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097981e-0b38-42d8-b7e2-67f36d5117f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:51.922522 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097981e-0b38-42d8-b7e2-67f36d5117f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:51.924793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097981e-0b38-42d8-b7e2-67f36d5117f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:51.927317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097981e-0b38-42d8-b7e2-67f36d5117f5 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:51.956223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 901/1785] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:51.957604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097981e-0b38-42d8-b7e2-67f36d5117f5 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:51.961491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f097981e-0b38-42d8-b7e2-67f36d5117f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:52.004961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17a2ce-cd57-4e8c-9c04-e761f889bf46 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:52.021182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c15d70-561a-4efe-8a5f-957cabf57e92 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be699d7507e04e23b70f098ba274330b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebb8624d726a42ce9b060b781cd2878b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:52.021830 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15d70-561a-4efe-8a5f-957cabf57e92 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:52.024940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15d70-561a-4efe-8a5f-957cabf57e92 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:52.025523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15d70-561a-4efe-8a5f-957cabf57e92 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:52.025960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c15d70-561a-4efe-8a5f-957cabf57e92 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:52.026491 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c15d70-561a-4efe-8a5f-957cabf57e92 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:52.036647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c15d70-561a-4efe-8a5f-957cabf57e92 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:52.093560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 885/1786] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:52.095626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c15d70-561a-4efe-8a5f-957cabf57e92 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:52.125419 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c15d70-561a-4efe-8a5f-957cabf57e92 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:52.139101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b418c61-8a13-433f-bffc-f553ee438d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:52.139905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b418c61-8a13-433f-bffc-f553ee438d7d admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:52.140314 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b418c61-8a13-433f-bffc-f553ee438d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:52.140698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b418c61-8a13-433f-bffc-f553ee438d7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:52.141757 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b418c61-8a13-433f-bffc-f553ee438d7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:52.142481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b418c61-8a13-433f-bffc-f553ee438d7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:52.142642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:52.150025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097981e-0b38-42d8-b7e2-67f36d5117f5 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:52.154949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b418c61-8a13-433f-bffc-f553ee438d7d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:52.157334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:52.165208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc78a3-9100-4f1e-90fc-8304689e1951 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:52.165998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc78a3-9100-4f1e-90fc-8304689e1951 service swift] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:52.166224 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc78a3-9100-4f1e-90fc-8304689e1951 service swift] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:52.167765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc78a3-9100-4f1e-90fc-8304689e1951 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:52.192322 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 886/1787] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:52.194277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc78a3-9100-4f1e-90fc-8304689e1951 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:52.195354 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b418c61-8a13-433f-bffc-f553ee438d7d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:52.198923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc78a3-9100-4f1e-90fc-8304689e1951 service swift] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:52.202566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4b418c61-8a13-433f-bffc-f553ee438d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:52.222591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 902/1788] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:07:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 21:07:52.225729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc78a3-9100-4f1e-90fc-8304689e1951 service swift] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:52.266951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc78a3-9100-4f1e-90fc-8304689e1951 service swift] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:52.298210 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f32e9-2901-4ed2-89ac-c88679360b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:52.299340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f32e9-2901-4ed2-89ac-c88679360b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:52.299751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f32e9-2901-4ed2-89ac-c88679360b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:52.300144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f32e9-2901-4ed2-89ac-c88679360b57 admin admin] PATH_INFO: `/v3/projects/3491f520fea74728986e6bf76f226127/users/21cabd27813c487b88a71612a2bbdbad/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:52.342236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f32e9-2901-4ed2-89ac-c88679360b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3491f520fea74728986e6bf76f226127, user_id=21cabd27813c487b88a71612a2bbdbad, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:52.352394 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f32e9-2901-4ed2-89ac-c88679360b57 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:52.389059 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 903/1789] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:52 2022] PUT /identity/v3/projects/3491f520fea74728986e6bf76f226127/users/21cabd27813c487b88a71612a2bbdbad/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:52.398011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f32e9-2901-4ed2-89ac-c88679360b57 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:52.418210 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b418c61-8a13-433f-bffc-f553ee438d7d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:52.644360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0180fb-31e6-4e93-abf9-bd013d89904c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:52.645024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0180fb-31e6-4e93-abf9-bd013d89904c service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:52.645320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0180fb-31e6-4e93-abf9-bd013d89904c service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:52.645591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0180fb-31e6-4e93-abf9-bd013d89904c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:52.652682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f32e9-2901-4ed2-89ac-c88679360b57 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:52.661326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3262a6-a21f-4701-9cc3-f52670db67cf tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be699d7507e04e23b70f098ba274330b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebb8624d726a42ce9b060b781cd2878b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:52.662026 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3262a6-a21f-4701-9cc3-f52670db67cf tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:52.662363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3262a6-a21f-4701-9cc3-f52670db67cf tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:52.664813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3262a6-a21f-4701-9cc3-f52670db67cf tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:52.667384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3262a6-a21f-4701-9cc3-f52670db67cf tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:52.674727 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3262a6-a21f-4701-9cc3-f52670db67cf tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:52.810367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 904/1790] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:52 2022] POST /identity/v3/projects => generated 355 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:52.812426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3262a6-a21f-4701-9cc3-f52670db67cf tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:52.905047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0180fb-31e6-4e93-abf9-bd013d89904c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:52.906544 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0180fb-31e6-4e93-abf9-bd013d89904c service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:52.982835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 887/1791] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:52.989320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3b299-4425-408d-9715-834ab6b702a5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:52.989827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3b299-4425-408d-9715-834ab6b702a5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:52.990126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3b299-4425-408d-9715-834ab6b702a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:53.065932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-76e3b299-4425-408d-9715-834ab6b702a5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:53.080752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-76e3b299-4425-408d-9715-834ab6b702a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:53.118517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 888/1792] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:53.120755 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3b299-4425-408d-9715-834ab6b702a5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:53.128268 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3262a6-a21f-4701-9cc3-f52670db67cf tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:53.151133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384d593-b0d0-42f8-bb70-39cf0a00c07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:53.152096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384d593-b0d0-42f8-bb70-39cf0a00c07a admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:53.152470 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384d593-b0d0-42f8-bb70-39cf0a00c07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:53.152748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384d593-b0d0-42f8-bb70-39cf0a00c07a admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:53.153765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384d593-b0d0-42f8-bb70-39cf0a00c07a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:53.182089 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384d593-b0d0-42f8-bb70-39cf0a00c07a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:53.303953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 905/1793] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:52 2022] POST /identity/v3/projects => generated 367 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:53.306792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209195c2-64a4-47dc-8548-a847eabf97cc None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:53.307079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209195c2-64a4-47dc-8548-a847eabf97cc None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:53.307353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209195c2-64a4-47dc-8548-a847eabf97cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:53.401611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:53.422028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-209195c2-64a4-47dc-8548-a847eabf97cc None None] MFA Rules not processed for user `95b17424a40b475480403eb9f4f3f88f`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:53.425147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-209195c2-64a4-47dc-8548-a847eabf97cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:53.427227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3b299-4425-408d-9715-834ab6b702a5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:53.544059 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:53.656158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 906/1794] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Aug 19 21:07:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:53.665367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209195c2-64a4-47dc-8548-a847eabf97cc None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:53.708166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209195c2-64a4-47dc-8548-a847eabf97cc None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:53.726941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79803f77-527f-4bb6-b148-d7a7d34dfde1 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be699d7507e04e23b70f098ba274330b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebb8624d726a42ce9b060b781cd2878b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:53.727597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79803f77-527f-4bb6-b148-d7a7d34dfde1 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:53.727883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79803f77-527f-4bb6-b148-d7a7d34dfde1 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:53.728165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79803f77-527f-4bb6-b148-d7a7d34dfde1 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:53.728843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79803f77-527f-4bb6-b148-d7a7d34dfde1 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:53.729154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79803f77-527f-4bb6-b148-d7a7d34dfde1 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:53.733751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafebed-6ffe-4523-997e-657d6bb33b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:53.734408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafebed-6ffe-4523-997e-657d6bb33b68 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:53.734690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafebed-6ffe-4523-997e-657d6bb33b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:53.734993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafebed-6ffe-4523-997e-657d6bb33b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:53.755224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79803f77-527f-4bb6-b148-d7a7d34dfde1 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:53.811671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 889/1795] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 693 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:53.813058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79803f77-527f-4bb6-b148-d7a7d34dfde1 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:53.971064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79803f77-527f-4bb6-b148-d7a7d34dfde1 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:53.984061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafebed-6ffe-4523-997e-657d6bb33b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:53.984361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb774f9b-d463-47b6-a3b1-31aa45a184a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:53.986040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafebed-6ffe-4523-997e-657d6bb33b68 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:53.986166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb774f9b-d463-47b6-a3b1-31aa45a184a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:53.986398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb774f9b-d463-47b6-a3b1-31aa45a184a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:53.986752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb774f9b-d463-47b6-a3b1-31aa45a184a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:53.987868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb774f9b-d463-47b6-a3b1-31aa45a184a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:53.990126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb774f9b-d463-47b6-a3b1-31aa45a184a4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:54.026285 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 890/1796] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:53 2022] POST /identity/v3/users => generated 284 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:54.027456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb774f9b-d463-47b6-a3b1-31aa45a184a4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:54.035915 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 907/1797] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:54.036837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafebed-6ffe-4523-997e-657d6bb33b68 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:54.043631 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb774f9b-d463-47b6-a3b1-31aa45a184a4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:54.048433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decc5da-d78a-4433-992d-38a3a9957122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:54.049133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decc5da-d78a-4433-992d-38a3a9957122 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:54.049472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decc5da-d78a-4433-992d-38a3a9957122 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:54.049804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decc5da-d78a-4433-992d-38a3a9957122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:54.072713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafebed-6ffe-4523-997e-657d6bb33b68 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:54.076514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decc5da-d78a-4433-992d-38a3a9957122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:54.082525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be699d7507e04e23b70f098ba274330b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebb8624d726a42ce9b060b781cd2878b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:54.082800 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decc5da-d78a-4433-992d-38a3a9957122 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:54.083377 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:54.083732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:54.084076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] PATH_INFO: `/v3/projects/147454d17f5a42099e2ab53417c8653f` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:54.085787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: Authorizing `identity:delete_project(project_id=147454d17f5a42099e2ab53417c8653f)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:54.090905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:54.119726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 891/1798] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:54.121676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decc5da-d78a-4433-992d-38a3a9957122 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:54.122990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9decc5da-d78a-4433-992d-38a3a9957122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:54.149306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decc5da-d78a-4433-992d-38a3a9957122 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:54.156734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:54.157802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:54.158155 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:54.159497 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] PATH_INFO: `/v3/projects/67aaca28d3a0459f99d1b3af71c29dd3` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:54.163368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=67aaca28d3a0459f99d1b3af71c29dd3)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:54.166903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:54.238384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147454d17f5a42099e2ab53417c8653f', 'request_id': 'req-d7f29a68-2fab-4825-91d6-c464eb0265f6'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.258909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147454d17f5a42099e2ab53417c8653f', 'request_id': 'req-d7f29a68-2fab-4825-91d6-c464eb0265f6'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.269830 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147454d17f5a42099e2ab53417c8653f', 'request_id': 'req-d7f29a68-2fab-4825-91d6-c464eb0265f6'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.299477 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] The token cache is being invalidate because project 147454d17f5a42099e2ab53417c8653f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:07:54.300041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.301467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.304342 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67aaca28d3a0459f99d1b3af71c29dd3', 'request_id': 'req-5e895d49-7f24-481a-a191-22b9867a6acf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.309607 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 908/1799] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:07:54 2022] DELETE /identity/v3/projects/147454d17f5a42099e2ab53417c8653f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:54.310299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:54.315482 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:54.329668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67aaca28d3a0459f99d1b3af71c29dd3', 'request_id': 'req-5e895d49-7f24-481a-a191-22b9867a6acf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.354385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67aaca28d3a0459f99d1b3af71c29dd3', 'request_id': 'req-5e895d49-7f24-481a-a191-22b9867a6acf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.356942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:54.387537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] The token cache is being invalidate because project 67aaca28d3a0459f99d1b3af71c29dd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:07:54.388230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.390152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.393848 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 892/1800] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:07:54 2022] DELETE /identity/v3/projects/67aaca28d3a0459f99d1b3af71c29dd3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:54.403610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:54.405075 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:54.607698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e895d49-7f24-481a-a191-22b9867a6acf admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:54.616393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:54.620302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:54.623069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:54.624534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] PATH_INFO: `/v3/users/d1134c8208ce406b812b7e9702117d12` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:54.625754 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f29a68-2fab-4825-91d6-c464eb0265f6 tempest-VolumeQuotaClassesTest-1712745191 tempest-VolumeQuotaClassesTest-1712745191-project-admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:54.630204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1134c8208ce406b812b7e9702117d12)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:54.636766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:54.651823 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a9734-8ca6-4755-bd1a-c658b0256af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:54.652564 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a9734-8ca6-4755-bd1a-c658b0256af6 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:54.652870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a9734-8ca6-4755-bd1a-c658b0256af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:54.653285 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a9734-8ca6-4755-bd1a-c658b0256af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:54.653802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a9734-8ca6-4755-bd1a-c658b0256af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:54.663468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a9734-8ca6-4755-bd1a-c658b0256af6 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:54.682378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:54.703806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 909/1801] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:54.707511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a9734-8ca6-4755-bd1a-c658b0256af6 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:54.713708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-fd1a9734-8ca6-4755-bd1a-c658b0256af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:54.754855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a9734-8ca6-4755-bd1a-c658b0256af6 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:54.781082 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392716d-f24a-4617-ba93-f0562721ed3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:54.781721 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392716d-f24a-4617-ba93-f0562721ed3f admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:54.782013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392716d-f24a-4617-ba93-f0562721ed3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:54.782295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392716d-f24a-4617-ba93-f0562721ed3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:54.783055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392716d-f24a-4617-ba93-f0562721ed3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:54.784812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392716d-f24a-4617-ba93-f0562721ed3f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:54.788859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1134c8208ce406b812b7e9702117d12'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.814723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 910/1802] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:54.820453 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392716d-f24a-4617-ba93-f0562721ed3f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:54.852307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1134c8208ce406b812b7e9702117d12'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.875625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1134c8208ce406b812b7e9702117d12'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.877438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1134c8208ce406b812b7e9702117d12'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.879123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1134c8208ce406b812b7e9702117d12'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:54.879462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392716d-f24a-4617-ba93-f0562721ed3f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:54.897031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f1485-89da-404d-9581-0c598abb10d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:54.898729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f1485-89da-404d-9581-0c598abb10d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:54.899053 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f1485-89da-404d-9581-0c598abb10d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:54.899604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f1485-89da-404d-9581-0c598abb10d2 admin admin] PATH_INFO: `/v3/projects/6adf26a59c7f462386123b2315f7743e/users/4b3a605df0f047c89337810004393307/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:54.916143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 893/1803] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:07:54 2022] DELETE /identity/v3/users/d1134c8208ce406b812b7e9702117d12 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:54.917052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:54.918498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:54.993043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f1485-89da-404d-9581-0c598abb10d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6adf26a59c7f462386123b2315f7743e, user_id=4b3a605df0f047c89337810004393307, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:55.000838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f1485-89da-404d-9581-0c598abb10d2 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:55.061548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 911/1804] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:54 2022] PUT /identity/v3/projects/6adf26a59c7f462386123b2315f7743e/users/4b3a605df0f047c89337810004393307/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:55.072856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11aa18-6522-455a-9181-66403f05f9ee None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:55.073202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11aa18-6522-455a-9181-66403f05f9ee None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:55.073458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11aa18-6522-455a-9181-66403f05f9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:55.086232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ba796-5ab8-4813-a6be-6cf28578f638 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:55.123839 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:55.184431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb20066-8d7f-42b0-9028-f60e87e3376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:55.185007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb20066-8d7f-42b0-9028-f60e87e3376e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:55.185342 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb20066-8d7f-42b0-9028-f60e87e3376e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:55.186072 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb20066-8d7f-42b0-9028-f60e87e3376e admin admin] PATH_INFO: `/v3/users/40006409ee7c47c587c071ff67949bda` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:55.187754 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb20066-8d7f-42b0-9028-f60e87e3376e admin admin] RBAC: Authorizing `identity:delete_user(user_id=40006409ee7c47c587c071ff67949bda)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:55.191247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb20066-8d7f-42b0-9028-f60e87e3376e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:55.228960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-1b11aa18-6522-455a-9181-66403f05f9ee None None] MFA Rules not processed for user `4b3a605df0f047c89337810004393307`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:55.244736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1b11aa18-6522-455a-9181-66403f05f9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:55.292976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fdb20066-8d7f-42b0-9028-f60e87e3376e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40006409ee7c47c587c071ff67949bda'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:55.312147 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fdb20066-8d7f-42b0-9028-f60e87e3376e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40006409ee7c47c587c071ff67949bda'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:55.331554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fdb20066-8d7f-42b0-9028-f60e87e3376e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40006409ee7c47c587c071ff67949bda'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:55.333512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fdb20066-8d7f-42b0-9028-f60e87e3376e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40006409ee7c47c587c071ff67949bda'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:55.335279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fdb20066-8d7f-42b0-9028-f60e87e3376e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40006409ee7c47c587c071ff67949bda'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:55.384146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 894/1805] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:07:54 2022] DELETE /identity/v3/users/40006409ee7c47c587c071ff67949bda => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:55.386922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b7a77-d1a3-45d9-9bc5-b242edcd99d3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:55.387216 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b7a77-d1a3-45d9-9bc5-b242edcd99d3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:55.387493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b7a77-d1a3-45d9-9bc5-b242edcd99d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:55.429020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a78b7a77-d1a3-45d9-9bc5-b242edcd99d3 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:55.432916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a78b7a77-d1a3-45d9-9bc5-b242edcd99d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:55.436485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 912/1806] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:07:55.437757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11aa18-6522-455a-9181-66403f05f9ee None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:55.439490 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1b11aa18-6522-455a-9181-66403f05f9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:55.455327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11aa18-6522-455a-9181-66403f05f9ee None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:55.539416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f343716-f42d-4e3e-8e06-acc121d71f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:55.540842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343716-f42d-4e3e-8e06-acc121d71f03 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:55.541349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343716-f42d-4e3e-8e06-acc121d71f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:55.542330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343716-f42d-4e3e-8e06-acc121d71f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:55.543489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f343716-f42d-4e3e-8e06-acc121d71f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:55.547094 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f343716-f42d-4e3e-8e06-acc121d71f03 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:55.591368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 895/1807] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:55.594785 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 913/1808] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:55 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:55.596378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b7a77-d1a3-45d9-9bc5-b242edcd99d3 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:55.620015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b7a77-d1a3-45d9-9bc5-b242edcd99d3 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:55.665457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f343716-f42d-4e3e-8e06-acc121d71f03 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:55.669576 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5f343716-f42d-4e3e-8e06-acc121d71f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:55.700743 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:55.745375 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f3d2d-8557-424f-9ec7-4b83e0848e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:55.746433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f3d2d-8557-424f-9ec7-4b83e0848e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:55.746983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f3d2d-8557-424f-9ec7-4b83e0848e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:55.747591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f3d2d-8557-424f-9ec7-4b83e0848e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:55.748959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f3d2d-8557-424f-9ec7-4b83e0848e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:55.753571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f3d2d-8557-424f-9ec7-4b83e0848e67 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:55.810303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 896/1809] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:55 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:55.815950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f3d2d-8557-424f-9ec7-4b83e0848e67 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:55.841092 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f3d2d-8557-424f-9ec7-4b83e0848e67 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:55.846644 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bc3ff-17af-45b5-8ae5-578ba3deef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:55.847169 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bc3ff-17af-45b5-8ae5-578ba3deef85 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:55.847459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bc3ff-17af-45b5-8ae5-578ba3deef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:55.847737 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bc3ff-17af-45b5-8ae5-578ba3deef85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:55.848433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bc3ff-17af-45b5-8ae5-578ba3deef85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:55.850345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bc3ff-17af-45b5-8ae5-578ba3deef85 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:55.866205 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 897/1810] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:55.871471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:55.876037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bc3ff-17af-45b5-8ae5-578ba3deef85 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:55.930080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bc3ff-17af-45b5-8ae5-578ba3deef85 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:55.930303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f343716-f42d-4e3e-8e06-acc121d71f03 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:55.935839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bde871-e685-4b5f-a9f0-0cd097f34e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:55.936648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bde871-e685-4b5f-a9f0-0cd097f34e17 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:55.936921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bde871-e685-4b5f-a9f0-0cd097f34e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:55.937384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bde871-e685-4b5f-a9f0-0cd097f34e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:55.947431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2474c-014a-4b11-84b7-2f3d9001d472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:55.948503 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2474c-014a-4b11-84b7-2f3d9001d472 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:55.949007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2474c-014a-4b11-84b7-2f3d9001d472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:55.949511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2474c-014a-4b11-84b7-2f3d9001d472 admin admin] PATH_INFO: `/v3/projects/e095260c141b4301b90d98c5d7844130/users/ff388127898a4234a2e5b3d066e8872a/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:55.969153 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bde871-e685-4b5f-a9f0-0cd097f34e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:55.972383 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bde871-e685-4b5f-a9f0-0cd097f34e17 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:55.987194 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2474c-014a-4b11-84b7-2f3d9001d472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e095260c141b4301b90d98c5d7844130, user_id=ff388127898a4234a2e5b3d066e8872a, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:55.989171 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 914/1811] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:07:55.991302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2474c-014a-4b11-84b7-2f3d9001d472 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:56.011164 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 898/1812] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:55 2022] PUT /identity/v3/projects/e095260c141b4301b90d98c5d7844130/users/ff388127898a4234a2e5b3d066e8872a/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:56.015252 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bde871-e685-4b5f-a9f0-0cd097f34e17 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:56.030449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bde871-e685-4b5f-a9f0-0cd097f34e17 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:56.205540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cea04-1fa3-4cca-86a3-cbe1fd431d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:56.206350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cea04-1fa3-4cca-86a3-cbe1fd431d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:56.206751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cea04-1fa3-4cca-86a3-cbe1fd431d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:56.207274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cea04-1fa3-4cca-86a3-cbe1fd431d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:56.208632 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cea04-1fa3-4cca-86a3-cbe1fd431d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:56.211683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cea04-1fa3-4cca-86a3-cbe1fd431d3c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:56.227228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 915/1813] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:56.231535 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2474c-014a-4b11-84b7-2f3d9001d472 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:56.251619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2474c-014a-4b11-84b7-2f3d9001d472 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:56.259706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c508d-5b2a-4651-99d9-a123ddade193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:56.260953 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c508d-5b2a-4651-99d9-a123ddade193 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:56.261293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c508d-5b2a-4651-99d9-a123ddade193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:56.261643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c508d-5b2a-4651-99d9-a123ddade193 admin admin] PATH_INFO: `/v3/projects/e095260c141b4301b90d98c5d7844130/users/ff388127898a4234a2e5b3d066e8872a/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:56.265803 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c508d-5b2a-4651-99d9-a123ddade193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e095260c141b4301b90d98c5d7844130, user_id=ff388127898a4234a2e5b3d066e8872a, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:56.270500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c508d-5b2a-4651-99d9-a123ddade193 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:56.290431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 899/1814] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:56 2022] PUT /identity/v3/projects/e095260c141b4301b90d98c5d7844130/users/ff388127898a4234a2e5b3d066e8872a/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:56.302960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24884e-55e6-4b92-a39a-e343c7223f1c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:56.303698 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24884e-55e6-4b92-a39a-e343c7223f1c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:56.304328 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24884e-55e6-4b92-a39a-e343c7223f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:56.358357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-3d24884e-55e6-4b92-a39a-e343c7223f1c None None] MFA Rules not processed for user `ff388127898a4234a2e5b3d066e8872a`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:56.361158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3d24884e-55e6-4b92-a39a-e343c7223f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:56.535393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 916/1815] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:56.550336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c508d-5b2a-4651-99d9-a123ddade193 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:56.552213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-694c508d-5b2a-4651-99d9-a123ddade193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:56.753801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c508d-5b2a-4651-99d9-a123ddade193 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:56.760590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56657981-8de2-426c-baa7-401ee60d03b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:56.762185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56657981-8de2-426c-baa7-401ee60d03b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:56.762646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56657981-8de2-426c-baa7-401ee60d03b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:56.763022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56657981-8de2-426c-baa7-401ee60d03b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:56.785034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56657981-8de2-426c-baa7-401ee60d03b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:56.787763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56657981-8de2-426c-baa7-401ee60d03b9 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:56.810553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 900/1816] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:07:57.775841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24884e-55e6-4b92-a39a-e343c7223f1c None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:57.778630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3d24884e-55e6-4b92-a39a-e343c7223f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:58.041047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24884e-55e6-4b92-a39a-e343c7223f1c None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:58.055717 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247710b-e42e-469c-9de6-41dce8c4d913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:58.057230 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247710b-e42e-469c-9de6-41dce8c4d913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:58.057870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247710b-e42e-469c-9de6-41dce8c4d913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:58.059098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247710b-e42e-469c-9de6-41dce8c4d913 admin admin] PATH_INFO: `/v3/projects/1ef3038d445c43eb869400c1d78caede` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:58.062411 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247710b-e42e-469c-9de6-41dce8c4d913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef3038d445c43eb869400c1d78caede)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:58.067821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247710b-e42e-469c-9de6-41dce8c4d913 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:58.110302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:58.281995 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8247710b-e42e-469c-9de6-41dce8c4d913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef3038d445c43eb869400c1d78caede', 'request_id': 'req-8247710b-e42e-469c-9de6-41dce8c4d913'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:58.307635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8247710b-e42e-469c-9de6-41dce8c4d913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef3038d445c43eb869400c1d78caede', 'request_id': 'req-8247710b-e42e-469c-9de6-41dce8c4d913'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:58.342706 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8247710b-e42e-469c-9de6-41dce8c4d913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef3038d445c43eb869400c1d78caede', 'request_id': 'req-8247710b-e42e-469c-9de6-41dce8c4d913'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:58.414765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8247710b-e42e-469c-9de6-41dce8c4d913 admin admin] The token cache is being invalidate because project 1ef3038d445c43eb869400c1d78caede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:07:58.416727 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8247710b-e42e-469c-9de6-41dce8c4d913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:58.419966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8247710b-e42e-469c-9de6-41dce8c4d913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:07:58.434876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 917/1817] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:07:57 2022] DELETE /identity/v3/projects/1ef3038d445c43eb869400c1d78caede => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:07:58.436307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58ca23-53fb-4081-84f4-af52de01e73d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:58.437174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58ca23-53fb-4081-84f4-af52de01e73d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:58.437174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58ca23-53fb-4081-84f4-af52de01e73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:58.525502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-cc58ca23-53fb-4081-84f4-af52de01e73d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:58.527466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-cc58ca23-53fb-4081-84f4-af52de01e73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:58.739183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 901/1818] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:58.744493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6947fe7-9477-4770-b3c0-2b3673d1f32c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:58.745019 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6947fe7-9477-4770-b3c0-2b3673d1f32c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:58.745390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6947fe7-9477-4770-b3c0-2b3673d1f32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:58.821410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-f6947fe7-9477-4770-b3c0-2b3673d1f32c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:58.823856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f6947fe7-9477-4770-b3c0-2b3673d1f32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:58.849520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 918/1819] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:07:58.855154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58ca23-53fb-4081-84f4-af52de01e73d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:58.874482 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58ca23-53fb-4081-84f4-af52de01e73d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:58.888889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1069d3-afd6-44ff-81e8-e2d01eba662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:58.891937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1069d3-afd6-44ff-81e8-e2d01eba662c admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:58.892849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1069d3-afd6-44ff-81e8-e2d01eba662c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:58.894401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1069d3-afd6-44ff-81e8-e2d01eba662c admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:58.897320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1069d3-afd6-44ff-81e8-e2d01eba662c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:07:58.897954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1069d3-afd6-44ff-81e8-e2d01eba662c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:58.904356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1069d3-afd6-44ff-81e8-e2d01eba662c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:58.944843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 902/1820] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:07:58.947490 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6947fe7-9477-4770-b3c0-2b3673d1f32c None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:58.963746 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6947fe7-9477-4770-b3c0-2b3673d1f32c None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:58.975585 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545989c6-f370-4639-8d99-0dfd2e01e816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:58.976299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545989c6-f370-4639-8d99-0dfd2e01e816 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:58.976589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545989c6-f370-4639-8d99-0dfd2e01e816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:58.976869 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545989c6-f370-4639-8d99-0dfd2e01e816 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:58.979009 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545989c6-f370-4639-8d99-0dfd2e01e816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:58.985904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545989c6-f370-4639-8d99-0dfd2e01e816 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:59.043223 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f72179-421f-4fc9-aa74-f742882223f8 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:59.043491 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f72179-421f-4fc9-aa74-f742882223f8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:59.043849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f72179-421f-4fc9-aa74-f742882223f8 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:59.045866 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 903/1821] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 21:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:07:59.094652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f3d52-b744-40cf-9ec0-d2e7b73ad70a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:59.095054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f3d52-b744-40cf-9ec0-d2e7b73ad70a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:59.095372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f3d52-b744-40cf-9ec0-d2e7b73ad70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:59.137165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 919/1822] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:07:58 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:07:59.139791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ee5f3d52-b744-40cf-9ec0-d2e7b73ad70a None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:07:59.142547 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545989c6-f370-4639-8d99-0dfd2e01e816 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:59.143445 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ee5f3d52-b744-40cf-9ec0-d2e7b73ad70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:07:59.166526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:07:59.477977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545989c6-f370-4639-8d99-0dfd2e01e816 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:59.484857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2a9cf-618b-440f-b437-24d8705df39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:59.485718 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2a9cf-618b-440f-b437-24d8705df39a admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:59.486205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2a9cf-618b-440f-b437-24d8705df39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:59.486654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2a9cf-618b-440f-b437-24d8705df39a admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:59.488001 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2a9cf-618b-440f-b437-24d8705df39a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:59.490462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2a9cf-618b-440f-b437-24d8705df39a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:59.547995 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 920/1823] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:07:59 2022] POST /identity/v3/users => generated 294 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:07:59.549214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2a9cf-618b-440f-b437-24d8705df39a admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:59.551694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 904/1824] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 19 21:07:59.574891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2a9cf-618b-440f-b437-24d8705df39a admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:59.622697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37168ad4-b36e-4ca5-8cbd-3b9a1c96e025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:59.624696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37168ad4-b36e-4ca5-8cbd-3b9a1c96e025 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:59.625723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37168ad4-b36e-4ca5-8cbd-3b9a1c96e025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:59.628022 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37168ad4-b36e-4ca5-8cbd-3b9a1c96e025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:59.628932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37168ad4-b36e-4ca5-8cbd-3b9a1c96e025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:59.635287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37168ad4-b36e-4ca5-8cbd-3b9a1c96e025 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:59.680559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 921/1825] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:59.687200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f3d52-b744-40cf-9ec0-d2e7b73ad70a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:59.733676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f3d52-b744-40cf-9ec0-d2e7b73ad70a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:59.772249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1171cba-c49b-48e6-b240-83d5b6f7c34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:59.781414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1171cba-c49b-48e6-b240-83d5b6f7c34c admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:59.782123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1171cba-c49b-48e6-b240-83d5b6f7c34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:59.782601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1171cba-c49b-48e6-b240-83d5b6f7c34c admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:59.788478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1171cba-c49b-48e6-b240-83d5b6f7c34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:59.807594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1171cba-c49b-48e6-b240-83d5b6f7c34c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:59.923325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 905/1826] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:07:59.925388 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37168ad4-b36e-4ca5-8cbd-3b9a1c96e025 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:59.943766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37168ad4-b36e-4ca5-8cbd-3b9a1c96e025 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:07:59.968217 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd80fe6-9c59-4d8d-b280-6755daedb3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:07:59.969299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd80fe6-9c59-4d8d-b280-6755daedb3df admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:07:59.969794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd80fe6-9c59-4d8d-b280-6755daedb3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:07:59.970297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd80fe6-9c59-4d8d-b280-6755daedb3df admin admin] PATH_INFO: `/v3/projects/7d7bf1d2446648a5817d98089cc29a7d/users/eb58555098344badb53f04ead86edb1e/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:07:59.988700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd80fe6-9c59-4d8d-b280-6755daedb3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7bf1d2446648a5817d98089cc29a7d, user_id=eb58555098344badb53f04ead86edb1e, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:07:59.992758 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd80fe6-9c59-4d8d-b280-6755daedb3df admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:07:59.994053 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1171cba-c49b-48e6-b240-83d5b6f7c34c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:07:59.997823 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d1171cba-c49b-48e6-b240-83d5b6f7c34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:00.023424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 922/1827] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:07:59 2022] PUT /identity/v3/projects/7d7bf1d2446648a5817d98089cc29a7d/users/eb58555098344badb53f04ead86edb1e/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:00.025557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62737c46-3fa5-45e2-ab9e-b605107e8db4 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:00.026053 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62737c46-3fa5-45e2-ab9e-b605107e8db4 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:00.026454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62737c46-3fa5-45e2-ab9e-b605107e8db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:00.110676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1171cba-c49b-48e6-b240-83d5b6f7c34c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:00.124524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-62737c46-3fa5-45e2-ab9e-b605107e8db4 None None] MFA Rules not processed for user `eb58555098344badb53f04ead86edb1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:00.129164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-62737c46-3fa5-45e2-ab9e-b605107e8db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:00.167540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:00.423638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 923/1828] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:00.429890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da790d-003a-4447-b982-49f87d5ee012 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:00.430241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da790d-003a-4447-b982-49f87d5ee012 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:00.430863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da790d-003a-4447-b982-49f87d5ee012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:00.447100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970ce67-7a8b-4552-ba49-a80b8a1f0bfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:00.447778 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970ce67-7a8b-4552-ba49-a80b8a1f0bfc service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:00.448065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970ce67-7a8b-4552-ba49-a80b8a1f0bfc service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:00.448371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970ce67-7a8b-4552-ba49-a80b8a1f0bfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:00.492204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970ce67-7a8b-4552-ba49-a80b8a1f0bfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:00.493905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970ce67-7a8b-4552-ba49-a80b8a1f0bfc service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:00.539430 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-94da790d-003a-4447-b982-49f87d5ee012 None None] MFA Rules not processed for user `21cabd27813c487b88a71612a2bbdbad`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:00.542483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 906/1829] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:07:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:00.549091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970ce67-7a8b-4552-ba49-a80b8a1f0bfc service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:00.550129 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-94da790d-003a-4447-b982-49f87d5ee012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:00.832063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970ce67-7a8b-4552-ba49-a80b8a1f0bfc service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:00.833816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 924/1830] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:00.841189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da790d-003a-4447-b982-49f87d5ee012 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:00.844508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-94da790d-003a-4447-b982-49f87d5ee012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:00.852637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885caea1-fdec-4163-9586-bf5e6b9acd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:00.853278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885caea1-fdec-4163-9586-bf5e6b9acd54 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:00.853565 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885caea1-fdec-4163-9586-bf5e6b9acd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:00.856014 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885caea1-fdec-4163-9586-bf5e6b9acd54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:00.857440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885caea1-fdec-4163-9586-bf5e6b9acd54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:00.860844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885caea1-fdec-4163-9586-bf5e6b9acd54 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:00.882480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da790d-003a-4447-b982-49f87d5ee012 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:00.916778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f6727-371d-4b60-bec2-64596a2e1705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:00.923428 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f6727-371d-4b60-bec2-64596a2e1705 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:00.924034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f6727-371d-4b60-bec2-64596a2e1705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:00.926033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f6727-371d-4b60-bec2-64596a2e1705 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:00.927621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f6727-371d-4b60-bec2-64596a2e1705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:00.934486 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f6727-371d-4b60-bec2-64596a2e1705 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:00.954829 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 907/1831] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:00 2022] POST /identity/v3/projects => generated 387 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:00.963087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885caea1-fdec-4163-9586-bf5e6b9acd54 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:00.971788 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:01.093446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 925/1832] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:00 2022] POST /identity/v3/projects => generated 401 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:01.094387 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f6727-371d-4b60-bec2-64596a2e1705 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:01.205348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885caea1-fdec-4163-9586-bf5e6b9acd54 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:01.355109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfcbfd-665c-4edf-961a-4a67d3759eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:01.356074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfcbfd-665c-4edf-961a-4a67d3759eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:01.356407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfcbfd-665c-4edf-961a-4a67d3759eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:01.356703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfcbfd-665c-4edf-961a-4a67d3759eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:01.357419 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfcbfd-665c-4edf-961a-4a67d3759eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:01.360996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfcbfd-665c-4edf-961a-4a67d3759eb1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:01.382903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f6727-371d-4b60-bec2-64596a2e1705 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:01.394116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ac938-f1b0-42f8-ae13-c5c041a11723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:01.395505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ac938-f1b0-42f8-ae13-c5c041a11723 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:01.396111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ac938-f1b0-42f8-ae13-c5c041a11723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:01.397118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ac938-f1b0-42f8-ae13-c5c041a11723 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:01.399000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ac938-f1b0-42f8-ae13-c5c041a11723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:01.420795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ac938-f1b0-42f8-ae13-c5c041a11723 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:01.425597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 908/1833] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:00 2022] POST /identity/v3/users => generated 300 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:01.430844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfcbfd-665c-4edf-961a-4a67d3759eb1 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:01.478728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfcbfd-665c-4edf-961a-4a67d3759eb1 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:01.492954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31e97b-1fbf-4645-b01b-252adbbb38e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:01.492954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e97b-1fbf-4645-b01b-252adbbb38e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:01.492954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e97b-1fbf-4645-b01b-252adbbb38e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:01.492954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e97b-1fbf-4645-b01b-252adbbb38e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:01.493445 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31e97b-1fbf-4645-b01b-252adbbb38e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:01.495316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31e97b-1fbf-4645-b01b-252adbbb38e8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:01.500304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 926/1834] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:01 2022] POST /identity/v3/users => generated 307 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:01.503125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ac938-f1b0-42f8-ae13-c5c041a11723 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:01.534827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 909/1835] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:01.539920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31e97b-1fbf-4645-b01b-252adbbb38e8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:01.548742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ac938-f1b0-42f8-ae13-c5c041a11723 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:01.563398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31e97b-1fbf-4645-b01b-252adbbb38e8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:01.574548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89371961-2099-42b6-bee0-3d584d6f7f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:01.575804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89371961-2099-42b6-bee0-3d584d6f7f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:01.576426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89371961-2099-42b6-bee0-3d584d6f7f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:01.576881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89371961-2099-42b6-bee0-3d584d6f7f1d admin admin] PATH_INFO: `/v3/projects/d28defba5eb54174bffa0bee974d5c1a/users/0bcf4aaa79bf4bfab701508bfdb38869/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:01.589050 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180266-0398-468f-a87e-54f4f142dc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:01.592395 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180266-0398-468f-a87e-54f4f142dc5b admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:01.592933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180266-0398-468f-a87e-54f4f142dc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:01.593403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180266-0398-468f-a87e-54f4f142dc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:01.594651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d180266-0398-468f-a87e-54f4f142dc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:01.597755 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d180266-0398-468f-a87e-54f4f142dc5b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:01.613937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89371961-2099-42b6-bee0-3d584d6f7f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28defba5eb54174bffa0bee974d5c1a, user_id=0bcf4aaa79bf4bfab701508bfdb38869, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:01.615537 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:01.627069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89371961-2099-42b6-bee0-3d584d6f7f1d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:01.649238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 927/1836] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:01.652603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180266-0398-468f-a87e-54f4f142dc5b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:01.665350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 910/1837] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:01 2022] PUT /identity/v3/projects/d28defba5eb54174bffa0bee974d5c1a/users/0bcf4aaa79bf4bfab701508bfdb38869/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:01.667490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89371961-2099-42b6-bee0-3d584d6f7f1d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:01.714936 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180266-0398-468f-a87e-54f4f142dc5b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:01.830955 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89371961-2099-42b6-bee0-3d584d6f7f1d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:01.846136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd4768-474f-4c16-b65d-37fecbb4d4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:01.847852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd4768-474f-4c16-b65d-37fecbb4d4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:01.848406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd4768-474f-4c16-b65d-37fecbb4d4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:01.848946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd4768-474f-4c16-b65d-37fecbb4d4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:01.849751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd4768-474f-4c16-b65d-37fecbb4d4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:01.852598 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd4768-474f-4c16-b65d-37fecbb4d4e2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:01.869387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:01.883561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 911/1838] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:01.898934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd4768-474f-4c16-b65d-37fecbb4d4e2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:01.907757 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e7fd4768-474f-4c16-b65d-37fecbb4d4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:01.935398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd4768-474f-4c16-b65d-37fecbb4d4e2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:01.952496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:01.953304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:01.953700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:01.954082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] PATH_INFO: `/v3/projects/41a4621b41c441749adb93db4a09c25a` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:01.955529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a4621b41c441749adb93db4a09c25a)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:01.957703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:02.035805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6365436-46aa-4bef-b80d-fbf6dd41ee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:02.041314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6365436-46aa-4bef-b80d-fbf6dd41ee95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:02.044387 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6365436-46aa-4bef-b80d-fbf6dd41ee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:02.045527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6365436-46aa-4bef-b80d-fbf6dd41ee95 admin admin] PATH_INFO: `/v3/projects/3c04cc84c6d845e49a8a9240c4aff0a2/users/7ffc34a86b6e4dceae1d6bf4405152a6/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:02.097685 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6365436-46aa-4bef-b80d-fbf6dd41ee95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c04cc84c6d845e49a8a9240c4aff0a2, user_id=7ffc34a86b6e4dceae1d6bf4405152a6, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:02.108062 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6365436-46aa-4bef-b80d-fbf6dd41ee95 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:02.148232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 928/1839] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:01 2022] PUT /identity/v3/projects/3c04cc84c6d845e49a8a9240c4aff0a2/users/7ffc34a86b6e4dceae1d6bf4405152a6/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:02.149590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6365436-46aa-4bef-b80d-fbf6dd41ee95 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:02.151379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a4621b41c441749adb93db4a09c25a', 'request_id': 'req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:02.158479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f6365436-46aa-4bef-b80d-fbf6dd41ee95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:02.199105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a4621b41c441749adb93db4a09c25a', 'request_id': 'req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:02.225353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a4621b41c441749adb93db4a09c25a', 'request_id': 'req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:02.258340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] The token cache is being invalidate because project 41a4621b41c441749adb93db4a09c25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:02.258865 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:02.259755 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:02.264784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 912/1840] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:01 2022] DELETE /identity/v3/projects/41a4621b41c441749adb93db4a09c25a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:02.264784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:02.267424 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:02.427884 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6365436-46aa-4bef-b80d-fbf6dd41ee95 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:02.462634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eb036-28bd-47b0-a760-3fcd6dec6a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:02.464557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eb036-28bd-47b0-a760-3fcd6dec6a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:02.469930 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eb036-28bd-47b0-a760-3fcd6dec6a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:02.487755 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eb036-28bd-47b0-a760-3fcd6dec6a59 admin admin] PATH_INFO: `/v3/users/4b3a605df0f047c89337810004393307` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:02.490796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0eb036-28bd-47b0-a760-3fcd6dec6a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3a605df0f047c89337810004393307)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:02.493156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9a3b5-80ee-444c-8ae9-931cdd21ebd8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:02.495447 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0eb036-28bd-47b0-a760-3fcd6dec6a59 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:02.508411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4ac25-0661-41a4-9658-41fb126562f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:02.509211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4ac25-0661-41a4-9658-41fb126562f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:02.509570 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4ac25-0661-41a4-9658-41fb126562f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:02.509923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4ac25-0661-41a4-9658-41fb126562f6 admin admin] PATH_INFO: `/v3/projects/d28defba5eb54174bffa0bee974d5c1a/users/0bcf4aaa79bf4bfab701508bfdb38869/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:02.512410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4ac25-0661-41a4-9658-41fb126562f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28defba5eb54174bffa0bee974d5c1a, user_id=0bcf4aaa79bf4bfab701508bfdb38869, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:02.528656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4ac25-0661-41a4-9658-41fb126562f6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:02.571888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 913/1841] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:02 2022] PUT /identity/v3/projects/d28defba5eb54174bffa0bee974d5c1a/users/0bcf4aaa79bf4bfab701508bfdb38869/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:02.571888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4ac25-0661-41a4-9658-41fb126562f6 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:02.589452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a1c4ac25-0661-41a4-9658-41fb126562f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:02.744052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-3e0eb036-28bd-47b0-a760-3fcd6dec6a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3a605df0f047c89337810004393307'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:02.774298 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-3e0eb036-28bd-47b0-a760-3fcd6dec6a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3a605df0f047c89337810004393307'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:02.781243 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-3e0eb036-28bd-47b0-a760-3fcd6dec6a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3a605df0f047c89337810004393307'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:02.784078 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-3e0eb036-28bd-47b0-a760-3fcd6dec6a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3a605df0f047c89337810004393307'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:02.831795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-3e0eb036-28bd-47b0-a760-3fcd6dec6a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3a605df0f047c89337810004393307'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:02.858448 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4ac25-0661-41a4-9658-41fb126562f6 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:02.867707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b01b1-a116-4d74-9736-4bf31bdf6eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:02.868335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:02.868732 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b01b1-a116-4d74-9736-4bf31bdf6eda admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:02.869200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b01b1-a116-4d74-9736-4bf31bdf6eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:02.869652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b01b1-a116-4d74-9736-4bf31bdf6eda admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:02.870433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b01b1-a116-4d74-9736-4bf31bdf6eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:02.873149 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b01b1-a116-4d74-9736-4bf31bdf6eda admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:02.901434 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 914/1843] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:02.902522 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b01b1-a116-4d74-9736-4bf31bdf6eda admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:02.905379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1c2b01b1-a116-4d74-9736-4bf31bdf6eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:02.931512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b01b1-a116-4d74-9736-4bf31bdf6eda admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:02.931860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 929/1843] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:02 2022] DELETE /identity/v3/users/4b3a605df0f047c89337810004393307 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:02.944330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ff43-036c-487c-bf9c-b73424f41ba9 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:02.947376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ff43-036c-487c-bf9c-b73424f41ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:02.948319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ff43-036c-487c-bf9c-b73424f41ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:02.960866 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:03.070903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-c3d1ff43-036c-487c-bf9c-b73424f41ba9 None None] MFA Rules not processed for user `0bcf4aaa79bf4bfab701508bfdb38869`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:03.083414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c3d1ff43-036c-487c-bf9c-b73424f41ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:03.121805 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:03.122863 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:03.123257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:03.123658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] PATH_INFO: `/v3/users/be699d7507e04e23b70f098ba274330b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:03.126977 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be699d7507e04e23b70f098ba274330b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:03.129845 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:03.287898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 930/1844] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:03.293500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e81f81-e359-4b26-9410-33a06e8e71d6 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:03.293781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e81f81-e359-4b26-9410-33a06e8e71d6 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:03.294917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e81f81-e359-4b26-9410-33a06e8e71d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:03.325368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be699d7507e04e23b70f098ba274330b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:03.353621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-54e81f81-e359-4b26-9410-33a06e8e71d6 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:03.355031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-54e81f81-e359-4b26-9410-33a06e8e71d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:03.379540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 931/1845] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:03.379540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e81f81-e359-4b26-9410-33a06e8e71d6 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:03.379540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-54e81f81-e359-4b26-9410-33a06e8e71d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:03.384018 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be699d7507e04e23b70f098ba274330b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:03.409448 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be699d7507e04e23b70f098ba274330b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:03.409746 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e81f81-e359-4b26-9410-33a06e8e71d6 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:03.411967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be699d7507e04e23b70f098ba274330b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:03.414630 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be699d7507e04e23b70f098ba274330b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:03.422423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc31ad6-4e6d-41ac-b6ac-5b30517bfa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:03.423506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31ad6-4e6d-41ac-b6ac-5b30517bfa9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:03.423849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31ad6-4e6d-41ac-b6ac-5b30517bfa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:03.424160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31ad6-4e6d-41ac-b6ac-5b30517bfa9f admin admin] PATH_INFO: `/v3/projects/3c04cc84c6d845e49a8a9240c4aff0a2/users/7ffc34a86b6e4dceae1d6bf4405152a6/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:03.430649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc31ad6-4e6d-41ac-b6ac-5b30517bfa9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c04cc84c6d845e49a8a9240c4aff0a2, user_id=7ffc34a86b6e4dceae1d6bf4405152a6, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:03.433679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc31ad6-4e6d-41ac-b6ac-5b30517bfa9f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:03.464227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 932/1846] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:03 2022] PUT /identity/v3/projects/3c04cc84c6d845e49a8a9240c4aff0a2/users/7ffc34a86b6e4dceae1d6bf4405152a6/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:03.471011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc31ad6-4e6d-41ac-b6ac-5b30517bfa9f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:03.471516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 915/1847] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:02 2022] DELETE /identity/v3/users/be699d7507e04e23b70f098ba274330b => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:03.476767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1cc31ad6-4e6d-41ac-b6ac-5b30517bfa9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:03.504607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:03.511365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:03.653570 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc31ad6-4e6d-41ac-b6ac-5b30517bfa9f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:03.682170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86d790-14fc-4a52-8c44-ab9e79a2b5c1 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:03.695072 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756decf2-61a2-4cea-817f-5ea356e06773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:03.696239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756decf2-61a2-4cea-817f-5ea356e06773 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:03.697001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756decf2-61a2-4cea-817f-5ea356e06773 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:03.697503 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756decf2-61a2-4cea-817f-5ea356e06773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:03.701669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-756decf2-61a2-4cea-817f-5ea356e06773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:03.875251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:03.955840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3f093-ed87-45dc-b92c-1f78d2d1ca86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:03.956604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3f093-ed87-45dc-b92c-1f78d2d1ca86 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:03.956769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3f093-ed87-45dc-b92c-1f78d2d1ca86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:03.957053 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3f093-ed87-45dc-b92c-1f78d2d1ca86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:03.975095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756decf2-61a2-4cea-817f-5ea356e06773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:03.978015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-77a3f093-ed87-45dc-b92c-1f78d2d1ca86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:03.978254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756decf2-61a2-4cea-817f-5ea356e06773 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:04.029961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 916/1848] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:04.184432 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:04.346484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3f093-ed87-45dc-b92c-1f78d2d1ca86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:04.350407 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3f093-ed87-45dc-b92c-1f78d2d1ca86 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:04.387666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 933/1849] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 923 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:04.656132 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756decf2-61a2-4cea-817f-5ea356e06773 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:04.664947 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-756decf2-61a2-4cea-817f-5ea356e06773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:04.717361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756decf2-61a2-4cea-817f-5ea356e06773 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:04.741487 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:04.743262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:04.744990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:04.745741 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] PATH_INFO: `/v3/users/eb58555098344badb53f04ead86edb1e` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:04.753752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb58555098344badb53f04ead86edb1e)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:04.759192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:04.878855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb58555098344badb53f04ead86edb1e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:04.956708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb58555098344badb53f04ead86edb1e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:04.983909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb58555098344badb53f04ead86edb1e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:04.984936 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb58555098344badb53f04ead86edb1e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:04.986135 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb58555098344badb53f04ead86edb1e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:05.026227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 917/1850] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:04 2022] DELETE /identity/v3/users/eb58555098344badb53f04ead86edb1e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:05.029506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88768402-fd6b-4e43-8abf-36c4cf897173 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:05.030649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88768402-fd6b-4e43-8abf-36c4cf897173 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:05.031510 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88768402-fd6b-4e43-8abf-36c4cf897173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:05.116849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-88768402-fd6b-4e43-8abf-36c4cf897173 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:05.119273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-88768402-fd6b-4e43-8abf-36c4cf897173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:05.276126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 934/1851] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:05.359237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:05.363782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:05.624942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88768402-fd6b-4e43-8abf-36c4cf897173 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:05.626776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-88768402-fd6b-4e43-8abf-36c4cf897173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:05.642849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88768402-fd6b-4e43-8abf-36c4cf897173 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:05.655349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:05.656288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:05.657996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9662958-df1a-4089-b81a-0421427566b5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:05.658590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:05.659060 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a admin admin] PATH_INFO: `/v3/projects/ebb8624d726a42ce9b060b781cd2878b` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:05.661577 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb8624d726a42ce9b060b781cd2878b)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:05.665161 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:05.681371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4f4ec-f616-4e66-bee3-e6d832e44caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:05.682503 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4f4ec-f616-4e66-bee3-e6d832e44caf service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:05.683357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4f4ec-f616-4e66-bee3-e6d832e44caf service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:05.683892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4f4ec-f616-4e66-bee3-e6d832e44caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:05.729591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4f4ec-f616-4e66-bee3-e6d832e44caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:05.732571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4f4ec-f616-4e66-bee3-e6d832e44caf service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:05.785284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 918/1852] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:08:05.859479 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb0bb4-e2e4-4c0c-a79e-18854c979cb3 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:05.860702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb0bb4-e2e4-4c0c-a79e-18854c979cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:05.862723 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb0bb4-e2e4-4c0c-a79e-18854c979cb3 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:05.863913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb8624d726a42ce9b060b781cd2878b', 'request_id': 'req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:05.867074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 919/1853] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 21:08:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:08:05.878383 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb8624d726a42ce9b060b781cd2878b', 'request_id': 'req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:05.908285 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb8624d726a42ce9b060b781cd2878b', 'request_id': 'req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:05.928861 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a admin admin] The token cache is being invalidate because project ebb8624d726a42ce9b060b781cd2878b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:05.929306 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:05.930102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0c0c5f55-8b7d-4255-bc65-bb8d440ad81a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:05.936831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 935/1854] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:05 2022] DELETE /identity/v3/projects/ebb8624d726a42ce9b060b781cd2878b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:05.939259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929b435-96b5-4e8a-b140-d83e0e911c69 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:05.940091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929b435-96b5-4e8a-b140-d83e0e911c69 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:05.940266 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929b435-96b5-4e8a-b140-d83e0e911c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:05.975438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368225-9332-4b0e-90df-b7673ec5ac53 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:05.975872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368225-9332-4b0e-90df-b7673ec5ac53 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:05.976319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368225-9332-4b0e-90df-b7673ec5ac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:06.011329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2929b435-96b5-4e8a-b140-d83e0e911c69 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:06.012020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2929b435-96b5-4e8a-b140-d83e0e911c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:06.036174 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-cd368225-9332-4b0e-90df-b7673ec5ac53 None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:06.041219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cd368225-9332-4b0e-90df-b7673ec5ac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:06.243283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:06.354785 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:06.375341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 936/1855] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:06.413813 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 920/1856] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:06.415977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffe2e8-9229-4be0-a123-14dfcbf46c43 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:06.416410 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffe2e8-9229-4be0-a123-14dfcbf46c43 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:06.416767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffe2e8-9229-4be0-a123-14dfcbf46c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:06.484957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ffffe2e8-9229-4be0-a123-14dfcbf46c43 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:06.489054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ffffe2e8-9229-4be0-a123-14dfcbf46c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:06.531096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 937/1857] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:06.532439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929b435-96b5-4e8a-b140-d83e0e911c69 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:06.553745 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffe2e8-9229-4be0-a123-14dfcbf46c43 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:06.555149 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929b435-96b5-4e8a-b140-d83e0e911c69 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:06.556205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ffffe2e8-9229-4be0-a123-14dfcbf46c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:06.562037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780766b-2df8-4be9-99bb-9fa3dba8495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:06.563127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780766b-2df8-4be9-99bb-9fa3dba8495f admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:06.563513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780766b-2df8-4be9-99bb-9fa3dba8495f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:06.563889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780766b-2df8-4be9-99bb-9fa3dba8495f admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:06.564708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780766b-2df8-4be9-99bb-9fa3dba8495f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:08:06.565081 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780766b-2df8-4be9-99bb-9fa3dba8495f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:06.566941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780766b-2df8-4be9-99bb-9fa3dba8495f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:06.594508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffe2e8-9229-4be0-a123-14dfcbf46c43 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:06.603206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 921/1858] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:08:06.609057 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780766b-2df8-4be9-99bb-9fa3dba8495f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:06.622141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d2e3c-5039-43c1-a2ba-b5bc582deb2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:06.624248 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d2e3c-5039-43c1-a2ba-b5bc582deb2d service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:06.625131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d2e3c-5039-43c1-a2ba-b5bc582deb2d service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:06.625893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d2e3c-5039-43c1-a2ba-b5bc582deb2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:06.650302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780766b-2df8-4be9-99bb-9fa3dba8495f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:06.656509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d2e3c-5039-43c1-a2ba-b5bc582deb2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:06.661190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d2e3c-5039-43c1-a2ba-b5bc582deb2d service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:06.689628 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa6ffe-0529-487f-8a19-b54b7a518844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:06.690658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa6ffe-0529-487f-8a19-b54b7a518844 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:06.691207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa6ffe-0529-487f-8a19-b54b7a518844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:06.691713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa6ffe-0529-487f-8a19-b54b7a518844 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:06.692850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa6ffe-0529-487f-8a19-b54b7a518844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:06.697930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa6ffe-0529-487f-8a19-b54b7a518844 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:06.703980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 938/1859] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:06.826440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 922/1860] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:06 2022] POST /identity/v3/projects => generated 371 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:06.827453 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d2e3c-5039-43c1-a2ba-b5bc582deb2d service nova] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:06.887903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d2e3c-5039-43c1-a2ba-b5bc582deb2d service nova] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:07.002986 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9f831-a1ca-404d-8d38-907644c28dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:07.003909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9f831-a1ca-404d-8d38-907644c28dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:07.004533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9f831-a1ca-404d-8d38-907644c28dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:07.004957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9f831-a1ca-404d-8d38-907644c28dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:07.005761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9f831-a1ca-404d-8d38-907644c28dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:07.009953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9f831-a1ca-404d-8d38-907644c28dd8 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:07.096097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa6ffe-0529-487f-8a19-b54b7a518844 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:07.103013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 939/1861] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:06 2022] POST /identity/v3/users => generated 286 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:08:07.115107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa6ffe-0529-487f-8a19-b54b7a518844 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:07.123051 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341428d6-fb97-44e1-8189-425a8791b172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:07.123982 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341428d6-fb97-44e1-8189-425a8791b172 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:07.124400 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341428d6-fb97-44e1-8189-425a8791b172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:07.124695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341428d6-fb97-44e1-8189-425a8791b172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:07.125480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341428d6-fb97-44e1-8189-425a8791b172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:07.127659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341428d6-fb97-44e1-8189-425a8791b172 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:07.145402 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 923/1862] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:08:07.150798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9f831-a1ca-404d-8d38-907644c28dd8 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:07.222782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9f831-a1ca-404d-8d38-907644c28dd8 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:07.237595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a7e0d-594f-42b0-99e9-fce1665589f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:07.238757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a7e0d-594f-42b0-99e9-fce1665589f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:07.239307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a7e0d-594f-42b0-99e9-fce1665589f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:07.239997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a7e0d-594f-42b0-99e9-fce1665589f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:07.241808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a7e0d-594f-42b0-99e9-fce1665589f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:07.246630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a7e0d-594f-42b0-99e9-fce1665589f4 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:07.289470 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341428d6-fb97-44e1-8189-425a8791b172 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:07.290602 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 940/1863] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:07.292075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1425c8-655e-4211-a778-1cc145633f87 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:07.292377 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1425c8-655e-4211-a778-1cc145633f87 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:07.302835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1425c8-655e-4211-a778-1cc145633f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:07.315817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341428d6-fb97-44e1-8189-425a8791b172 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:07.336483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22007c-834f-430b-b819-d962172d74c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:07.336483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22007c-834f-430b-b819-d962172d74c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:07.340968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22007c-834f-430b-b819-d962172d74c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:07.341896 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22007c-834f-430b-b819-d962172d74c9 admin admin] PATH_INFO: `/v3/projects/3e9e50c4294641f38b63c3c421ec1abc/users/c8eed745175b4c02af199f7655ea0231/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:07.373321 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-6d1425c8-655e-4211-a778-1cc145633f87 None None] MFA Rules not processed for user `7ffc34a86b6e4dceae1d6bf4405152a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:07.374809 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6d1425c8-655e-4211-a778-1cc145633f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:07.381772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22007c-834f-430b-b819-d962172d74c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9e50c4294641f38b63c3c421ec1abc, user_id=c8eed745175b4c02af199f7655ea0231, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:07.391041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22007c-834f-430b-b819-d962172d74c9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:07.434510 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 924/1864] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:07 2022] PUT /identity/v3/projects/3e9e50c4294641f38b63c3c421ec1abc/users/c8eed745175b4c02af199f7655ea0231/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:08:07.436773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550ccd7-8e1e-4a2b-acbb-1f257f00e98b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:07.437187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550ccd7-8e1e-4a2b-acbb-1f257f00e98b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:07.437539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550ccd7-8e1e-4a2b-acbb-1f257f00e98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:07.481765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-0550ccd7-8e1e-4a2b-acbb-1f257f00e98b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:07.484300 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0550ccd7-8e1e-4a2b-acbb-1f257f00e98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:07.602070 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 941/1865] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:07 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:07.677222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 925/1866] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:07.710511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1425c8-655e-4211-a778-1cc145633f87 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:07.713202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6d1425c8-655e-4211-a778-1cc145633f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:07.792459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:07.864077 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1425c8-655e-4211-a778-1cc145633f87 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:07.925370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550ccd7-8e1e-4a2b-acbb-1f257f00e98b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:07.927070 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0550ccd7-8e1e-4a2b-acbb-1f257f00e98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:07.942073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550ccd7-8e1e-4a2b-acbb-1f257f00e98b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:07.961041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:07.961640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:07.961944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:07.962227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] PATH_INFO: `/v3/projects/7d7bf1d2446648a5817d98089cc29a7d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:07.964038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d7bf1d2446648a5817d98089cc29a7d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:07.965894 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:07.987421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee078e-8303-4775-b220-19b392512b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:07.989679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee078e-8303-4775-b220-19b392512b36 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:07.990302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee078e-8303-4775-b220-19b392512b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:07.991324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee078e-8303-4775-b220-19b392512b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:08.014865 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee078e-8303-4775-b220-19b392512b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:08.018631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee078e-8303-4775-b220-19b392512b36 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:08.047620 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d7bf1d2446648a5817d98089cc29a7d', 'request_id': 'req-7c87467e-c201-42b1-94d6-667d2011eccb'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.050662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 942/1867] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:08.052374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee078e-8303-4775-b220-19b392512b36 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:08.055773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d7bf1d2446648a5817d98089cc29a7d', 'request_id': 'req-7c87467e-c201-42b1-94d6-667d2011eccb'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.056922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-75ee078e-8303-4775-b220-19b392512b36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:08.067590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d7bf1d2446648a5817d98089cc29a7d', 'request_id': 'req-7c87467e-c201-42b1-94d6-667d2011eccb'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.083704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] The token cache is being invalidate because project 7d7bf1d2446648a5817d98089cc29a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:08.084112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.085807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.090851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 926/1868] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:07 2022] DELETE /identity/v3/projects/7d7bf1d2446648a5817d98089cc29a7d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:08.091897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:08.093682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:08.109378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee078e-8303-4775-b220-19b392512b36 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:08.116015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:08.251108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:08.253215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:08.253671 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:08.254169 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87467e-c201-42b1-94d6-667d2011eccb admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:08.254471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] PATH_INFO: `/v3/projects/6adf26a59c7f462386123b2315f7743e` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:08.257367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6adf26a59c7f462386123b2315f7743e)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:08.263226 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:08.268109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e31da0-f187-48cb-9276-0df2e9a926d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:08.269350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e31da0-f187-48cb-9276-0df2e9a926d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:08.269821 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e31da0-f187-48cb-9276-0df2e9a926d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:08.270362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e31da0-f187-48cb-9276-0df2e9a926d8 admin admin] PATH_INFO: `/v3/users/0bcf4aaa79bf4bfab701508bfdb38869` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:08.274229 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e31da0-f187-48cb-9276-0df2e9a926d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bcf4aaa79bf4bfab701508bfdb38869)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:08.281079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e31da0-f187-48cb-9276-0df2e9a926d8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:08.377172 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6adf26a59c7f462386123b2315f7743e', 'request_id': 'req-af70ebe8-d20b-44c9-b14e-657ee804591b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.400985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6adf26a59c7f462386123b2315f7743e', 'request_id': 'req-af70ebe8-d20b-44c9-b14e-657ee804591b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.424463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6adf26a59c7f462386123b2315f7743e', 'request_id': 'req-af70ebe8-d20b-44c9-b14e-657ee804591b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.442006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a1e31da0-f187-48cb-9276-0df2e9a926d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bcf4aaa79bf4bfab701508bfdb38869'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.451306 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] The token cache is being invalidate because project 6adf26a59c7f462386123b2315f7743e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:08.451506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.452986 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.456493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 943/1869] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:08 2022] DELETE /identity/v3/projects/6adf26a59c7f462386123b2315f7743e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:08.464029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:08.466366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:08.471225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a1e31da0-f187-48cb-9276-0df2e9a926d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bcf4aaa79bf4bfab701508bfdb38869'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.487680 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a1e31da0-f187-48cb-9276-0df2e9a926d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bcf4aaa79bf4bfab701508bfdb38869'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.489717 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a1e31da0-f187-48cb-9276-0df2e9a926d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bcf4aaa79bf4bfab701508bfdb38869'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.491871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a1e31da0-f187-48cb-9276-0df2e9a926d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bcf4aaa79bf4bfab701508bfdb38869'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.511036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:08.523151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 927/1870] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:08 2022] DELETE /identity/v3/users/0bcf4aaa79bf4bfab701508bfdb38869 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:08.601892 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70ebe8-d20b-44c9-b14e-657ee804591b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:08.738480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9d3e1-1226-4ee6-bdbb-d4b8edcb72df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:08.742318 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9d3e1-1226-4ee6-bdbb-d4b8edcb72df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:08.743249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9d3e1-1226-4ee6-bdbb-d4b8edcb72df admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:08.744018 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9d3e1-1226-4ee6-bdbb-d4b8edcb72df admin admin] PATH_INFO: `/v3/users/ff388127898a4234a2e5b3d066e8872a` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:08.746609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9d3e1-1226-4ee6-bdbb-d4b8edcb72df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff388127898a4234a2e5b3d066e8872a)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:08.750950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9d3e1-1226-4ee6-bdbb-d4b8edcb72df admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:08.869781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-80d9d3e1-1226-4ee6-bdbb-d4b8edcb72df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff388127898a4234a2e5b3d066e8872a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.887849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-80d9d3e1-1226-4ee6-bdbb-d4b8edcb72df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff388127898a4234a2e5b3d066e8872a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.890499 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-80d9d3e1-1226-4ee6-bdbb-d4b8edcb72df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff388127898a4234a2e5b3d066e8872a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.892586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-80d9d3e1-1226-4ee6-bdbb-d4b8edcb72df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff388127898a4234a2e5b3d066e8872a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.926530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-80d9d3e1-1226-4ee6-bdbb-d4b8edcb72df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff388127898a4234a2e5b3d066e8872a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:08.964366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 944/1871] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:08 2022] DELETE /identity/v3/users/ff388127898a4234a2e5b3d066e8872a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:08:09.309636 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1677290-1747-49cd-acda-7c8ef4df3989 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:09.311429 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1677290-1747-49cd-acda-7c8ef4df3989 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:09.312005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1677290-1747-49cd-acda-7c8ef4df3989 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:09.315898 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 928/1872] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 21:08:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:08:09.339838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e706248-cb10-4b14-ad51-8b07774e1ffb None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:09.340524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e706248-cb10-4b14-ad51-8b07774e1ffb None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:09.341043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e706248-cb10-4b14-ad51-8b07774e1ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:09.390186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7e706248-cb10-4b14-ad51-8b07774e1ffb None None] MFA Rules not processed for user `be0a8d40d21048afa4ce94706e3625c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:09.396126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7e706248-cb10-4b14-ad51-8b07774e1ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:09.519415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:09.614669 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 945/1873] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:08:09.635009 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1677290-1747-49cd-acda-7c8ef4df3989 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:09.639265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a1677290-1747-49cd-acda-7c8ef4df3989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:09.666611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1677290-1747-49cd-acda-7c8ef4df3989 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:09.676038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30aca03-c626-4956-ae5f-2dec48fb0616 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:09.676806 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aca03-c626-4956-ae5f-2dec48fb0616 service placement] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:09.677157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aca03-c626-4956-ae5f-2dec48fb0616 service placement] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:09.677663 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aca03-c626-4956-ae5f-2dec48fb0616 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:09.690895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30aca03-c626-4956-ae5f-2dec48fb0616 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:09.695093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30aca03-c626-4956-ae5f-2dec48fb0616 service placement] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:09.745269 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 929/1874] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:10.171280 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e706248-cb10-4b14-ad51-8b07774e1ffb None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:10.174606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7e706248-cb10-4b14-ad51-8b07774e1ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:10.340312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e706248-cb10-4b14-ad51-8b07774e1ffb None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:10.348305 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71340e2-2253-438a-90a1-477101e2906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:10.349257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71340e2-2253-438a-90a1-477101e2906e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:10.349603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71340e2-2253-438a-90a1-477101e2906e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:10.350695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71340e2-2253-438a-90a1-477101e2906e admin admin] PATH_INFO: `/v3/projects/d28defba5eb54174bffa0bee974d5c1a` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:10.352408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71340e2-2253-438a-90a1-477101e2906e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d28defba5eb54174bffa0bee974d5c1a)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:10.354924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71340e2-2253-438a-90a1-477101e2906e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:10.360086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30aca03-c626-4956-ae5f-2dec48fb0616 service placement] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:10.366820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d30aca03-c626-4956-ae5f-2dec48fb0616 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:10.430426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e71340e2-2253-438a-90a1-477101e2906e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd28defba5eb54174bffa0bee974d5c1a', 'request_id': 'req-e71340e2-2253-438a-90a1-477101e2906e'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:10.443101 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e71340e2-2253-438a-90a1-477101e2906e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd28defba5eb54174bffa0bee974d5c1a', 'request_id': 'req-e71340e2-2253-438a-90a1-477101e2906e'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:10.456582 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30aca03-c626-4956-ae5f-2dec48fb0616 service placement] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:10.479465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e71340e2-2253-438a-90a1-477101e2906e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd28defba5eb54174bffa0bee974d5c1a', 'request_id': 'req-e71340e2-2253-438a-90a1-477101e2906e'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:10.493580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e71340e2-2253-438a-90a1-477101e2906e admin admin] The token cache is being invalidate because project d28defba5eb54174bffa0bee974d5c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:10.493976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e71340e2-2253-438a-90a1-477101e2906e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:10.503964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e71340e2-2253-438a-90a1-477101e2906e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:10.513275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 946/1875] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:10 2022] DELETE /identity/v3/projects/d28defba5eb54174bffa0bee974d5c1a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:10.520300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a9156-18fd-4d30-8ff5-cc63d014b364 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:10.522183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a9156-18fd-4d30-8ff5-cc63d014b364 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:10.523554 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a9156-18fd-4d30-8ff5-cc63d014b364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:10.596193 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-9d5a9156-18fd-4d30-8ff5-cc63d014b364 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:10.596691 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39606d-663f-47de-91b7-e88e70bedf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:10.597900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39606d-663f-47de-91b7-e88e70bedf87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:10.598350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39606d-663f-47de-91b7-e88e70bedf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:10.598921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9d5a9156-18fd-4d30-8ff5-cc63d014b364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:10.604003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39606d-663f-47de-91b7-e88e70bedf87 admin admin] PATH_INFO: `/v3/projects/e095260c141b4301b90d98c5d7844130` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:10.609064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39606d-663f-47de-91b7-e88e70bedf87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e095260c141b4301b90d98c5d7844130)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:10.611953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 947/1876] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:08:10.618229 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39606d-663f-47de-91b7-e88e70bedf87 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:10.650938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdace9-6642-4ca5-8819-d38460bd3c50 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:10.654288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdace9-6642-4ca5-8819-d38460bd3c50 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:10.657092 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdace9-6642-4ca5-8819-d38460bd3c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:10.689734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:10.706124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-47cdace9-6642-4ca5-8819-d38460bd3c50 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:10.710955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-47cdace9-6642-4ca5-8819-d38460bd3c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:10.723886 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 948/1877] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:10.728702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdace9-6642-4ca5-8819-d38460bd3c50 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:10.779824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdace9-6642-4ca5-8819-d38460bd3c50 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:10.812998 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f39606d-663f-47de-91b7-e88e70bedf87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e095260c141b4301b90d98c5d7844130', 'request_id': 'req-2f39606d-663f-47de-91b7-e88e70bedf87'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:10.823576 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f39606d-663f-47de-91b7-e88e70bedf87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e095260c141b4301b90d98c5d7844130', 'request_id': 'req-2f39606d-663f-47de-91b7-e88e70bedf87'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:10.837395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f39606d-663f-47de-91b7-e88e70bedf87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e095260c141b4301b90d98c5d7844130', 'request_id': 'req-2f39606d-663f-47de-91b7-e88e70bedf87'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:10.867538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f39606d-663f-47de-91b7-e88e70bedf87 admin admin] The token cache is being invalidate because project e095260c141b4301b90d98c5d7844130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:10.869122 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f39606d-663f-47de-91b7-e88e70bedf87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:10.871490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f39606d-663f-47de-91b7-e88e70bedf87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:10.874849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 930/1878] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:10 2022] DELETE /identity/v3/projects/e095260c141b4301b90d98c5d7844130 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:10.878451 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd0b4-5317-4c60-8e31-fbd6d9f54d10 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:10.878809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd0b4-5317-4c60-8e31-fbd6d9f54d10 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:10.879099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd0b4-5317-4c60-8e31-fbd6d9f54d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:10.921897 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:10.934663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158723bb-c36b-4830-9b89-94594911bcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:10.935358 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158723bb-c36b-4830-9b89-94594911bcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:10.935666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158723bb-c36b-4830-9b89-94594911bcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:10.935958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158723bb-c36b-4830-9b89-94594911bcc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:10.938219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158723bb-c36b-4830-9b89-94594911bcc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:08:10.939820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158723bb-c36b-4830-9b89-94594911bcc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:10.942296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158723bb-c36b-4830-9b89-94594911bcc0 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:10.983365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 949/1879] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:08:10.985103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e88dd1-694f-4671-9cfc-fdb619de30dd None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:10.986355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e88dd1-694f-4671-9cfc-fdb619de30dd None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:10.986907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e88dd1-694f-4671-9cfc-fdb619de30dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:11.001985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-89ddd0b4-5317-4c60-8e31-fbd6d9f54d10 None None] MFA Rules not processed for user `c8eed745175b4c02af199f7655ea0231`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:11.006902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-89ddd0b4-5317-4c60-8e31-fbd6d9f54d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:11.013404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-82e88dd1-694f-4671-9cfc-fdb619de30dd None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:11.015876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-82e88dd1-694f-4671-9cfc-fdb619de30dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:11.030363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 950/1880] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:11.033044 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e88dd1-694f-4671-9cfc-fdb619de30dd None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:11.048632 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-82e88dd1-694f-4671-9cfc-fdb619de30dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:11.073507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e88dd1-694f-4671-9cfc-fdb619de30dd None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:11.088816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:11.089756 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:11.090252 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:11.090840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] PATH_INFO: `/v3/users/21cabd27813c487b88a71612a2bbdbad` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:11.093701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21cabd27813c487b88a71612a2bbdbad)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:11.096782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:11.210962 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 931/1881] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:11.213100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd0b4-5317-4c60-8e31-fbd6d9f54d10 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:11.216704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-89ddd0b4-5317-4c60-8e31-fbd6d9f54d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:11.259954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd0b4-5317-4c60-8e31-fbd6d9f54d10 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:11.272048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec4b08-b464-4c73-91e4-bec7b82813fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:11.273062 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec4b08-b464-4c73-91e4-bec7b82813fe admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:11.273565 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec4b08-b464-4c73-91e4-bec7b82813fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:11.274048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec4b08-b464-4c73-91e4-bec7b82813fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:11.275209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec4b08-b464-4c73-91e4-bec7b82813fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:11.280780 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec4b08-b464-4c73-91e4-bec7b82813fe admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:11.296349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21cabd27813c487b88a71612a2bbdbad'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:11.314260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21cabd27813c487b88a71612a2bbdbad'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:11.315888 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21cabd27813c487b88a71612a2bbdbad'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:11.317462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21cabd27813c487b88a71612a2bbdbad'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:11.349224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 932/1882] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:11 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:11.356532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1d48e-adbf-4b20-92f0-c2c9eaf5b9a9 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:11.357196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1d48e-adbf-4b20-92f0-c2c9eaf5b9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:11.357966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1d48e-adbf-4b20-92f0-c2c9eaf5b9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:11.363427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21cabd27813c487b88a71612a2bbdbad'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:11.388542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 951/1883] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:11 2022] DELETE /identity/v3/users/21cabd27813c487b88a71612a2bbdbad => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:11.390994 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:11.393116 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:11.415346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5eb1d48e-adbf-4b20-92f0-c2c9eaf5b9a9 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:11.417602 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5eb1d48e-adbf-4b20-92f0-c2c9eaf5b9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:11.493840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966289ec-4b9a-4f5a-b2a6-56ee5908d926 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:11.510706 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8f728-ef22-481f-a27d-cb143b62a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:11.513626 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f728-ef22-481f-a27d-cb143b62a9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:11.514141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f728-ef22-481f-a27d-cb143b62a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:11.514634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f728-ef22-481f-a27d-cb143b62a9f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:11.515884 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8f728-ef22-481f-a27d-cb143b62a9f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:11.528273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8f728-ef22-481f-a27d-cb143b62a9f0 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:11.587061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 933/1884] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:11.590212 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1d48e-adbf-4b20-92f0-c2c9eaf5b9a9 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:11.596330 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5eb1d48e-adbf-4b20-92f0-c2c9eaf5b9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:11.637637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1d48e-adbf-4b20-92f0-c2c9eaf5b9a9 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:11.654140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9ca8c-976f-4531-a907-50c2ba4ea665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:11.654909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9ca8c-976f-4531-a907-50c2ba4ea665 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:11.655208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9ca8c-976f-4531-a907-50c2ba4ea665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:11.655594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9ca8c-976f-4531-a907-50c2ba4ea665 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:11.656278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9ca8c-976f-4531-a907-50c2ba4ea665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:11.659331 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9ca8c-976f-4531-a907-50c2ba4ea665 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:11.685543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 952/1885] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:11 2022] POST /identity/v3/projects => generated 373 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:11.685543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8f728-ef22-481f-a27d-cb143b62a9f0 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:11.685862 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:11.701895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 934/1886] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:11 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:11.702997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9ca8c-976f-4531-a907-50c2ba4ea665 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:11.737189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9ca8c-976f-4531-a907-50c2ba4ea665 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:11.826140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:11.846141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb0961-73b1-42c5-8d6d-1d1a0c2107f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:11.847317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb0961-73b1-42c5-8d6d-1d1a0c2107f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:11.847836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb0961-73b1-42c5-8d6d-1d1a0c2107f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:11.848347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb0961-73b1-42c5-8d6d-1d1a0c2107f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:11.850378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb0961-73b1-42c5-8d6d-1d1a0c2107f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:11.855570 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb0961-73b1-42c5-8d6d-1d1a0c2107f4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:11.862135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8f728-ef22-481f-a27d-cb143b62a9f0 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:11.869048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe009c-9d3a-4314-8725-5b6d462d81c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:11.870161 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe009c-9d3a-4314-8725-5b6d462d81c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:11.870559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe009c-9d3a-4314-8725-5b6d462d81c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:11.870980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe009c-9d3a-4314-8725-5b6d462d81c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:11.871987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe009c-9d3a-4314-8725-5b6d462d81c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:08:11.872404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe009c-9d3a-4314-8725-5b6d462d81c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:11.875515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe009c-9d3a-4314-8725-5b6d462d81c3 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:11.907040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 953/1887] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:08:11.907040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe009c-9d3a-4314-8725-5b6d462d81c3 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:11.921590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 935/1888] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:11 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:11.929480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb0961-73b1-42c5-8d6d-1d1a0c2107f4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:11.931229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe009c-9d3a-4314-8725-5b6d462d81c3 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:11.943239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a88f17-3bb2-4cea-a8b9-48c4f00185a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:11.946364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a88f17-3bb2-4cea-a8b9-48c4f00185a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:11.947265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a88f17-3bb2-4cea-a8b9-48c4f00185a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:11.948191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a88f17-3bb2-4cea-a8b9-48c4f00185a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:11.950018 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a88f17-3bb2-4cea-a8b9-48c4f00185a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:11.953204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb0961-73b1-42c5-8d6d-1d1a0c2107f4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:11.954015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a88f17-3bb2-4cea-a8b9-48c4f00185a4 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:11.965635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f566a2-a7dd-4331-a812-3785b6c82a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:11.967436 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f566a2-a7dd-4331-a812-3785b6c82a6d admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:11.968417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f566a2-a7dd-4331-a812-3785b6c82a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:11.968720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f566a2-a7dd-4331-a812-3785b6c82a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:11.970049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f566a2-a7dd-4331-a812-3785b6c82a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:11.974864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f566a2-a7dd-4331-a812-3785b6c82a6d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:12.008426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 954/1889] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:12.011117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a88f17-3bb2-4cea-a8b9-48c4f00185a4 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:12.037867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a88f17-3bb2-4cea-a8b9-48c4f00185a4 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:12.048726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4b447-6a2a-4282-a2c2-557eecd559e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:12.049877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4b447-6a2a-4282-a2c2-557eecd559e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:12.050591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4b447-6a2a-4282-a2c2-557eecd559e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:12.051233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4b447-6a2a-4282-a2c2-557eecd559e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:12.052290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4b447-6a2a-4282-a2c2-557eecd559e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:12.057506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4b447-6a2a-4282-a2c2-557eecd559e4 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:12.066263 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 936/1890] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:11 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:12.070466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f566a2-a7dd-4331-a812-3785b6c82a6d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:12.079663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 955/1891] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:12.084896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4b447-6a2a-4282-a2c2-557eecd559e4 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:12.100999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4b447-6a2a-4282-a2c2-557eecd559e4 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:12.275490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f566a2-a7dd-4331-a812-3785b6c82a6d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:12.282283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43807475-00bc-4610-8f3f-a9cbc15fc75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:12.283027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43807475-00bc-4610-8f3f-a9cbc15fc75f admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:12.283420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43807475-00bc-4610-8f3f-a9cbc15fc75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:12.283666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43807475-00bc-4610-8f3f-a9cbc15fc75f admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:12.284358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43807475-00bc-4610-8f3f-a9cbc15fc75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:12.286459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43807475-00bc-4610-8f3f-a9cbc15fc75f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:12.309965 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 937/1892] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:12.310971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43807475-00bc-4610-8f3f-a9cbc15fc75f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:12.338994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43807475-00bc-4610-8f3f-a9cbc15fc75f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:12.354623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b181391-4b31-4a36-a59e-47c78f0fa8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:12.355192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b181391-4b31-4a36-a59e-47c78f0fa8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:12.355470 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b181391-4b31-4a36-a59e-47c78f0fa8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:12.355753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b181391-4b31-4a36-a59e-47c78f0fa8c6 admin admin] PATH_INFO: `/v3/projects/3d678693e1ee4635be237a7faa3fafb1/users/ae5e4a0fa5044537856129960a8a44de/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:12.380601 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b1c4f-aa05-40f8-9fbd-2c0add10a52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:12.383354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b1c4f-aa05-40f8-9fbd-2c0add10a52d admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:12.384205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b1c4f-aa05-40f8-9fbd-2c0add10a52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:12.385349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b1c4f-aa05-40f8-9fbd-2c0add10a52d admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:12.387121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b1c4f-aa05-40f8-9fbd-2c0add10a52d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:12.387672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b181391-4b31-4a36-a59e-47c78f0fa8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d678693e1ee4635be237a7faa3fafb1, user_id=ae5e4a0fa5044537856129960a8a44de, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:12.390459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b181391-4b31-4a36-a59e-47c78f0fa8c6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:12.391751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b1c4f-aa05-40f8-9fbd-2c0add10a52d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:12.419558 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 938/1893] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:12 2022] PUT /identity/v3/projects/3d678693e1ee4635be237a7faa3fafb1/users/ae5e4a0fa5044537856129960a8a44de/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:12.422276 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b181391-4b31-4a36-a59e-47c78f0fa8c6 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:12.425346 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0b181391-4b31-4a36-a59e-47c78f0fa8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:12.431076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 956/1894] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:12 2022] POST /identity/v3/users => generated 293 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:12.431076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b1c4f-aa05-40f8-9fbd-2c0add10a52d admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:12.458589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b1c4f-aa05-40f8-9fbd-2c0add10a52d admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:12.516653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:12.555316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b181391-4b31-4a36-a59e-47c78f0fa8c6 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:12.560598 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:12.561270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:12.561558 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:12.561859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] PATH_INFO: `/v3/projects/3491f520fea74728986e6bf76f226127` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:12.563293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3491f520fea74728986e6bf76f226127)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:12.565337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:12.593447 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e12bf1-61ff-4c6d-b151-16035c348d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:12.594485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e12bf1-61ff-4c6d-b151-16035c348d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:12.594819 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e12bf1-61ff-4c6d-b151-16035c348d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:12.595111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e12bf1-61ff-4c6d-b151-16035c348d84 admin admin] PATH_INFO: `/v3/projects/de7d2d6dc9994976adb96d1736a84783/users/580691728ad34d039ebe8776c655f0a2/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:12.617343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e12bf1-61ff-4c6d-b151-16035c348d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7d2d6dc9994976adb96d1736a84783, user_id=580691728ad34d039ebe8776c655f0a2, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:12.620276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e12bf1-61ff-4c6d-b151-16035c348d84 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:12.636532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3491f520fea74728986e6bf76f226127', 'request_id': 'req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:12.639815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 957/1895] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:12 2022] PUT /identity/v3/projects/de7d2d6dc9994976adb96d1736a84783/users/580691728ad34d039ebe8776c655f0a2/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:12.641666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e12bf1-61ff-4c6d-b151-16035c348d84 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:12.658573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3491f520fea74728986e6bf76f226127', 'request_id': 'req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:12.675756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3491f520fea74728986e6bf76f226127', 'request_id': 'req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:12.706160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] The token cache is being invalidate because project 3491f520fea74728986e6bf76f226127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:12.706670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:12.707900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:12.713039 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 939/1896] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:12 2022] DELETE /identity/v3/projects/3491f520fea74728986e6bf76f226127 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:12.715151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:12.718975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:12.723802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:12.816293 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e12bf1-61ff-4c6d-b151-16035c348d84 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:12.828272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5c5fb-9477-4514-9a33-76426cef6b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:12.830185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5c5fb-9477-4514-9a33-76426cef6b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:12.830965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5c5fb-9477-4514-9a33-76426cef6b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:12.831765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5c5fb-9477-4514-9a33-76426cef6b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:12.833219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5c5fb-9477-4514-9a33-76426cef6b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:12.837277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5c5fb-9477-4514-9a33-76426cef6b58 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:12.861819 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 958/1897] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:12.864679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd1c7-5a83-4931-ad48-b12b008cfa71 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:12.865923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd1c7-5a83-4931-ad48-b12b008cfa71 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:12.866626 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd1c7-5a83-4931-ad48-b12b008cfa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:12.923882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d87eb6-2c22-4b54-90da-ebc3b9f6e02f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:12.945038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-29abd1c7-5a83-4931-ad48-b12b008cfa71 None None] MFA Rules not processed for user `580691728ad34d039ebe8776c655f0a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:12.947348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-29abd1c7-5a83-4931-ad48-b12b008cfa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:12.949567 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30d5a1-d74c-4981-b435-dbb59958f875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:12.950673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30d5a1-d74c-4981-b435-dbb59958f875 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:12.951199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30d5a1-d74c-4981-b435-dbb59958f875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:12.951678 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30d5a1-d74c-4981-b435-dbb59958f875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:12.952957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30d5a1-d74c-4981-b435-dbb59958f875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:12.957109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30d5a1-d74c-4981-b435-dbb59958f875 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:12.991431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 940/1898] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:12.992763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30d5a1-d74c-4981-b435-dbb59958f875 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:12.995352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ae30d5a1-d74c-4981-b435-dbb59958f875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:13.015289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30d5a1-d74c-4981-b435-dbb59958f875 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:13.024167 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:13.025271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:13.025871 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:13.026367 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] PATH_INFO: `/v3/users/7ffc34a86b6e4dceae1d6bf4405152a6` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:13.028247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ffc34a86b6e4dceae1d6bf4405152a6)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:13.033037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:13.143630 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ffc34a86b6e4dceae1d6bf4405152a6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:13.159467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:13.171201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ffc34a86b6e4dceae1d6bf4405152a6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:13.183041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 959/1899] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:13.183041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd1c7-5a83-4931-ad48-b12b008cfa71 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:13.192262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-29abd1c7-5a83-4931-ad48-b12b008cfa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:13.202943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ffc34a86b6e4dceae1d6bf4405152a6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:13.203766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ffc34a86b6e4dceae1d6bf4405152a6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:13.206578 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ffc34a86b6e4dceae1d6bf4405152a6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:13.239885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd1c7-5a83-4931-ad48-b12b008cfa71 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:13.246395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 941/1900] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:12 2022] DELETE /identity/v3/users/7ffc34a86b6e4dceae1d6bf4405152a6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:13.248333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:13.261130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:13.354370 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe468e-7ea6-4659-ab51-abc3cdb3c912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:13.355964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe468e-7ea6-4659-ab51-abc3cdb3c912 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:13.356759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe468e-7ea6-4659-ab51-abc3cdb3c912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:13.357654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe468e-7ea6-4659-ab51-abc3cdb3c912 admin admin] PATH_INFO: `/v3/projects/3d678693e1ee4635be237a7faa3fafb1/users/ae5e4a0fa5044537856129960a8a44de/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:13.364832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe468e-7ea6-4659-ab51-abc3cdb3c912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d678693e1ee4635be237a7faa3fafb1, user_id=ae5e4a0fa5044537856129960a8a44de, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:13.372389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe468e-7ea6-4659-ab51-abc3cdb3c912 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:13.401844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8743f-cf05-4239-a154-dd5b2caa363a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:13.413278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 960/1901] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:13 2022] PUT /identity/v3/projects/3d678693e1ee4635be237a7faa3fafb1/users/ae5e4a0fa5044537856129960a8a44de/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:13.414654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe468e-7ea6-4659-ab51-abc3cdb3c912 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:13.421514 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a7fe468e-7ea6-4659-ab51-abc3cdb3c912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:13.497620 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b42c6-60dd-4a1c-bb3c-cb636bcc572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:13.498487 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b42c6-60dd-4a1c-bb3c-cb636bcc572b admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:13.499351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b42c6-60dd-4a1c-bb3c-cb636bcc572b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:13.499962 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b42c6-60dd-4a1c-bb3c-cb636bcc572b admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:13.501664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b42c6-60dd-4a1c-bb3c-cb636bcc572b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:13.505701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b42c6-60dd-4a1c-bb3c-cb636bcc572b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:13.530578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:13.553676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 942/1902] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:13.555539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b42c6-60dd-4a1c-bb3c-cb636bcc572b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:13.557003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe468e-7ea6-4659-ab51-abc3cdb3c912 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:13.564020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da1071-875a-40b6-80a0-16be4ec7f0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:13.565581 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1071-875a-40b6-80a0-16be4ec7f0ee admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:13.566209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1071-875a-40b6-80a0-16be4ec7f0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:13.566782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1071-875a-40b6-80a0-16be4ec7f0ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:13.567697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da1071-875a-40b6-80a0-16be4ec7f0ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:13.571846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da1071-875a-40b6-80a0-16be4ec7f0ee admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:13.582571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b42c6-60dd-4a1c-bb3c-cb636bcc572b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:13.592511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf8c62-82f8-4960-b152-f54ddf8349d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:13.594073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf8c62-82f8-4960-b152-f54ddf8349d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:13.594575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf8c62-82f8-4960-b152-f54ddf8349d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:13.595140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf8c62-82f8-4960-b152-f54ddf8349d0 admin admin] PATH_INFO: `/v3/projects/7360ef205568422d8abfeb5408efdb79/users/e686731b6c8b4f958c32e0a3fa161b74/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:13.618085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 961/1903] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:13 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:13.625051 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da1071-875a-40b6-80a0-16be4ec7f0ee admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:13.630203 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf8c62-82f8-4960-b152-f54ddf8349d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7360ef205568422d8abfeb5408efdb79, user_id=e686731b6c8b4f958c32e0a3fa161b74, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:13.636231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf8c62-82f8-4960-b152-f54ddf8349d0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:13.670879 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 943/1904] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:13 2022] PUT /identity/v3/projects/7360ef205568422d8abfeb5408efdb79/users/e686731b6c8b4f958c32e0a3fa161b74/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:13.685464 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e70e6-14d2-4184-906e-73b4d1c1c928 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:13.685954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e70e6-14d2-4184-906e-73b4d1c1c928 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:13.686432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e70e6-14d2-4184-906e-73b4d1c1c928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:13.767111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-144e70e6-14d2-4184-906e-73b4d1c1c928 None None] MFA Rules not processed for user `e686731b6c8b4f958c32e0a3fa161b74`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:13.770166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-144e70e6-14d2-4184-906e-73b4d1c1c928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:13.807451 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da1071-875a-40b6-80a0-16be4ec7f0ee admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:13.869561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:13.919766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 944/1905] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:13.919766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e70e6-14d2-4184-906e-73b4d1c1c928 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:13.924456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-144e70e6-14d2-4184-906e-73b4d1c1c928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:13.962044 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7766dc-ff45-491c-bbde-256d108a7664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:13.963244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7766dc-ff45-491c-bbde-256d108a7664 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:13.963724 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7766dc-ff45-491c-bbde-256d108a7664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:13.964341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7766dc-ff45-491c-bbde-256d108a7664 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:13.965301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7766dc-ff45-491c-bbde-256d108a7664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:13.969857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7766dc-ff45-491c-bbde-256d108a7664 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:14.019873 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 962/1906] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:13 2022] POST /identity/v3/users => generated 294 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:14.021458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7766dc-ff45-491c-bbde-256d108a7664 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:14.044460 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7766dc-ff45-491c-bbde-256d108a7664 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:14.061006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365acde7-c7cb-414b-b1fa-ccaa5a710c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:14.062081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365acde7-c7cb-414b-b1fa-ccaa5a710c2a admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.063136 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365acde7-c7cb-414b-b1fa-ccaa5a710c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.063694 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365acde7-c7cb-414b-b1fa-ccaa5a710c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.065921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365acde7-c7cb-414b-b1fa-ccaa5a710c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:14.071206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365acde7-c7cb-414b-b1fa-ccaa5a710c2a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:14.097045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e70e6-14d2-4184-906e-73b4d1c1c928 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:14.105900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:14.107646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.108153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.108619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] PATH_INFO: `/v3/projects/3c04cc84c6d845e49a8a9240c4aff0a2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.110951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c04cc84c6d845e49a8a9240c4aff0a2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:14.114921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:14.143289 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 963/1907] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:14 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:14.145274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365acde7-c7cb-414b-b1fa-ccaa5a710c2a admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:14.269525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:14.279387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c04cc84c6d845e49a8a9240c4aff0a2', 'request_id': 'req-9c6460d4-37cc-4049-9f0f-4991b7797d3b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:14.296039 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365acde7-c7cb-414b-b1fa-ccaa5a710c2a admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:14.329551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c04cc84c6d845e49a8a9240c4aff0a2', 'request_id': 'req-9c6460d4-37cc-4049-9f0f-4991b7797d3b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:14.366722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c04cc84c6d845e49a8a9240c4aff0a2', 'request_id': 'req-9c6460d4-37cc-4049-9f0f-4991b7797d3b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:14.425139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] The token cache is being invalidate because project 3c04cc84c6d845e49a8a9240c4aff0a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:14.425795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:14.426938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:14.427119 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e02cf-2c84-4b5e-b116-8f00e2e7720d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:14.428329 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e02cf-2c84-4b5e-b116-8f00e2e7720d admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.429060 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e02cf-2c84-4b5e-b116-8f00e2e7720d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.429563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e02cf-2c84-4b5e-b116-8f00e2e7720d admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.430850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e02cf-2c84-4b5e-b116-8f00e2e7720d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:14.432181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 945/1908] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:13 2022] DELETE /identity/v3/projects/3c04cc84c6d845e49a8a9240c4aff0a2 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:14.433318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:14.434371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e02cf-2c84-4b5e-b116-8f00e2e7720d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:14.448878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:14.459126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 964/1909] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:14.459126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1ae14-4185-4f7b-94ff-935ff02adef5 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.459126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1ae14-4185-4f7b-94ff-935ff02adef5 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.459126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1ae14-4185-4f7b-94ff-935ff02adef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.478504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6460d4-37cc-4049-9f0f-4991b7797d3b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:14.487380 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-73b1ae14-4185-4f7b-94ff-935ff02adef5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:14.487380 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-73b1ae14-4185-4f7b-94ff-935ff02adef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:14.495525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 965/1910] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:14.495744 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddea39-a87f-42ac-ac48-01b3848883f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:14.496995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddea39-a87f-42ac-ac48-01b3848883f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.497508 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddea39-a87f-42ac-ac48-01b3848883f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.498013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddea39-a87f-42ac-ac48-01b3848883f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.499255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddea39-a87f-42ac-ac48-01b3848883f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:14.502999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1ae14-4185-4f7b-94ff-935ff02adef5 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:14.503237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddea39-a87f-42ac-ac48-01b3848883f6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:14.504592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-73b1ae14-4185-4f7b-94ff-935ff02adef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:14.524144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1ae14-4185-4f7b-94ff-935ff02adef5 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:14.531314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ca6e8-ecb3-482f-8ab2-704d1d1da300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:14.532654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ca6e8-ecb3-482f-8ab2-704d1d1da300 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.532964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ca6e8-ecb3-482f-8ab2-704d1d1da300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.534314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ca6e8-ecb3-482f-8ab2-704d1d1da300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.534467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ca6e8-ecb3-482f-8ab2-704d1d1da300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:14.536205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ca6e8-ecb3-482f-8ab2-704d1d1da300 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:14.554214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 966/1911] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:14.554214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d430f-11b6-443e-a292-daccbe92491b None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.554214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d430f-11b6-443e-a292-daccbe92491b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.554214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d430f-11b6-443e-a292-daccbe92491b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.559059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 946/1912] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:14 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:14.560921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddea39-a87f-42ac-ac48-01b3848883f6 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:14.577698 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ce4d430f-11b6-443e-a292-daccbe92491b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:14.579020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ce4d430f-11b6-443e-a292-daccbe92491b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:14.585080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddea39-a87f-42ac-ac48-01b3848883f6 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:14.599531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf211dc-b031-410f-8b5f-372f3ef9d089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:14.599531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf211dc-b031-410f-8b5f-372f3ef9d089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.599531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf211dc-b031-410f-8b5f-372f3ef9d089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.599531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf211dc-b031-410f-8b5f-372f3ef9d089 admin admin] PATH_INFO: `/v3/projects/d63facba736441fbae314e9d8675b471/users/ac1e4fb9f25649cd96451616187de49d/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.601211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 967/1913] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:14.602492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d430f-11b6-443e-a292-daccbe92491b None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:14.615140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d430f-11b6-443e-a292-daccbe92491b None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:14.625508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cf56e-9ce2-4d95-8d1b-5a4f33f2edfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:14.627492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cf56e-9ce2-4d95-8d1b-5a4f33f2edfb admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.628006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cf56e-9ce2-4d95-8d1b-5a4f33f2edfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.628766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cf56e-9ce2-4d95-8d1b-5a4f33f2edfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.629747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9cf56e-9ce2-4d95-8d1b-5a4f33f2edfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:14.632890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9cf56e-9ce2-4d95-8d1b-5a4f33f2edfb admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:14.637882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf211dc-b031-410f-8b5f-372f3ef9d089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63facba736441fbae314e9d8675b471, user_id=ac1e4fb9f25649cd96451616187de49d, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:14.646823 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf211dc-b031-410f-8b5f-372f3ef9d089 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:14.648674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 968/1914] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:14.650472 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cf56e-9ce2-4d95-8d1b-5a4f33f2edfb admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:14.666777 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cf56e-9ce2-4d95-8d1b-5a4f33f2edfb admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:14.677408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 947/1915] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:14 2022] PUT /identity/v3/projects/d63facba736441fbae314e9d8675b471/users/ac1e4fb9f25649cd96451616187de49d/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:14.680596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a2fc3-551f-4bd7-aef6-2d729e06f8cd None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.681833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a2fc3-551f-4bd7-aef6-2d729e06f8cd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.682335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a2fc3-551f-4bd7-aef6-2d729e06f8cd None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.685028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 948/1916] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 21:08:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:08:14.685881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a2fc3-551f-4bd7-aef6-2d729e06f8cd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:14.777400 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:14.782299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e680e8-b6d6-448c-98c1-3df5a4e4f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:14.783611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e680e8-b6d6-448c-98c1-3df5a4e4f763 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.784002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e680e8-b6d6-448c-98c1-3df5a4e4f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.784529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e680e8-b6d6-448c-98c1-3df5a4e4f763 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.785759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e680e8-b6d6-448c-98c1-3df5a4e4f763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:08:14.786283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e680e8-b6d6-448c-98c1-3df5a4e4f763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:14.790280 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e680e8-b6d6-448c-98c1-3df5a4e4f763 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:14.815827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 969/1917] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:08:14.818206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c229f-4268-4691-8f87-4ee3f3b43b64 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.818885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c229f-4268-4691-8f87-4ee3f3b43b64 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.819408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c229f-4268-4691-8f87-4ee3f3b43b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.861763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a2fc3-551f-4bd7-aef6-2d729e06f8cd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:14.876062 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-3d0c229f-4268-4691-8f87-4ee3f3b43b64 None None] MFA Rules not processed for user `ac1e4fb9f25649cd96451616187de49d`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:14.877826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3d0c229f-4268-4691-8f87-4ee3f3b43b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:14.882919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf9aed-0e94-4db4-b7ab-cb9409bc1101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:14.883643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf9aed-0e94-4db4-b7ab-cb9409bc1101 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.883932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf9aed-0e94-4db4-b7ab-cb9409bc1101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.884224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf9aed-0e94-4db4-b7ab-cb9409bc1101 admin admin] PATH_INFO: `/v3/projects/d67edd73d8ef4209a0b9c91cf6c76caa/users/a0ec87b01e1545e585b9cf5083974572/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.926480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf9aed-0e94-4db4-b7ab-cb9409bc1101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67edd73d8ef4209a0b9c91cf6c76caa, user_id=a0ec87b01e1545e585b9cf5083974572, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:14.929552 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf9aed-0e94-4db4-b7ab-cb9409bc1101 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:14.936962 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:14.956042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 949/1918] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:14 2022] PUT /identity/v3/projects/d67edd73d8ef4209a0b9c91cf6c76caa/users/a0ec87b01e1545e585b9cf5083974572/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:14.957455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8391b6-1261-445e-82ce-2c3f68c15b84 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:14.957749 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8391b6-1261-445e-82ce-2c3f68c15b84 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:14.958031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8391b6-1261-445e-82ce-2c3f68c15b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:14.983046 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 970/1919] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:14.984353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c229f-4268-4691-8f87-4ee3f3b43b64 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:14.998318 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c229f-4268-4691-8f87-4ee3f3b43b64 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:14.998890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1d8391b6-1261-445e-82ce-2c3f68c15b84 None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:15.000169 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1d8391b6-1261-445e-82ce-2c3f68c15b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:15.077256 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f5583-bb7f-428c-b79a-c0d897103359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:15.078260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f5583-bb7f-428c-b79a-c0d897103359 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:15.078628 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f5583-bb7f-428c-b79a-c0d897103359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:15.079180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f5583-bb7f-428c-b79a-c0d897103359 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:15.080371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f5583-bb7f-428c-b79a-c0d897103359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:15.083913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f5583-bb7f-428c-b79a-c0d897103359 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:15.112339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 950/1920] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:15.113045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8391b6-1261-445e-82ce-2c3f68c15b84 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:15.126106 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8391b6-1261-445e-82ce-2c3f68c15b84 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:15.128457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 971/1921] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:14 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:15.129600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f5583-bb7f-428c-b79a-c0d897103359 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:15.232550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f5583-bb7f-428c-b79a-c0d897103359 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:15.262219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb131a5-0c78-4ad5-876f-0e435505ea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:15.263122 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea1af9-56a7-4790-bc6d-c7cca4ba292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:15.264512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea1af9-56a7-4790-bc6d-c7cca4ba292c admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:15.265350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea1af9-56a7-4790-bc6d-c7cca4ba292c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:15.266298 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea1af9-56a7-4790-bc6d-c7cca4ba292c admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:15.268168 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb131a5-0c78-4ad5-876f-0e435505ea57 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:15.268515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea1af9-56a7-4790-bc6d-c7cca4ba292c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:15.269881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb131a5-0c78-4ad5-876f-0e435505ea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:15.271607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb131a5-0c78-4ad5-876f-0e435505ea57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:15.275577 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea1af9-56a7-4790-bc6d-c7cca4ba292c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:15.277849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb131a5-0c78-4ad5-876f-0e435505ea57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:15.283724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb131a5-0c78-4ad5-876f-0e435505ea57 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:15.337312 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 951/1922] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:15.341311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb131a5-0c78-4ad5-876f-0e435505ea57 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:15.355076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 972/1923] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:15 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:15.360964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba51261-466d-466e-ad88-e183c7fd897d None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:15.361840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba51261-466d-466e-ad88-e183c7fd897d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:15.363183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba51261-466d-466e-ad88-e183c7fd897d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:15.377096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb131a5-0c78-4ad5-876f-0e435505ea57 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:15.424715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-1ba51261-466d-466e-ad88-e183c7fd897d None None] MFA Rules not processed for user `ae5e4a0fa5044537856129960a8a44de`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:15.426016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1ba51261-466d-466e-ad88-e183c7fd897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:15.473404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:15.479178 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:15.518628 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700d15f-cb09-4ae4-a94b-2510ee860cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:15.519670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700d15f-cb09-4ae4-a94b-2510ee860cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:15.520734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700d15f-cb09-4ae4-a94b-2510ee860cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:15.521208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700d15f-cb09-4ae4-a94b-2510ee860cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:15.523268 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700d15f-cb09-4ae4-a94b-2510ee860cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:15.525003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 973/1924] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:15.527934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700d15f-cb09-4ae4-a94b-2510ee860cf5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:15.536229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba51261-466d-466e-ad88-e183c7fd897d None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:15.538453 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1ba51261-466d-466e-ad88-e183c7fd897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:15.572042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 952/1925] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:15 2022] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:15.573183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700d15f-cb09-4ae4-a94b-2510ee860cf5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:15.586637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700d15f-cb09-4ae4-a94b-2510ee860cf5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:15.593241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fd338-fd44-413c-9635-ecd5c6817f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:15.593581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fd338-fd44-413c-9635-ecd5c6817f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:15.593735 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fd338-fd44-413c-9635-ecd5c6817f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:15.594008 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fd338-fd44-413c-9635-ecd5c6817f5f admin admin] PATH_INFO: `/v3/projects/d67edd73d8ef4209a0b9c91cf6c76caa/users/a0ec87b01e1545e585b9cf5083974572/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:15.596579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fd338-fd44-413c-9635-ecd5c6817f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67edd73d8ef4209a0b9c91cf6c76caa, user_id=a0ec87b01e1545e585b9cf5083974572, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:15.599588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fd338-fd44-413c-9635-ecd5c6817f5f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:15.615199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 953/1926] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:15 2022] PUT /identity/v3/projects/d67edd73d8ef4209a0b9c91cf6c76caa/users/a0ec87b01e1545e585b9cf5083974572/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:15.617116 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fd338-fd44-413c-9635-ecd5c6817f5f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:15.698108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba51261-466d-466e-ad88-e183c7fd897d None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:15.726832 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fd338-fd44-413c-9635-ecd5c6817f5f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:15.732462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4f07b-c546-4f7e-8bcd-f3074afa6eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:15.733204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4f07b-c546-4f7e-8bcd-f3074afa6eae admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:15.733544 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4f07b-c546-4f7e-8bcd-f3074afa6eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:15.733904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4f07b-c546-4f7e-8bcd-f3074afa6eae admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:15.734715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4f07b-c546-4f7e-8bcd-f3074afa6eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:15.737334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4f07b-c546-4f7e-8bcd-f3074afa6eae admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:15.790085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 954/1927] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:15 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:15.792452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9bec3-1140-4348-9393-912235d1086e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:15.793010 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9bec3-1140-4348-9393-912235d1086e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:15.793503 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9bec3-1140-4348-9393-912235d1086e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:15.817190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352a37d-7d6a-453b-8bba-237a872a8867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:15.817822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352a37d-7d6a-453b-8bba-237a872a8867 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:15.818123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352a37d-7d6a-453b-8bba-237a872a8867 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:15.819046 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352a37d-7d6a-453b-8bba-237a872a8867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:15.829317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352a37d-7d6a-453b-8bba-237a872a8867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:15.830250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-adb9bec3-1140-4348-9393-912235d1086e None None] MFA Rules not processed for user `c8eed745175b4c02af199f7655ea0231`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:15.830988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352a37d-7d6a-453b-8bba-237a872a8867 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:15.832824 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-adb9bec3-1140-4348-9393-912235d1086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:15.845661 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 974/1928] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:15.846553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352a37d-7d6a-453b-8bba-237a872a8867 service nova] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:15.858802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352a37d-7d6a-453b-8bba-237a872a8867 service nova] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:15.864031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec5b6f-3886-4960-b519-c1ab6ff5d1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:15.864658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec5b6f-3886-4960-b519-c1ab6ff5d1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:15.864939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec5b6f-3886-4960-b519-c1ab6ff5d1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:15.865214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec5b6f-3886-4960-b519-c1ab6ff5d1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:15.866503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec5b6f-3886-4960-b519-c1ab6ff5d1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:15.868170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec5b6f-3886-4960-b519-c1ab6ff5d1e1 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:15.881006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 975/1929] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:15.886330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bcfc5-d99c-4922-aed6-3e4783becd3e None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:15.886649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bcfc5-d99c-4922-aed6-3e4783becd3e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:15.886918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bcfc5-d99c-4922-aed6-3e4783becd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:15.935115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ec9bcfc5-d99c-4922-aed6-3e4783becd3e None None] MFA Rules not processed for user `a0ec87b01e1545e585b9cf5083974572`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:15.937451 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ec9bcfc5-d99c-4922-aed6-3e4783becd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:15.954938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 955/1930] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:15.954938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9bec3-1140-4348-9393-912235d1086e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:15.974767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9bec3-1140-4348-9393-912235d1086e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:15.982811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f07352-4659-4691-8bf1-ee65df8f0afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:15.983584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f07352-4659-4691-8bf1-ee65df8f0afd admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:15.983999 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f07352-4659-4691-8bf1-ee65df8f0afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:15.984403 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f07352-4659-4691-8bf1-ee65df8f0afd admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:15.985235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f07352-4659-4691-8bf1-ee65df8f0afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:15.987663 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f07352-4659-4691-8bf1-ee65df8f0afd admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:15.997485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:16.009263 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 956/1931] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:16.010703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f07352-4659-4691-8bf1-ee65df8f0afd admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:16.031391 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f07352-4659-4691-8bf1-ee65df8f0afd admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:16.041155 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e28d3-b01f-424c-bdaf-a00e47adbd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:16.042235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e28d3-b01f-424c-bdaf-a00e47adbd17 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:16.042729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e28d3-b01f-424c-bdaf-a00e47adbd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:16.043272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e28d3-b01f-424c-bdaf-a00e47adbd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:16.044505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e28d3-b01f-424c-bdaf-a00e47adbd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:16.047701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e28d3-b01f-424c-bdaf-a00e47adbd17 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:16.064788 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 976/1932] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:16.066500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bcfc5-d99c-4922-aed6-3e4783becd3e None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:16.068984 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 957/1933] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:16.075042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e28d3-b01f-424c-bdaf-a00e47adbd17 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:16.086203 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e28d3-b01f-424c-bdaf-a00e47adbd17 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:16.092818 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1df8e-c2c1-4c7c-bb1d-9c1c8526b2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:16.093626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1df8e-c2c1-4c7c-bb1d-9c1c8526b2a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:16.094046 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1df8e-c2c1-4c7c-bb1d-9c1c8526b2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:16.094237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1df8e-c2c1-4c7c-bb1d-9c1c8526b2a1 admin admin] PATH_INFO: `/v3/projects/4cb7a271184d4b708378abbf5ceda284/users/8977349f12bc41139cf79550190891c4/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:16.107570 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bcfc5-d99c-4922-aed6-3e4783becd3e None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:16.112445 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1df8e-c2c1-4c7c-bb1d-9c1c8526b2a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb7a271184d4b708378abbf5ceda284, user_id=8977349f12bc41139cf79550190891c4, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:16.115082 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489feb3c-6a40-440e-b16d-a350ca1cc290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:16.115720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1df8e-c2c1-4c7c-bb1d-9c1c8526b2a1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:16.116036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489feb3c-6a40-440e-b16d-a350ca1cc290 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:16.116562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489feb3c-6a40-440e-b16d-a350ca1cc290 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:16.117003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489feb3c-6a40-440e-b16d-a350ca1cc290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:16.119742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-489feb3c-6a40-440e-b16d-a350ca1cc290 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:16.142111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 958/1934] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:16 2022] PUT /identity/v3/projects/4cb7a271184d4b708378abbf5ceda284/users/8977349f12bc41139cf79550190891c4/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:16.142111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1df8e-c2c1-4c7c-bb1d-9c1c8526b2a1 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:16.142406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489feb3c-6a40-440e-b16d-a350ca1cc290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:16.143708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489feb3c-6a40-440e-b16d-a350ca1cc290 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:16.160507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:16.161278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 977/1935] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:16.162579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489feb3c-6a40-440e-b16d-a350ca1cc290 service nova] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:16.164734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-489feb3c-6a40-440e-b16d-a350ca1cc290 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:16.275720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489feb3c-6a40-440e-b16d-a350ca1cc290 service nova] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:16.282820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1df8e-c2c1-4c7c-bb1d-9c1c8526b2a1 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:16.293097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12ede8-bb40-4526-8f90-2c052b020fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:16.294265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12ede8-bb40-4526-8f90-2c052b020fec admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:16.294789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12ede8-bb40-4526-8f90-2c052b020fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:16.295327 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12ede8-bb40-4526-8f90-2c052b020fec admin admin] PATH_INFO: `/v3/projects/40f324257e364c23848b98d4705decdd/users/6c73f31561ba44339106489728b62b65/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:16.332170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12ede8-bb40-4526-8f90-2c052b020fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f324257e364c23848b98d4705decdd, user_id=6c73f31561ba44339106489728b62b65, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:16.338369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12ede8-bb40-4526-8f90-2c052b020fec admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:16.383807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 959/1936] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:16 2022] PUT /identity/v3/projects/40f324257e364c23848b98d4705decdd/users/6c73f31561ba44339106489728b62b65/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:16.384918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12ede8-bb40-4526-8f90-2c052b020fec admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:16.408613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d637370-941f-4e08-a644-12c715a0c2e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:16.409828 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d637370-941f-4e08-a644-12c715a0c2e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:16.410121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d637370-941f-4e08-a644-12c715a0c2e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:16.410403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d637370-941f-4e08-a644-12c715a0c2e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:16.533339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12ede8-bb40-4526-8f90-2c052b020fec admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:16.541913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696c1f5-a506-4139-8def-5639d9c83600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:16.542978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696c1f5-a506-4139-8def-5639d9c83600 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:16.543468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696c1f5-a506-4139-8def-5639d9c83600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:16.543949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696c1f5-a506-4139-8def-5639d9c83600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:16.545171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696c1f5-a506-4139-8def-5639d9c83600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:16.548430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696c1f5-a506-4139-8def-5639d9c83600 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:16.556306 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d637370-941f-4e08-a644-12c715a0c2e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:16.557780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d637370-941f-4e08-a644-12c715a0c2e3 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:16.570025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 978/1937] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:16.571501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee122f-211d-4850-8071-938763406c18 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:16.571803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee122f-211d-4850-8071-938763406c18 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:16.572089 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee122f-211d-4850-8071-938763406c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:16.574853 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 960/1938] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:16.576459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696c1f5-a506-4139-8def-5639d9c83600 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:16.598860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696c1f5-a506-4139-8def-5639d9c83600 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:16.610599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-b0ee122f-211d-4850-8071-938763406c18 None None] MFA Rules not processed for user `6c73f31561ba44339106489728b62b65`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:16.612921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b0ee122f-211d-4850-8071-938763406c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:16.620140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95d909-ae03-4a17-8582-de8560603e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:16.631679 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95d909-ae03-4a17-8582-de8560603e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:16.632284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95d909-ae03-4a17-8582-de8560603e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:16.633076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95d909-ae03-4a17-8582-de8560603e44 admin admin] PATH_INFO: `/v3/projects/4cb7a271184d4b708378abbf5ceda284/users/8977349f12bc41139cf79550190891c4/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:16.638896 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95d909-ae03-4a17-8582-de8560603e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb7a271184d4b708378abbf5ceda284, user_id=8977349f12bc41139cf79550190891c4, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:16.645742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:16.646150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95d909-ae03-4a17-8582-de8560603e44 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:16.670040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 961/1939] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:16 2022] PUT /identity/v3/projects/4cb7a271184d4b708378abbf5ceda284/users/8977349f12bc41139cf79550190891c4/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:16.671296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95d909-ae03-4a17-8582-de8560603e44 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:16.731188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 979/1940] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:16.733749 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077e0cb-f00c-489f-9352-46223432b372 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:16.734262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077e0cb-f00c-489f-9352-46223432b372 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:16.735697 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077e0cb-f00c-489f-9352-46223432b372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:16.797157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-f077e0cb-f00c-489f-9352-46223432b372 None None] MFA Rules not processed for user `8977349f12bc41139cf79550190891c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:16.798471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f077e0cb-f00c-489f-9352-46223432b372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:16.826098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95d909-ae03-4a17-8582-de8560603e44 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:16.832234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:16.832908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:16.833192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:16.833474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] PATH_INFO: `/v3/users/e686731b6c8b4f958c32e0a3fa161b74` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:16.835537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e686731b6c8b4f958c32e0a3fa161b74)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:16.837576 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:16.856979 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:16.927235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e686731b6c8b4f958c32e0a3fa161b74'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:16.946027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e686731b6c8b4f958c32e0a3fa161b74'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:16.958333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e686731b6c8b4f958c32e0a3fa161b74'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:16.959603 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e686731b6c8b4f958c32e0a3fa161b74'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:16.960995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e686731b6c8b4f958c32e0a3fa161b74'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:16.969797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 980/1941] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:16.971354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077e0cb-f00c-489f-9352-46223432b372 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:16.991948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077e0cb-f00c-489f-9352-46223432b372 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:16.999144 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 962/1942] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:16 2022] DELETE /identity/v3/users/e686731b6c8b4f958c32e0a3fa161b74 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:17.001289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:17.004866 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:17.006461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59ca26-091c-40af-9cf3-d4e738011dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:17.007180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59ca26-091c-40af-9cf3-d4e738011dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:17.007541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59ca26-091c-40af-9cf3-d4e738011dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:17.007828 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59ca26-091c-40af-9cf3-d4e738011dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:17.008642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59ca26-091c-40af-9cf3-d4e738011dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:17.010931 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59ca26-091c-40af-9cf3-d4e738011dfc admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:17.055265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 981/1943] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:16 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:17.055265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733629f-1bce-476f-86a3-c3ace8a63ef7 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:17.055265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733629f-1bce-476f-86a3-c3ace8a63ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:17.055265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733629f-1bce-476f-86a3-c3ace8a63ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:17.082520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-3733629f-1bce-476f-86a3-c3ace8a63ef7 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:17.086461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3733629f-1bce-476f-86a3-c3ace8a63ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:17.169851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3f8d6-511d-4c30-ba9a-95c58ea1c0a3 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:17.215070 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 982/1944] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:17.215070 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733629f-1bce-476f-86a3-c3ace8a63ef7 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:17.218507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3733629f-1bce-476f-86a3-c3ace8a63ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:17.247645 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733629f-1bce-476f-86a3-c3ace8a63ef7 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:17.252798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0dcc4-374a-4255-ba2b-d97bc8de3cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:17.253555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0dcc4-374a-4255-ba2b-d97bc8de3cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:17.253896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0dcc4-374a-4255-ba2b-d97bc8de3cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:17.254231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0dcc4-374a-4255-ba2b-d97bc8de3cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:17.255005 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0dcc4-374a-4255-ba2b-d97bc8de3cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:17.258135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0dcc4-374a-4255-ba2b-d97bc8de3cb0 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:17.284719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:17.301953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 983/1945] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:17 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:17.303112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0dcc4-374a-4255-ba2b-d97bc8de3cb0 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:17.308905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ace0dcc4-374a-4255-ba2b-d97bc8de3cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:17.326287 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae40f6b-6327-4a67-9514-d50527520fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:17.326969 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae40f6b-6327-4a67-9514-d50527520fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:17.327252 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae40f6b-6327-4a67-9514-d50527520fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:17.327525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae40f6b-6327-4a67-9514-d50527520fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:17.330530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fae40f6b-6327-4a67-9514-d50527520fc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:17.429700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0dcc4-374a-4255-ba2b-d97bc8de3cb0 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:17.447290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d7b1e-3207-4ffd-a894-ef7f350681fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:17.450511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d7b1e-3207-4ffd-a894-ef7f350681fe service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:17.451108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d7b1e-3207-4ffd-a894-ef7f350681fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:17.451375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d7b1e-3207-4ffd-a894-ef7f350681fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:17.467065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d7b1e-3207-4ffd-a894-ef7f350681fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:17.469625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d7b1e-3207-4ffd-a894-ef7f350681fe service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:17.486357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 984/1946] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:17.487631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d7b1e-3207-4ffd-a894-ef7f350681fe service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:17.507720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae40f6b-6327-4a67-9514-d50527520fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:17.511532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae40f6b-6327-4a67-9514-d50527520fc1 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:17.514716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d7b1e-3207-4ffd-a894-ef7f350681fe service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:17.535083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165cabe-ad50-45a1-8ec9-ac182c19ef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:17.535083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165cabe-ad50-45a1-8ec9-ac182c19ef18 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:17.535409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:17.536114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165cabe-ad50-45a1-8ec9-ac182c19ef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:17.536114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165cabe-ad50-45a1-8ec9-ac182c19ef18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:17.536114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165cabe-ad50-45a1-8ec9-ac182c19ef18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:17.538666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165cabe-ad50-45a1-8ec9-ac182c19ef18 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:17.552264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 963/1947] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:17.627512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 985/1948] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:17.630701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae40f6b-6327-4a67-9514-d50527520fc1 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:17.671283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae40f6b-6327-4a67-9514-d50527520fc1 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:17.693170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592586f-dd9a-418f-a6de-e0ca95a5a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:17.695432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592586f-dd9a-418f-a6de-e0ca95a5a585 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:17.697722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592586f-dd9a-418f-a6de-e0ca95a5a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:17.698425 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592586f-dd9a-418f-a6de-e0ca95a5a585 admin admin] PATH_INFO: `/v3/projects/73e08b618de24a2f80a88e2b4622219e/users/f0d23227ccf445a1b251606dd522a7b2/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:17.736959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592586f-dd9a-418f-a6de-e0ca95a5a585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e08b618de24a2f80a88e2b4622219e, user_id=f0d23227ccf445a1b251606dd522a7b2, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:17.744852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592586f-dd9a-418f-a6de-e0ca95a5a585 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:17.789190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 964/1949] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:17 2022] PUT /identity/v3/projects/73e08b618de24a2f80a88e2b4622219e/users/f0d23227ccf445a1b251606dd522a7b2/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:17.790534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165cabe-ad50-45a1-8ec9-ac182c19ef18 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:17.827001 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165cabe-ad50-45a1-8ec9-ac182c19ef18 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:18.008907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8e2fc-7d83-4ad5-87a7-eff74fa83bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:18.008907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8e2fc-7d83-4ad5-87a7-eff74fa83bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:18.008907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8e2fc-7d83-4ad5-87a7-eff74fa83bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:18.008907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8e2fc-7d83-4ad5-87a7-eff74fa83bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:18.009593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8e2fc-7d83-4ad5-87a7-eff74fa83bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:18.009593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8e2fc-7d83-4ad5-87a7-eff74fa83bc3 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:18.032416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 986/1950] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:08:18.037927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592586f-dd9a-418f-a6de-e0ca95a5a585 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:18.049535 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592586f-dd9a-418f-a6de-e0ca95a5a585 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:18.056201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25098cc-63c4-4483-a776-73215179fe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:18.057028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25098cc-63c4-4483-a776-73215179fe31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:18.057449 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25098cc-63c4-4483-a776-73215179fe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:18.057917 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25098cc-63c4-4483-a776-73215179fe31 admin admin] PATH_INFO: `/v3/projects/73e08b618de24a2f80a88e2b4622219e/users/f0d23227ccf445a1b251606dd522a7b2/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:18.060405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25098cc-63c4-4483-a776-73215179fe31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e08b618de24a2f80a88e2b4622219e, user_id=f0d23227ccf445a1b251606dd522a7b2, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:18.063732 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25098cc-63c4-4483-a776-73215179fe31 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:18.095378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 965/1951] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:18 2022] PUT /identity/v3/projects/73e08b618de24a2f80a88e2b4622219e/users/f0d23227ccf445a1b251606dd522a7b2/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:18.101286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467d0bd-469e-4da1-a76e-7999c233184c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:18.102019 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467d0bd-469e-4da1-a76e-7999c233184c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:18.102324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467d0bd-469e-4da1-a76e-7999c233184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:18.207335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-1467d0bd-469e-4da1-a76e-7999c233184c None None] MFA Rules not processed for user `f0d23227ccf445a1b251606dd522a7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:18.210847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1467d0bd-469e-4da1-a76e-7999c233184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:18.327042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25098cc-63c4-4483-a776-73215179fe31 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:18.329351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c25098cc-63c4-4483-a776-73215179fe31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:18.520816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25098cc-63c4-4483-a776-73215179fe31 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:18.526456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:18.527165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:18.527439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:18.527770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] PATH_INFO: `/v3/projects/7360ef205568422d8abfeb5408efdb79` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:18.528975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7360ef205568422d8abfeb5408efdb79)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:18.531047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:18.540667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 987/1952] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:18.561877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467d0bd-469e-4da1-a76e-7999c233184c None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:18.563992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1467d0bd-469e-4da1-a76e-7999c233184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:18.602595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:18.691761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7360ef205568422d8abfeb5408efdb79', 'request_id': 'req-d1f41fbf-dbdf-4b3b-8b12-94873b927285'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:18.713806 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7360ef205568422d8abfeb5408efdb79', 'request_id': 'req-d1f41fbf-dbdf-4b3b-8b12-94873b927285'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:18.732381 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7360ef205568422d8abfeb5408efdb79', 'request_id': 'req-d1f41fbf-dbdf-4b3b-8b12-94873b927285'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:18.785770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] The token cache is being invalidate because project 7360ef205568422d8abfeb5408efdb79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:18.786281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:18.788142 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:18.791114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 966/1953] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:18 2022] DELETE /identity/v3/projects/7360ef205568422d8abfeb5408efdb79 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:18.796657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:18.799255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:18.807437 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467d0bd-469e-4da1-a76e-7999c233184c None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:18.925158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855d54-849a-4c93-8398-2e6ceed85b1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:18.926516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855d54-849a-4c93-8398-2e6ceed85b1c service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:18.927326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855d54-849a-4c93-8398-2e6ceed85b1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:18.927835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855d54-849a-4c93-8398-2e6ceed85b1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:18.931924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a1855d54-849a-4c93-8398-2e6ceed85b1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:18.941515 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:18.964972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f41fbf-dbdf-4b3b-8b12-94873b927285 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:18.974484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:18.975664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:18.976153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:18.976630 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] PATH_INFO: `/v3/users/a0ec87b01e1545e585b9cf5083974572` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:18.979667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ec87b01e1545e585b9cf5083974572)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:18.983038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:19.085528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1855d54-849a-4c93-8398-2e6ceed85b1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:19.088718 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1855d54-849a-4c93-8398-2e6ceed85b1c service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:19.106180 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ec87b01e1545e585b9cf5083974572'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:19.125186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 988/1954] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:19.127016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855d54-849a-4c93-8398-2e6ceed85b1c service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:19.129773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a1855d54-849a-4c93-8398-2e6ceed85b1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:19.143819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ec87b01e1545e585b9cf5083974572'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:19.162956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ec87b01e1545e585b9cf5083974572'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:19.163910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855d54-849a-4c93-8398-2e6ceed85b1c service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:19.164603 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ec87b01e1545e585b9cf5083974572'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:19.165895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ec87b01e1545e585b9cf5083974572'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:19.182436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce472-54a4-43ac-b338-139263e42cd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:19.183768 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce472-54a4-43ac-b338-139263e42cd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:19.184666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce472-54a4-43ac-b338-139263e42cd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:19.184850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce472-54a4-43ac-b338-139263e42cd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:19.189575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-830ce472-54a4-43ac-b338-139263e42cd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:19.210857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 967/1955] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:18 2022] DELETE /identity/v3/users/a0ec87b01e1545e585b9cf5083974572 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:19.245221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:19.248332 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:19.356034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ce472-54a4-43ac-b338-139263e42cd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:19.360751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ce472-54a4-43ac-b338-139263e42cd9 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:19.415413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 989/1956] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:19.465634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada66cb-8ff9-44fa-aa28-16d5f959d821 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:19.473916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4930d4-671d-4376-acff-101ef455b6db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:19.475592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4930d4-671d-4376-acff-101ef455b6db service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:19.476349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4930d4-671d-4376-acff-101ef455b6db service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:19.476908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4930d4-671d-4376-acff-101ef455b6db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:19.480861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2f4930d4-671d-4376-acff-101ef455b6db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:19.613170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4930d4-671d-4376-acff-101ef455b6db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:19.614754 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4930d4-671d-4376-acff-101ef455b6db service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:19.626804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 968/1957] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:08:20.030111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce472-54a4-43ac-b338-139263e42cd9 service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:20.032197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-830ce472-54a4-43ac-b338-139263e42cd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:20.081889 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce472-54a4-43ac-b338-139263e42cd9 service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:20.132790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:20.293742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:20.295579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:20.296454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:20.297277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f admin admin] PATH_INFO: `/v3/projects/d67edd73d8ef4209a0b9c91cf6c76caa` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:20.300904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67edd73d8ef4209a0b9c91cf6c76caa)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:20.307543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:20.414190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67edd73d8ef4209a0b9c91cf6c76caa', 'request_id': 'req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:20.430156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67edd73d8ef4209a0b9c91cf6c76caa', 'request_id': 'req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:20.439209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67edd73d8ef4209a0b9c91cf6c76caa', 'request_id': 'req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:20.455965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f admin admin] The token cache is being invalidate because project d67edd73d8ef4209a0b9c91cf6c76caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:20.456457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:20.457353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2683d6fe-f804-4dc6-bfaf-b8a1f4350e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:20.463112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 990/1958] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:20 2022] DELETE /identity/v3/projects/d67edd73d8ef4209a0b9c91cf6c76caa => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:20.467865 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d57abe-aa6b-45e9-a50a-72728f220574 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:20.469219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d57abe-aa6b-45e9-a50a-72728f220574 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:20.469746 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d57abe-aa6b-45e9-a50a-72728f220574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:20.504387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-45d57abe-aa6b-45e9-a50a-72728f220574 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:20.507283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-45d57abe-aa6b-45e9-a50a-72728f220574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:20.553086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:20.629201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 969/1959] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:20.644299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8109-33a9-4e22-b31e-87db4a1eae66 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:20.644855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8109-33a9-4e22-b31e-87db4a1eae66 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:20.645269 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8109-33a9-4e22-b31e-87db4a1eae66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:20.689157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-989b8109-33a9-4e22-b31e-87db4a1eae66 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:20.692016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-989b8109-33a9-4e22-b31e-87db4a1eae66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:20.710982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 991/1960] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:20.716422 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d57abe-aa6b-45e9-a50a-72728f220574 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:20.736471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d57abe-aa6b-45e9-a50a-72728f220574 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:20.754031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d1633-9c41-41ef-9e57-28f12366de10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:20.754811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1633-9c41-41ef-9e57-28f12366de10 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:20.755099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1633-9c41-41ef-9e57-28f12366de10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:20.755503 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1633-9c41-41ef-9e57-28f12366de10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:20.756907 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d1633-9c41-41ef-9e57-28f12366de10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:08:20.757407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d1633-9c41-41ef-9e57-28f12366de10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:20.759533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d1633-9c41-41ef-9e57-28f12366de10 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:20.777817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 970/1961] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:08:20.783930 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b8109-33a9-4e22-b31e-87db4a1eae66 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:20.795003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b8109-33a9-4e22-b31e-87db4a1eae66 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:20.800829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4311fb-c74a-4762-98a5-18038c25c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:20.801644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4311fb-c74a-4762-98a5-18038c25c02f admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:20.801934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4311fb-c74a-4762-98a5-18038c25c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:20.802221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4311fb-c74a-4762-98a5-18038c25c02f admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:20.803455 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4311fb-c74a-4762-98a5-18038c25c02f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:20.805573 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4311fb-c74a-4762-98a5-18038c25c02f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:20.858807 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 992/1962] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:20 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:08:20.864358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d1633-9c41-41ef-9e57-28f12366de10 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:20.891366 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d1633-9c41-41ef-9e57-28f12366de10 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:21.035331 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46dcba-7158-4d21-87c1-cfb160f09680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:21.036108 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46dcba-7158-4d21-87c1-cfb160f09680 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:21.036456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46dcba-7158-4d21-87c1-cfb160f09680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:21.038070 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46dcba-7158-4d21-87c1-cfb160f09680 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:21.038473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46dcba-7158-4d21-87c1-cfb160f09680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:21.040775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46dcba-7158-4d21-87c1-cfb160f09680 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:21.077269 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 971/1963] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:20 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:21.079025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4311fb-c74a-4762-98a5-18038c25c02f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:21.106843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4311fb-c74a-4762-98a5-18038c25c02f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:21.119705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d83c6-69d9-4c21-9204-ae6749158b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:21.121507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d83c6-69d9-4c21-9204-ae6749158b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:21.122544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d83c6-69d9-4c21-9204-ae6749158b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:21.123370 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d83c6-69d9-4c21-9204-ae6749158b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:21.125209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d83c6-69d9-4c21-9204-ae6749158b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:21.130301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d83c6-69d9-4c21-9204-ae6749158b1b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:21.166896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 993/1964] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:08:21.170925 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46dcba-7158-4d21-87c1-cfb160f09680 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:21.189064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46dcba-7158-4d21-87c1-cfb160f09680 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:21.201755 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87d89f-b209-4d09-85cd-f594de043485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:21.202614 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87d89f-b209-4d09-85cd-f594de043485 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:21.203163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87d89f-b209-4d09-85cd-f594de043485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:21.203656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87d89f-b209-4d09-85cd-f594de043485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:21.205371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87d89f-b209-4d09-85cd-f594de043485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:21.208280 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87d89f-b209-4d09-85cd-f594de043485 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:21.230802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 972/1965] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:08:21.235023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d83c6-69d9-4c21-9204-ae6749158b1b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:21.248087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d83c6-69d9-4c21-9204-ae6749158b1b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:21.261423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f8987-901c-44c4-a2e2-34f89c2ef1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:21.262124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8987-901c-44c4-a2e2-34f89c2ef1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:21.262404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8987-901c-44c4-a2e2-34f89c2ef1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:21.262682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8987-901c-44c4-a2e2-34f89c2ef1c5 admin admin] PATH_INFO: `/v3/projects/d581db7fab8244fabab49cb71931a54a/users/cfc1aa56b1fc49ff9158c4db9cfa4c0d/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:21.283030 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f8987-901c-44c4-a2e2-34f89c2ef1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d581db7fab8244fabab49cb71931a54a, user_id=cfc1aa56b1fc49ff9158c4db9cfa4c0d, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:21.286028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f8987-901c-44c4-a2e2-34f89c2ef1c5 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:21.320590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 994/1966] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:21 2022] PUT /identity/v3/projects/d581db7fab8244fabab49cb71931a54a/users/cfc1aa56b1fc49ff9158c4db9cfa4c0d/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:08:21.326529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672abb6-0143-4b30-aba1-16bbd2cc7be3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:21.326876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672abb6-0143-4b30-aba1-16bbd2cc7be3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:21.327188 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672abb6-0143-4b30-aba1-16bbd2cc7be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:21.373516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c672abb6-0143-4b30-aba1-16bbd2cc7be3 None None] MFA Rules not processed for user `cfc1aa56b1fc49ff9158c4db9cfa4c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:21.376035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c672abb6-0143-4b30-aba1-16bbd2cc7be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:21.533913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f8987-901c-44c4-a2e2-34f89c2ef1c5 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:21.536207 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 973/1967] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:08:21.732124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:21.789939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f8987-901c-44c4-a2e2-34f89c2ef1c5 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:21.799805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167e886-8002-4fa8-9f02-7c587a9dd75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:21.802326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167e886-8002-4fa8-9f02-7c587a9dd75c admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:21.802326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167e886-8002-4fa8-9f02-7c587a9dd75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:21.802326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167e886-8002-4fa8-9f02-7c587a9dd75c admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:21.802326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167e886-8002-4fa8-9f02-7c587a9dd75c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:21.804680 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167e886-8002-4fa8-9f02-7c587a9dd75c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:21.887660 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 995/1968] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:21 2022] POST /identity/v3/projects => generated 385 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:21.892004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672abb6-0143-4b30-aba1-16bbd2cc7be3 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:21.917170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672abb6-0143-4b30-aba1-16bbd2cc7be3 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:22.017156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:22.155157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f1b99-469a-4dd3-943b-f5cee36b3e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:22.156294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f1b99-469a-4dd3-943b-f5cee36b3e0f admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:22.156776 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f1b99-469a-4dd3-943b-f5cee36b3e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:22.157218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f1b99-469a-4dd3-943b-f5cee36b3e0f admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:22.160556 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f1b99-469a-4dd3-943b-f5cee36b3e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:22.165019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f1b99-469a-4dd3-943b-f5cee36b3e0f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:22.270533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 974/1969] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:21 2022] POST /identity/v3/users => generated 299 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:08:22.273211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167e886-8002-4fa8-9f02-7c587a9dd75c admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:22.313452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167e886-8002-4fa8-9f02-7c587a9dd75c admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:22.319902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e3ae-e4ea-4858-b381-8ab3539085da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:22.320547 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e3ae-e4ea-4858-b381-8ab3539085da admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:22.320830 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e3ae-e4ea-4858-b381-8ab3539085da admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:22.321106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e3ae-e4ea-4858-b381-8ab3539085da admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:22.321786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0e3ae-e4ea-4858-b381-8ab3539085da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:22.323551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0e3ae-e4ea-4858-b381-8ab3539085da admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:22.372765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 996/1970] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:08:22.380000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f1b99-469a-4dd3-943b-f5cee36b3e0f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:22.433612 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f1b99-469a-4dd3-943b-f5cee36b3e0f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:22.461861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae122e-eac9-4211-8138-974f1640fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:22.464466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae122e-eac9-4211-8138-974f1640fdec admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:22.464958 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae122e-eac9-4211-8138-974f1640fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:22.467944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae122e-eac9-4211-8138-974f1640fdec admin admin] PATH_INFO: `/v3/projects/4c4c8665cdc1436cb0201ed3fb5dbacf/users/0550a0d9ee8e42b287c7b57f0c37ffda/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:22.513250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae122e-eac9-4211-8138-974f1640fdec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4c8665cdc1436cb0201ed3fb5dbacf, user_id=0550a0d9ee8e42b287c7b57f0c37ffda, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:22.539105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae122e-eac9-4211-8138-974f1640fdec admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:22.597045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 975/1971] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:22 2022] PUT /identity/v3/projects/4c4c8665cdc1436cb0201ed3fb5dbacf/users/0550a0d9ee8e42b287c7b57f0c37ffda/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:22.602258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e3ae-e4ea-4858-b381-8ab3539085da admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:22.623271 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e3ae-e4ea-4858-b381-8ab3539085da admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:22.764184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8377d71-e304-448a-b24f-ab4ea7be09b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:22.765270 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377d71-e304-448a-b24f-ab4ea7be09b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:22.765553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377d71-e304-448a-b24f-ab4ea7be09b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:22.766021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377d71-e304-448a-b24f-ab4ea7be09b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:22.767132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8377d71-e304-448a-b24f-ab4ea7be09b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:22.769081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8377d71-e304-448a-b24f-ab4ea7be09b4 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:22.817150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 997/1972] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:22.819234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae122e-eac9-4211-8138-974f1640fdec admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:22.836946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae122e-eac9-4211-8138-974f1640fdec admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:22.853825 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150d8d0-4bcf-4e69-b1f3-655d4bbfff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:22.854902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d8d0-4bcf-4e69-b1f3-655d4bbfff9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:22.855506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d8d0-4bcf-4e69-b1f3-655d4bbfff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:22.856203 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d8d0-4bcf-4e69-b1f3-655d4bbfff9b admin admin] PATH_INFO: `/v3/projects/4c4c8665cdc1436cb0201ed3fb5dbacf/users/0550a0d9ee8e42b287c7b57f0c37ffda/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:22.875006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150d8d0-4bcf-4e69-b1f3-655d4bbfff9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4c8665cdc1436cb0201ed3fb5dbacf, user_id=0550a0d9ee8e42b287c7b57f0c37ffda, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:22.882809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150d8d0-4bcf-4e69-b1f3-655d4bbfff9b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:22.958233 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 976/1973] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:22 2022] PUT /identity/v3/projects/4c4c8665cdc1436cb0201ed3fb5dbacf/users/0550a0d9ee8e42b287c7b57f0c37ffda/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:08:22.986360 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc24c9-f3cb-4271-b292-76dab019d7b3 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:22.986942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc24c9-f3cb-4271-b292-76dab019d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:22.987360 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc24c9-f3cb-4271-b292-76dab019d7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:23.062087 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-66fc24c9-f3cb-4271-b292-76dab019d7b3 None None] MFA Rules not processed for user `0550a0d9ee8e42b287c7b57f0c37ffda`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:23.065237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-66fc24c9-f3cb-4271-b292-76dab019d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:23.303309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 998/1974] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:08:23.317390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150d8d0-4bcf-4e69-b1f3-655d4bbfff9b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:23.323510 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2150d8d0-4bcf-4e69-b1f3-655d4bbfff9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:23.608582 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150d8d0-4bcf-4e69-b1f3-655d4bbfff9b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:23.640782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b09678-680b-4bb0-acb2-4976501ad879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:23.642242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b09678-680b-4bb0-acb2-4976501ad879 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:23.642755 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b09678-680b-4bb0-acb2-4976501ad879 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:23.643311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b09678-680b-4bb0-acb2-4976501ad879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:23.707710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b09678-680b-4bb0-acb2-4976501ad879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:23.710225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b09678-680b-4bb0-acb2-4976501ad879 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:23.755501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 977/1975] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:24.874319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc24c9-f3cb-4271-b292-76dab019d7b3 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:24.876903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-66fc24c9-f3cb-4271-b292-76dab019d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:24.993336 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:25.020881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc24c9-f3cb-4271-b292-76dab019d7b3 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:25.027120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736002b-e719-41e3-b0c5-3ba98c34026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:25.027783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736002b-e719-41e3-b0c5-3ba98c34026e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:25.028111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736002b-e719-41e3-b0c5-3ba98c34026e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:25.028392 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736002b-e719-41e3-b0c5-3ba98c34026e admin admin] PATH_INFO: `/v3/users/6c73f31561ba44339106489728b62b65` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:25.038832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736002b-e719-41e3-b0c5-3ba98c34026e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c73f31561ba44339106489728b62b65)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:25.043239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736002b-e719-41e3-b0c5-3ba98c34026e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:25.167445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8736002b-e719-41e3-b0c5-3ba98c34026e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c73f31561ba44339106489728b62b65'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:25.195001 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8736002b-e719-41e3-b0c5-3ba98c34026e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c73f31561ba44339106489728b62b65'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:25.197184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8736002b-e719-41e3-b0c5-3ba98c34026e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c73f31561ba44339106489728b62b65'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:25.198700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8736002b-e719-41e3-b0c5-3ba98c34026e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c73f31561ba44339106489728b62b65'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:25.202424 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b09678-680b-4bb0-acb2-4976501ad879 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:25.245147 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b09678-680b-4bb0-acb2-4976501ad879 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:25.267850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:25.268951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:25.269446 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:25.269959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] PATH_INFO: `/v3/users/cfc1aa56b1fc49ff9158c4db9cfa4c0d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:25.278674 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc1aa56b1fc49ff9158c4db9cfa4c0d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:25.280959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:25.287722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8736002b-e719-41e3-b0c5-3ba98c34026e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c73f31561ba44339106489728b62b65'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:25.356621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 999/1976] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:24 2022] DELETE /identity/v3/users/6c73f31561ba44339106489728b62b65 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:25.360381 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549f65-cf75-417f-aa51-0333fac29969 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:25.360894 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549f65-cf75-417f-aa51-0333fac29969 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:25.363509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549f65-cf75-417f-aa51-0333fac29969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:25.417919 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-83549f65-cf75-417f-aa51-0333fac29969 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:25.421612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-83549f65-cf75-417f-aa51-0333fac29969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:25.427590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc1aa56b1fc49ff9158c4db9cfa4c0d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:25.463901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc1aa56b1fc49ff9158c4db9cfa4c0d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:25.486649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc1aa56b1fc49ff9158c4db9cfa4c0d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:25.488242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc1aa56b1fc49ff9158c4db9cfa4c0d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:25.488888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc1aa56b1fc49ff9158c4db9cfa4c0d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:25.491517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:25.518966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 978/1977] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:25 2022] DELETE /identity/v3/users/cfc1aa56b1fc49ff9158c4db9cfa4c0d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:25.520408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:25.523788 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:25.575988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1000/1978] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:25.578560 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f101b-9309-470b-89dc-510aaeb84250 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:25.579014 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f101b-9309-470b-89dc-510aaeb84250 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:25.579505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f101b-9309-470b-89dc-510aaeb84250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:25.622172 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ad7f101b-9309-470b-89dc-510aaeb84250 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:25.624692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ad7f101b-9309-470b-89dc-510aaeb84250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:25.640761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323e57b-8449-455a-8e63-89dcc0d3a89b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:25.662887 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8a08-e536-44ae-b4df-36374d69d034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:25.666058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8a08-e536-44ae-b4df-36374d69d034 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:25.666602 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8a08-e536-44ae-b4df-36374d69d034 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:25.667178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8a08-e536-44ae-b4df-36374d69d034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:25.671251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-378f8a08-e536-44ae-b4df-36374d69d034 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:25.877993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:25.935147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1001/1979] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:25.935902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f101b-9309-470b-89dc-510aaeb84250 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:25.939446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ad7f101b-9309-470b-89dc-510aaeb84250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:25.968730 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f8a08-e536-44ae-b4df-36374d69d034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:25.972939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f8a08-e536-44ae-b4df-36374d69d034 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:26.013136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 979/1980] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:26.031559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8a08-e536-44ae-b4df-36374d69d034 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:26.040739 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-378f8a08-e536-44ae-b4df-36374d69d034 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:26.151816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f101b-9309-470b-89dc-510aaeb84250 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:26.164487 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d196d64-3010-45d8-bfe3-be4bee814028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:26.165147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d196d64-3010-45d8-bfe3-be4bee814028 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:26.165430 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d196d64-3010-45d8-bfe3-be4bee814028 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:26.165712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d196d64-3010-45d8-bfe3-be4bee814028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:26.196187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d196d64-3010-45d8-bfe3-be4bee814028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:26.197726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d196d64-3010-45d8-bfe3-be4bee814028 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:26.229084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1002/1981] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:26.329859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8a08-e536-44ae-b4df-36374d69d034 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:26.340124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93157b37-55f0-4421-9194-da16498fe7b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:26.340782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93157b37-55f0-4421-9194-da16498fe7b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:26.341072 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93157b37-55f0-4421-9194-da16498fe7b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:26.341350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93157b37-55f0-4421-9194-da16498fe7b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:26.356022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93157b37-55f0-4421-9194-da16498fe7b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:26.358047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93157b37-55f0-4421-9194-da16498fe7b1 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:26.375776 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 980/1982] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:27.558997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d196d64-3010-45d8-bfe3-be4bee814028 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:27.562123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6d196d64-3010-45d8-bfe3-be4bee814028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:27.649900 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d196d64-3010-45d8-bfe3-be4bee814028 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:27.664934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:27.666505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:27.667225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:27.667881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] PATH_INFO: `/v3/projects/40f324257e364c23848b98d4705decdd` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:27.670170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f324257e364c23848b98d4705decdd)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:27.675497 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:27.964257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f324257e364c23848b98d4705decdd', 'request_id': 'req-17d246eb-4682-4180-8a06-1ca4c499cfd7'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:27.985583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f324257e364c23848b98d4705decdd', 'request_id': 'req-17d246eb-4682-4180-8a06-1ca4c499cfd7'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:28.001813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f324257e364c23848b98d4705decdd', 'request_id': 'req-17d246eb-4682-4180-8a06-1ca4c499cfd7'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:28.026715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] The token cache is being invalidate because project 40f324257e364c23848b98d4705decdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:28.027424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:28.028921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:28.032663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1003/1983] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:27 2022] DELETE /identity/v3/projects/40f324257e364c23848b98d4705decdd => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:28.037697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93157b37-55f0-4421-9194-da16498fe7b1 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:28.050358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93157b37-55f0-4421-9194-da16498fe7b1 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:28.167506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:28.217475 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:28.219054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:28.219786 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:28.220469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] PATH_INFO: `/v3/users/f0d23227ccf445a1b251606dd522a7b2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:28.225282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d23227ccf445a1b251606dd522a7b2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:28.229531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:28.328197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d23227ccf445a1b251606dd522a7b2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:28.348675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d23227ccf445a1b251606dd522a7b2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:28.360967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d23227ccf445a1b251606dd522a7b2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:28.361806 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d23227ccf445a1b251606dd522a7b2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:28.362551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d23227ccf445a1b251606dd522a7b2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:28.391482 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 981/1984] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:28 2022] DELETE /identity/v3/users/f0d23227ccf445a1b251606dd522a7b2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:08:29.053834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:29.058521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:29.120574 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d246eb-4682-4180-8a06-1ca4c499cfd7 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:29.283375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee845e-1d87-4b06-9bf7-a2065651fc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:29.283911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee845e-1d87-4b06-9bf7-a2065651fc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:29.284394 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee845e-1d87-4b06-9bf7-a2065651fc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:29.284848 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee845e-1d87-4b06-9bf7-a2065651fc53 admin admin] PATH_INFO: `/v3/projects/73e08b618de24a2f80a88e2b4622219e` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:29.286629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee845e-1d87-4b06-9bf7-a2065651fc53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e08b618de24a2f80a88e2b4622219e)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:29.289667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee845e-1d87-4b06-9bf7-a2065651fc53 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:29.307358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:29.314076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:29.348415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509c28e-d149-447f-9a0a-eff1e7db98a4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:29.361668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:29.363791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:29.364618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:29.366573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] PATH_INFO: `/v3/projects/d581db7fab8244fabab49cb71931a54a` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:29.369095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] RBAC: Authorizing `identity:delete_project(project_id=d581db7fab8244fabab49cb71931a54a)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:29.374383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:29.380279 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:29.416673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e0ee845e-1d87-4b06-9bf7-a2065651fc53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e08b618de24a2f80a88e2b4622219e', 'request_id': 'req-e0ee845e-1d87-4b06-9bf7-a2065651fc53'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:29.435917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e0ee845e-1d87-4b06-9bf7-a2065651fc53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e08b618de24a2f80a88e2b4622219e', 'request_id': 'req-e0ee845e-1d87-4b06-9bf7-a2065651fc53'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:29.450397 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e0ee845e-1d87-4b06-9bf7-a2065651fc53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e08b618de24a2f80a88e2b4622219e', 'request_id': 'req-e0ee845e-1d87-4b06-9bf7-a2065651fc53'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:29.498167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e0ee845e-1d87-4b06-9bf7-a2065651fc53 admin admin] The token cache is being invalidate because project 73e08b618de24a2f80a88e2b4622219e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:29.498700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e0ee845e-1d87-4b06-9bf7-a2065651fc53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:29.507595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e0ee845e-1d87-4b06-9bf7-a2065651fc53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:29.517545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1004/1985] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:29 2022] DELETE /identity/v3/projects/73e08b618de24a2f80a88e2b4622219e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:29.527720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4c770-2330-4888-a10c-c04a6fc825c1 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:29.529491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4c770-2330-4888-a10c-c04a6fc825c1 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:29.530485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4c770-2330-4888-a10c-c04a6fc825c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:29.572174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd581db7fab8244fabab49cb71931a54a', 'request_id': 'req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:29.600862 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd581db7fab8244fabab49cb71931a54a', 'request_id': 'req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:29.620319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd581db7fab8244fabab49cb71931a54a', 'request_id': 'req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:29.640906 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-8bc4c770-2330-4888-a10c-c04a6fc825c1 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:29.643231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8bc4c770-2330-4888-a10c-c04a6fc825c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:29.660379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] The token cache is being invalidate because project d581db7fab8244fabab49cb71931a54a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:29.661300 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:29.667455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:29.679154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 982/1986] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:29 2022] DELETE /identity/v3/projects/d581db7fab8244fabab49cb71931a54a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:29.681486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:29.684376 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:29.864743 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:29.872503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1005/1987] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:29.875267 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c61e-96dd-447c-bae6-720747ab091f None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:29.875564 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c61e-96dd-447c-bae6-720747ab091f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:29.875881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c61e-96dd-447c-bae6-720747ab091f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:29.914314 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce74a7-2df1-4fa7-a0d0-7fd4c63284da admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:29.914722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-dbe5c61e-96dd-447c-bae6-720747ab091f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:29.917494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-dbe5c61e-96dd-447c-bae6-720747ab091f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:29.921940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:29.922937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:29.923373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:29.923803 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] PATH_INFO: `/v3/users/0550a0d9ee8e42b287c7b57f0c37ffda` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:29.925354 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0550a0d9ee8e42b287c7b57f0c37ffda)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:29.928490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:29.939227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1006/1988] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:29.941627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5c61e-96dd-447c-bae6-720747ab091f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:29.961927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5c61e-96dd-447c-bae6-720747ab091f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:29.972815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da138689-5a70-4a59-ba1d-f395c25f09f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:29.974267 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da138689-5a70-4a59-ba1d-f395c25f09f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:29.974994 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da138689-5a70-4a59-ba1d-f395c25f09f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:29.975614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da138689-5a70-4a59-ba1d-f395c25f09f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:29.977131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da138689-5a70-4a59-ba1d-f395c25f09f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:08:29.977820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da138689-5a70-4a59-ba1d-f395c25f09f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:29.983418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da138689-5a70-4a59-ba1d-f395c25f09f5 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:30.020378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1007/1989] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:08:30.027802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da138689-5a70-4a59-ba1d-f395c25f09f5 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:30.060890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da138689-5a70-4a59-ba1d-f395c25f09f5 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:30.072643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd07d3-faa1-4a7c-b187-a23d7ea96396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:30.076104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd07d3-faa1-4a7c-b187-a23d7ea96396 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:30.076770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd07d3-faa1-4a7c-b187-a23d7ea96396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:30.077426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd07d3-faa1-4a7c-b187-a23d7ea96396 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:30.078928 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd07d3-faa1-4a7c-b187-a23d7ea96396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:30.087680 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd07d3-faa1-4a7c-b187-a23d7ea96396 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:30.096892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0550a0d9ee8e42b287c7b57f0c37ffda'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:30.147615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0550a0d9ee8e42b287c7b57f0c37ffda'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:30.191794 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0550a0d9ee8e42b287c7b57f0c37ffda'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:30.197884 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1008/1990] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:30 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:30.200580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd07d3-faa1-4a7c-b187-a23d7ea96396 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:30.203388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0550a0d9ee8e42b287c7b57f0c37ffda'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:30.204865 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-aecd07d3-faa1-4a7c-b187-a23d7ea96396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:30.207540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0550a0d9ee8e42b287c7b57f0c37ffda'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:30.282647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 983/1991] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:29 2022] DELETE /identity/v3/users/0550a0d9ee8e42b287c7b57f0c37ffda => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:30.296439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:30.311194 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:30.464891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd07d3-faa1-4a7c-b187-a23d7ea96396 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:30.520121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:30.648270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683c640-26a8-407e-9446-0e5d6ece0d8a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:30.661016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b74a7-cd22-45d9-b516-7dc15877917c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:30.661555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f47b4-24b5-4e4e-b3c9-6ee6b2174fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:30.663001 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f47b4-24b5-4e4e-b3c9-6ee6b2174fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:30.663758 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f47b4-24b5-4e4e-b3c9-6ee6b2174fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:30.664317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f47b4-24b5-4e4e-b3c9-6ee6b2174fc7 admin admin] PATH_INFO: `/v3/users/580691728ad34d039ebe8776c655f0a2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:30.665537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b74a7-cd22-45d9-b516-7dc15877917c admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:30.666569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b74a7-cd22-45d9-b516-7dc15877917c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:30.667228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b74a7-cd22-45d9-b516-7dc15877917c admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:30.668616 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b74a7-cd22-45d9-b516-7dc15877917c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:30.668909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f47b4-24b5-4e4e-b3c9-6ee6b2174fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=580691728ad34d039ebe8776c655f0a2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:30.673089 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b74a7-cd22-45d9-b516-7dc15877917c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:30.674125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f47b4-24b5-4e4e-b3c9-6ee6b2174fc7 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:30.779897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 984/1992] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:30 2022] POST /identity/v3/users => generated 290 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:30.782381 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b74a7-cd22-45d9-b516-7dc15877917c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:30.821560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b74a7-cd22-45d9-b516-7dc15877917c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:30.832077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c32c6c-271b-4639-b15a-1c8c34a30b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:30.833129 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32c6c-271b-4639-b15a-1c8c34a30b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:30.833607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32c6c-271b-4639-b15a-1c8c34a30b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:30.834663 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32c6c-271b-4639-b15a-1c8c34a30b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:30.836266 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c32c6c-271b-4639-b15a-1c8c34a30b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:30.840150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c32c6c-271b-4639-b15a-1c8c34a30b17 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:30.847969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-867f47b4-24b5-4e4e-b3c9-6ee6b2174fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580691728ad34d039ebe8776c655f0a2'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:30.869491 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 985/1993] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:30.871413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c32c6c-271b-4639-b15a-1c8c34a30b17 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:30.894131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-867f47b4-24b5-4e4e-b3c9-6ee6b2174fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580691728ad34d039ebe8776c655f0a2'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:30.897524 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c32c6c-271b-4639-b15a-1c8c34a30b17 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:30.903684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-867f47b4-24b5-4e4e-b3c9-6ee6b2174fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580691728ad34d039ebe8776c655f0a2'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:30.907068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdfbfb-0002-4826-bfe3-ad1e119f77a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:30.907591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-867f47b4-24b5-4e4e-b3c9-6ee6b2174fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580691728ad34d039ebe8776c655f0a2'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:30.908335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdfbfb-0002-4826-bfe3-ad1e119f77a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:30.908886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdfbfb-0002-4826-bfe3-ad1e119f77a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:30.909523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdfbfb-0002-4826-bfe3-ad1e119f77a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:30.910827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdfbfb-0002-4826-bfe3-ad1e119f77a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:30.914789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdfbfb-0002-4826-bfe3-ad1e119f77a9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:30.938955 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 986/1994] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:30.939652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-867f47b4-24b5-4e4e-b3c9-6ee6b2174fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580691728ad34d039ebe8776c655f0a2'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:30.947308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdfbfb-0002-4826-bfe3-ad1e119f77a9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:30.954542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1fbdfbfb-0002-4826-bfe3-ad1e119f77a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:31.001319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1009/1995] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:30 2022] DELETE /identity/v3/users/580691728ad34d039ebe8776c655f0a2 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:31.002085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdfbfb-0002-4826-bfe3-ad1e119f77a9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:31.003846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348e5d7-1239-45c4-81ef-c9bb3c6bf801 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:31.004333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348e5d7-1239-45c4-81ef-c9bb3c6bf801 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:31.004806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348e5d7-1239-45c4-81ef-c9bb3c6bf801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:31.069444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-5348e5d7-1239-45c4-81ef-c9bb3c6bf801 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:31.073356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5348e5d7-1239-45c4-81ef-c9bb3c6bf801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:31.096019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:31.178960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d075e03-8318-4425-a8a0-5b4eb5a99b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:31.180604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d075e03-8318-4425-a8a0-5b4eb5a99b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:31.181962 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d075e03-8318-4425-a8a0-5b4eb5a99b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:31.182488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d075e03-8318-4425-a8a0-5b4eb5a99b88 admin admin] PATH_INFO: `/v3/projects/fdc3cb6a8c0b415687aea7510e34f8d9/users/cf211a5efb03476fae047605d0907060/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:31.225105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d075e03-8318-4425-a8a0-5b4eb5a99b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc3cb6a8c0b415687aea7510e34f8d9, user_id=cf211a5efb03476fae047605d0907060, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:31.228975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d075e03-8318-4425-a8a0-5b4eb5a99b88 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:31.256976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 987/1996] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:30 2022] PUT /identity/v3/projects/fdc3cb6a8c0b415687aea7510e34f8d9/users/cf211a5efb03476fae047605d0907060/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:31.260070 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1010/1997] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:08:31.276618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760649e-6d39-46a2-85a0-3e335fc8c6d5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:31.276905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760649e-6d39-46a2-85a0-3e335fc8c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:31.277356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760649e-6d39-46a2-85a0-3e335fc8c6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:31.303320 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348e5d7-1239-45c4-81ef-c9bb3c6bf801 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:31.305294 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5348e5d7-1239-45c4-81ef-c9bb3c6bf801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:31.358561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1760649e-6d39-46a2-85a0-3e335fc8c6d5 None None] MFA Rules not processed for user `cf211a5efb03476fae047605d0907060`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:31.362492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1760649e-6d39-46a2-85a0-3e335fc8c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:31.374568 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:31.407066 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348e5d7-1239-45c4-81ef-c9bb3c6bf801 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:31.514417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd91c1-6242-4264-9751-6e33cdb0432a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:31.515215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd91c1-6242-4264-9751-6e33cdb0432a service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:31.515597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd91c1-6242-4264-9751-6e33cdb0432a service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:31.515945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd91c1-6242-4264-9751-6e33cdb0432a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:31.602815 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 988/1998] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:08:31.606383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760649e-6d39-46a2-85a0-3e335fc8c6d5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:31.656357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd91c1-6242-4264-9751-6e33cdb0432a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:31.658602 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd91c1-6242-4264-9751-6e33cdb0432a service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:31.679436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1011/1999] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:31.727910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd91c1-6242-4264-9751-6e33cdb0432a service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:31.734317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ccfd91c1-6242-4264-9751-6e33cdb0432a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:31.804421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd91c1-6242-4264-9751-6e33cdb0432a service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:31.811930 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89d43d-febc-4c3a-8865-dc1355e81081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:31.812996 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89d43d-febc-4c3a-8865-dc1355e81081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:31.813603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89d43d-febc-4c3a-8865-dc1355e81081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:31.814132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89d43d-febc-4c3a-8865-dc1355e81081 admin admin] PATH_INFO: `/v3/projects/4c4c8665cdc1436cb0201ed3fb5dbacf` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:31.816041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89d43d-febc-4c3a-8865-dc1355e81081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4c8665cdc1436cb0201ed3fb5dbacf)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:31.820112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89d43d-febc-4c3a-8865-dc1355e81081 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:31.838191 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760649e-6d39-46a2-85a0-3e335fc8c6d5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:31.850934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46de3b-3456-4301-b6cd-153f6a464bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:31.852272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46de3b-3456-4301-b6cd-153f6a464bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:31.853233 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46de3b-3456-4301-b6cd-153f6a464bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:31.853857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46de3b-3456-4301-b6cd-153f6a464bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:31.856595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46de3b-3456-4301-b6cd-153f6a464bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:31.863529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46de3b-3456-4301-b6cd-153f6a464bf9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:31.907536 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1c89d43d-febc-4c3a-8865-dc1355e81081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4c8665cdc1436cb0201ed3fb5dbacf', 'request_id': 'req-1c89d43d-febc-4c3a-8865-dc1355e81081'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:31.925663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1c89d43d-febc-4c3a-8865-dc1355e81081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4c8665cdc1436cb0201ed3fb5dbacf', 'request_id': 'req-1c89d43d-febc-4c3a-8865-dc1355e81081'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:31.938982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1c89d43d-febc-4c3a-8865-dc1355e81081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4c8665cdc1436cb0201ed3fb5dbacf', 'request_id': 'req-1c89d43d-febc-4c3a-8865-dc1355e81081'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:31.947797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 989/2000] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:31 2022] POST /identity/v3/projects => generated 379 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:08:31.950081 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46de3b-3456-4301-b6cd-153f6a464bf9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:31.972364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1c89d43d-febc-4c3a-8865-dc1355e81081 admin admin] The token cache is being invalidate because project 4c4c8665cdc1436cb0201ed3fb5dbacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:31.972712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1c89d43d-febc-4c3a-8865-dc1355e81081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:31.976609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1c89d43d-febc-4c3a-8865-dc1355e81081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:31.988620 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1012/2001] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:31 2022] DELETE /identity/v3/projects/4c4c8665cdc1436cb0201ed3fb5dbacf => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:31.992844 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459b73-aa0e-4b76-a987-4325a72f5ff5 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:31.993240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459b73-aa0e-4b76-a987-4325a72f5ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:31.993525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459b73-aa0e-4b76-a987-4325a72f5ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:32.031338 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-de459b73-aa0e-4b76-a987-4325a72f5ff5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:32.032729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-de459b73-aa0e-4b76-a987-4325a72f5ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:32.043020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:32.073995 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:32.110730 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46de3b-3456-4301-b6cd-153f6a464bf9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:32.120241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b51d4-2386-4c5a-8c6a-7f9a4c97e86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:32.121974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b51d4-2386-4c5a-8c6a-7f9a4c97e86a admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:32.122348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1013/2002] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:32.129885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b51d4-2386-4c5a-8c6a-7f9a4c97e86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:32.129885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b51d4-2386-4c5a-8c6a-7f9a4c97e86a admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:32.129885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b51d4-2386-4c5a-8c6a-7f9a4c97e86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:32.129885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b51d4-2386-4c5a-8c6a-7f9a4c97e86a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:32.131915 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd5d4c-ea37-4b78-9928-4c73d75274e5 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:32.132290 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd5d4c-ea37-4b78-9928-4c73d75274e5 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:32.132641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd5d4c-ea37-4b78-9928-4c73d75274e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:32.156779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e9bd5d4c-ea37-4b78-9928-4c73d75274e5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:32.158447 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e9bd5d4c-ea37-4b78-9928-4c73d75274e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:32.173540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1014/2003] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:32.174864 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd5d4c-ea37-4b78-9928-4c73d75274e5 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:32.180976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 990/2004] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:31 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:32.182670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b51d4-2386-4c5a-8c6a-7f9a4c97e86a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:32.187017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd5d4c-ea37-4b78-9928-4c73d75274e5 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:32.188101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2e0b51d4-2386-4c5a-8c6a-7f9a4c97e86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:32.192901 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8b0ad-bb03-45a8-9c8c-0e1411f5268f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:32.194129 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8b0ad-bb03-45a8-9c8c-0e1411f5268f admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:32.194535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8b0ad-bb03-45a8-9c8c-0e1411f5268f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:32.194945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8b0ad-bb03-45a8-9c8c-0e1411f5268f admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:32.195719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8b0ad-bb03-45a8-9c8c-0e1411f5268f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:08:32.196126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8b0ad-bb03-45a8-9c8c-0e1411f5268f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:32.197991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8b0ad-bb03-45a8-9c8c-0e1411f5268f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:32.219168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1015/2005] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:08:32.220467 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b51d4-2386-4c5a-8c6a-7f9a4c97e86a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:32.221060 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8b0ad-bb03-45a8-9c8c-0e1411f5268f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:32.232631 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbec0b7-72f0-46ff-a86f-7442fa89bd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:32.235071 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8b0ad-bb03-45a8-9c8c-0e1411f5268f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:32.235369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbec0b7-72f0-46ff-a86f-7442fa89bd69 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:32.236176 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbec0b7-72f0-46ff-a86f-7442fa89bd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:32.236751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbec0b7-72f0-46ff-a86f-7442fa89bd69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:32.238233 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbec0b7-72f0-46ff-a86f-7442fa89bd69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:32.242502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806d50a-d6d4-485c-a926-9671e6c5a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:32.243439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806d50a-d6d4-485c-a926-9671e6c5a1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:32.243593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbec0b7-72f0-46ff-a86f-7442fa89bd69 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:32.244009 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806d50a-d6d4-485c-a926-9671e6c5a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:32.244564 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806d50a-d6d4-485c-a926-9671e6c5a1d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:32.245405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806d50a-d6d4-485c-a926-9671e6c5a1d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:32.248109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806d50a-d6d4-485c-a926-9671e6c5a1d1 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:32.279580 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 991/2006] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:32.281761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbec0b7-72f0-46ff-a86f-7442fa89bd69 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:32.296148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1016/2007] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:32 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:08:32.297578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806d50a-d6d4-485c-a926-9671e6c5a1d1 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:32.306422 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbec0b7-72f0-46ff-a86f-7442fa89bd69 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:32.408350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806d50a-d6d4-485c-a926-9671e6c5a1d1 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:32.415831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896548f-5988-4817-bcba-e133f6746f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:32.416386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896548f-5988-4817-bcba-e133f6746f4b admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:32.416730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896548f-5988-4817-bcba-e133f6746f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:32.417004 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896548f-5988-4817-bcba-e133f6746f4b admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:32.417723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896548f-5988-4817-bcba-e133f6746f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:32.420333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896548f-5988-4817-bcba-e133f6746f4b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:32.445858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fe7d7-988f-4957-8062-031726dca8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:32.447131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fe7d7-988f-4957-8062-031726dca8fe admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:32.447699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fe7d7-988f-4957-8062-031726dca8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:32.448211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fe7d7-988f-4957-8062-031726dca8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:32.449520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fe7d7-988f-4957-8062-031726dca8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:32.452850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fe7d7-988f-4957-8062-031726dca8fe admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:32.454198 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1017/2008] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:32 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:32.488220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896548f-5988-4817-bcba-e133f6746f4b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:32.532784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 992/2009] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:32.557200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fe7d7-988f-4957-8062-031726dca8fe admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:32.562686 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896548f-5988-4817-bcba-e133f6746f4b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:32.612269 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fe7d7-988f-4957-8062-031726dca8fe admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:32.628465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0559d-4b2d-4c92-b3bb-aae7a906161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:32.629562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0559d-4b2d-4c92-b3bb-aae7a906161c admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:32.630144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0559d-4b2d-4c92-b3bb-aae7a906161c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:32.630682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0559d-4b2d-4c92-b3bb-aae7a906161c admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:32.631973 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0559d-4b2d-4c92-b3bb-aae7a906161c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:32.635169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0559d-4b2d-4c92-b3bb-aae7a906161c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:32.635685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0ae52-69a6-4cb2-8332-636932b1149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:32.636942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ae52-69a6-4cb2-8332-636932b1149f admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:32.637581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ae52-69a6-4cb2-8332-636932b1149f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:32.637952 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ae52-69a6-4cb2-8332-636932b1149f admin admin] PATH_INFO: `/v3/projects/8884721aeb764393a6172c89c2b8ad00/users/408018ed241146029d6f2d7e01dfa641/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:32.679779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0ae52-69a6-4cb2-8332-636932b1149f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8884721aeb764393a6172c89c2b8ad00, user_id=408018ed241146029d6f2d7e01dfa641, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:32.687957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0ae52-69a6-4cb2-8332-636932b1149f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:32.719007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1018/2010] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:32.723034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0559d-4b2d-4c92-b3bb-aae7a906161c admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:32.727762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 993/2011] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:32 2022] PUT /identity/v3/projects/8884721aeb764393a6172c89c2b8ad00/users/408018ed241146029d6f2d7e01dfa641/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:32.759638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88062ea2-7106-4824-9117-d5032f221731 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:32.760135 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88062ea2-7106-4824-9117-d5032f221731 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:32.760611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88062ea2-7106-4824-9117-d5032f221731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:32.773681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0559d-4b2d-4c92-b3bb-aae7a906161c admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:32.828105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-88062ea2-7106-4824-9117-d5032f221731 None None] MFA Rules not processed for user `408018ed241146029d6f2d7e01dfa641`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:32.831191 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-88062ea2-7106-4824-9117-d5032f221731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:32.873727 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67879777-02a1-44d2-88c0-2734fa549797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:32.874548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67879777-02a1-44d2-88c0-2734fa549797 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:32.874929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67879777-02a1-44d2-88c0-2734fa549797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:32.875205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67879777-02a1-44d2-88c0-2734fa549797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:32.875877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67879777-02a1-44d2-88c0-2734fa549797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:32.878942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67879777-02a1-44d2-88c0-2734fa549797 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:32.903396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1019/2012] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:32.909267 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67879777-02a1-44d2-88c0-2734fa549797 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:32.923745 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:32.932804 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67879777-02a1-44d2-88c0-2734fa549797 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:32.949894 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bde44-830e-4696-aaff-3bb436bb900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:32.950932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bde44-830e-4696-aaff-3bb436bb900e admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:32.951218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bde44-830e-4696-aaff-3bb436bb900e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:32.951496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bde44-830e-4696-aaff-3bb436bb900e admin admin] PATH_INFO: `/v3/projects/e18489ff54444af58371036af6593900/users/9a2db0e2828a430f88c7a0484445a2c5/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:32.984798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bde44-830e-4696-aaff-3bb436bb900e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18489ff54444af58371036af6593900, user_id=9a2db0e2828a430f88c7a0484445a2c5, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:32.989821 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 994/2013] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:32.996284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88062ea2-7106-4824-9117-d5032f221731 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:32.997921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bde44-830e-4696-aaff-3bb436bb900e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:33.012712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88062ea2-7106-4824-9117-d5032f221731 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:33.019960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d45a1-e283-4c53-9ce7-8bd0578de9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:33.020820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d45a1-e283-4c53-9ce7-8bd0578de9af admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:33.021274 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d45a1-e283-4c53-9ce7-8bd0578de9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:33.022428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d45a1-e283-4c53-9ce7-8bd0578de9af admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:33.024092 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d45a1-e283-4c53-9ce7-8bd0578de9af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:33.027332 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d45a1-e283-4c53-9ce7-8bd0578de9af admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:33.035857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1020/2014] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:32 2022] PUT /identity/v3/projects/e18489ff54444af58371036af6593900/users/9a2db0e2828a430f88c7a0484445a2c5/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:33.044006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87c34b-8ca7-42de-b6d5-15588e8aea58 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:33.044248 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87c34b-8ca7-42de-b6d5-15588e8aea58 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:33.044608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87c34b-8ca7-42de-b6d5-15588e8aea58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:33.049988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:33.076085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 995/2015] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:32 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:33.081797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d45a1-e283-4c53-9ce7-8bd0578de9af admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:33.103747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-2a87c34b-8ca7-42de-b6d5-15588e8aea58 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:33.105044 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2a87c34b-8ca7-42de-b6d5-15588e8aea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:33.221239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d45a1-e283-4c53-9ce7-8bd0578de9af admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:33.224263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1021/2016] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:33.246796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f4d00-a8cc-4caf-a35c-15dff4c46987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:33.248249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f4d00-a8cc-4caf-a35c-15dff4c46987 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:33.251565 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f4d00-a8cc-4caf-a35c-15dff4c46987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:33.252603 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f4d00-a8cc-4caf-a35c-15dff4c46987 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:33.255190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f4d00-a8cc-4caf-a35c-15dff4c46987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:33.267914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f4d00-a8cc-4caf-a35c-15dff4c46987 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:33.318967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87c34b-8ca7-42de-b6d5-15588e8aea58 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:33.322707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2a87c34b-8ca7-42de-b6d5-15588e8aea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:33.344976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 996/2017] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:33 2022] POST /identity/v3/users => generated 295 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:33.346859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f4d00-a8cc-4caf-a35c-15dff4c46987 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:33.369621 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f4d00-a8cc-4caf-a35c-15dff4c46987 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:33.386093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0ffd0-52b0-4e99-9586-eb39c0365d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:33.387790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0ffd0-52b0-4e99-9586-eb39c0365d52 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:33.388554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0ffd0-52b0-4e99-9586-eb39c0365d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:33.389236 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0ffd0-52b0-4e99-9586-eb39c0365d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:33.390820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0ffd0-52b0-4e99-9586-eb39c0365d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:33.395308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0ffd0-52b0-4e99-9586-eb39c0365d52 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:33.420011 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 997/2018] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:33.427224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0ffd0-52b0-4e99-9586-eb39c0365d52 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:33.452585 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0ffd0-52b0-4e99-9586-eb39c0365d52 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:33.455061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87c34b-8ca7-42de-b6d5-15588e8aea58 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:33.464520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95c2db-789a-4664-90e1-c6eef441636a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:33.466493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95c2db-789a-4664-90e1-c6eef441636a service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:33.467010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95c2db-789a-4664-90e1-c6eef441636a service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:33.467474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95c2db-789a-4664-90e1-c6eef441636a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:33.468918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a712c-218b-4b70-9889-5131785011f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:33.470311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a712c-218b-4b70-9889-5131785011f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:33.471014 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a712c-218b-4b70-9889-5131785011f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:33.471842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a712c-218b-4b70-9889-5131785011f0 admin admin] PATH_INFO: `/v3/projects/cc5e238fe6994070b0289fae0d358bf5/users/7b0dbe36e4e947a2a025655319edfe39/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:33.498027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95c2db-789a-4664-90e1-c6eef441636a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:33.501041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95c2db-789a-4664-90e1-c6eef441636a service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:33.511115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a712c-218b-4b70-9889-5131785011f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5e238fe6994070b0289fae0d358bf5, user_id=7b0dbe36e4e947a2a025655319edfe39, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:33.517982 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a712c-218b-4b70-9889-5131785011f0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:33.534238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1022/2019] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:08:33.552436 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 998/2020] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:33 2022] PUT /identity/v3/projects/cc5e238fe6994070b0289fae0d358bf5/users/7b0dbe36e4e947a2a025655319edfe39/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:33.561936 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95c2db-789a-4664-90e1-c6eef441636a service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:33.586838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95c2db-789a-4664-90e1-c6eef441636a service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:33.797751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915120d-9378-41fe-b947-84bd18707a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:33.804240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915120d-9378-41fe-b947-84bd18707a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:33.804698 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915120d-9378-41fe-b947-84bd18707a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:33.805045 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915120d-9378-41fe-b947-84bd18707a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:33.805824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915120d-9378-41fe-b947-84bd18707a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:33.807756 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915120d-9378-41fe-b947-84bd18707a72 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:33.839420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1023/2021] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:33.851221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a712c-218b-4b70-9889-5131785011f0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:33.903617 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a712c-218b-4b70-9889-5131785011f0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:33.909953 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4400d1-56cc-497f-b1fb-b83270169633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:33.910672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4400d1-56cc-497f-b1fb-b83270169633 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:33.910956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4400d1-56cc-497f-b1fb-b83270169633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:33.911235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4400d1-56cc-497f-b1fb-b83270169633 admin admin] PATH_INFO: `/v3/projects/cc5e238fe6994070b0289fae0d358bf5/users/7b0dbe36e4e947a2a025655319edfe39/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:33.916964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4400d1-56cc-497f-b1fb-b83270169633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5e238fe6994070b0289fae0d358bf5, user_id=7b0dbe36e4e947a2a025655319edfe39, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:33.927127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4400d1-56cc-497f-b1fb-b83270169633 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:33.936910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915120d-9378-41fe-b947-84bd18707a72 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:33.944138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8915120d-9378-41fe-b947-84bd18707a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:33.996008 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 999/2022] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:33 2022] PUT /identity/v3/projects/cc5e238fe6994070b0289fae0d358bf5/users/7b0dbe36e4e947a2a025655319edfe39/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:33.998889 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915120d-9378-41fe-b947-84bd18707a72 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:34.021079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ed5cf-3ba2-4a7b-aecf-ac7f7eea6ee1 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:34.021416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ed5cf-3ba2-4a7b-aecf-ac7f7eea6ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:34.021762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ed5cf-3ba2-4a7b-aecf-ac7f7eea6ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:34.051473 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:34.090789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-700ed5cf-3ba2-4a7b-aecf-ac7f7eea6ee1 None None] MFA Rules not processed for user `7b0dbe36e4e947a2a025655319edfe39`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:34.092280 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-700ed5cf-3ba2-4a7b-aecf-ac7f7eea6ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:34.236101 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:34.237477 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:34.238147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:34.238898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] PATH_INFO: `/v3/projects/de7d2d6dc9994976adb96d1736a84783` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:34.243227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=de7d2d6dc9994976adb96d1736a84783)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:34.250100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1000/2023] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:34.251033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:34.266087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ed5cf-3ba2-4a7b-aecf-ac7f7eea6ee1 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:34.268404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-700ed5cf-3ba2-4a7b-aecf-ac7f7eea6ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:34.304648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:34.385985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7d2d6dc9994976adb96d1736a84783', 'request_id': 'req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:34.406213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ed5cf-3ba2-4a7b-aecf-ac7f7eea6ee1 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:34.422538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7d2d6dc9994976adb96d1736a84783', 'request_id': 'req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:34.437870 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7d2d6dc9994976adb96d1736a84783', 'request_id': 'req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:34.483775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] The token cache is being invalidate because project de7d2d6dc9994976adb96d1736a84783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:34.485612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:34.487992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:34.501379 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1024/2024] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:33 2022] DELETE /identity/v3/projects/de7d2d6dc9994976adb96d1736a84783 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:08:34.506572 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:34.509581 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:34.531889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcf8db-e8a5-4e81-9238-821d756006d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:34.532770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcf8db-e8a5-4e81-9238-821d756006d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:34.532863 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcf8db-e8a5-4e81-9238-821d756006d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:34.534047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcf8db-e8a5-4e81-9238-821d756006d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:34.537481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3dbcf8db-e8a5-4e81-9238-821d756006d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:34.644560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcf8db-e8a5-4e81-9238-821d756006d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:34.646123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcf8db-e8a5-4e81-9238-821d756006d5 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:34.661234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1001/2025] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:34.739105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcf8db-e8a5-4e81-9238-821d756006d5 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:34.753502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3dbcf8db-e8a5-4e81-9238-821d756006d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:34.815034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcf8db-e8a5-4e81-9238-821d756006d5 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:34.825174 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef306a00-1dc0-4631-bbd2-a8a8e20f6aff admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:34.834718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312a797-96ab-46b6-9d62-4e162ebe8413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:34.836331 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312a797-96ab-46b6-9d62-4e162ebe8413 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:34.837354 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312a797-96ab-46b6-9d62-4e162ebe8413 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:34.838667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312a797-96ab-46b6-9d62-4e162ebe8413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:34.846911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f312a797-96ab-46b6-9d62-4e162ebe8413 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:34.847882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:34.853634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:34.856055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:34.856467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] PATH_INFO: `/v3/users/ac1e4fb9f25649cd96451616187de49d` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:34.859108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1e4fb9f25649cd96451616187de49d)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:34.873292 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:34.993765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1e4fb9f25649cd96451616187de49d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:34.999435 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:35.012961 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1e4fb9f25649cd96451616187de49d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:35.014088 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1e4fb9f25649cd96451616187de49d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:35.015083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1e4fb9f25649cd96451616187de49d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:35.050562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1e4fb9f25649cd96451616187de49d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:35.095353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1025/2026] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:34 2022] DELETE /identity/v3/users/ac1e4fb9f25649cd96451616187de49d => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:35.118269 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312a797-96ab-46b6-9d62-4e162ebe8413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:35.119799 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312a797-96ab-46b6-9d62-4e162ebe8413 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:35.132158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1002/2027] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:08:35.889519 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:35.893849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:36.091162 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65d402-1893-4e9e-885e-edbd84d274e6 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:36.098807 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:36.101309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:36.101717 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:36.101891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] PATH_INFO: `/v3/projects/d63facba736441fbae314e9d8675b471` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:36.104011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63facba736441fbae314e9d8675b471)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:36.106588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:36.199423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63facba736441fbae314e9d8675b471', 'request_id': 'req-33ffd3ba-40fb-45f7-94a7-358675072dec'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:36.216815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63facba736441fbae314e9d8675b471', 'request_id': 'req-33ffd3ba-40fb-45f7-94a7-358675072dec'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:36.228856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63facba736441fbae314e9d8675b471', 'request_id': 'req-33ffd3ba-40fb-45f7-94a7-358675072dec'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:36.247415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] The token cache is being invalidate because project d63facba736441fbae314e9d8675b471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:36.247786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:36.250785 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:36.253048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1026/2028] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:35 2022] DELETE /identity/v3/projects/d63facba736441fbae314e9d8675b471 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:36.258434 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312a797-96ab-46b6-9d62-4e162ebe8413 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:36.274295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312a797-96ab-46b6-9d62-4e162ebe8413 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:36.337481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:36.441945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba86c0a-5c20-44b7-9524-63aba0191362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:36.442996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba86c0a-5c20-44b7-9524-63aba0191362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:36.444368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba86c0a-5c20-44b7-9524-63aba0191362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:36.444897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba86c0a-5c20-44b7-9524-63aba0191362 admin admin] PATH_INFO: `/v3/users/8977349f12bc41139cf79550190891c4` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:36.446482 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba86c0a-5c20-44b7-9524-63aba0191362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8977349f12bc41139cf79550190891c4)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:36.448809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba86c0a-5c20-44b7-9524-63aba0191362 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:36.551036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7ba86c0a-5c20-44b7-9524-63aba0191362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8977349f12bc41139cf79550190891c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:36.574556 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7ba86c0a-5c20-44b7-9524-63aba0191362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8977349f12bc41139cf79550190891c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:36.588334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7ba86c0a-5c20-44b7-9524-63aba0191362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8977349f12bc41139cf79550190891c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:36.590689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7ba86c0a-5c20-44b7-9524-63aba0191362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8977349f12bc41139cf79550190891c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:36.592681 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7ba86c0a-5c20-44b7-9524-63aba0191362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8977349f12bc41139cf79550190891c4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:36.632068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1003/2029] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:36 2022] DELETE /identity/v3/users/8977349f12bc41139cf79550190891c4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:37.801083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:37.812043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:37.893878 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffd3ba-40fb-45f7-94a7-358675072dec admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:38.107482 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41387e-d7f4-475f-b13c-dd73d6abf950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:38.108599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41387e-d7f4-475f-b13c-dd73d6abf950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:38.109071 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41387e-d7f4-475f-b13c-dd73d6abf950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:38.109544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41387e-d7f4-475f-b13c-dd73d6abf950 admin admin] PATH_INFO: `/v3/projects/4cb7a271184d4b708378abbf5ceda284` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:38.111942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41387e-d7f4-475f-b13c-dd73d6abf950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb7a271184d4b708378abbf5ceda284)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:38.117044 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41387e-d7f4-475f-b13c-dd73d6abf950 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:38.120835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:38.279071 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cf41387e-d7f4-475f-b13c-dd73d6abf950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb7a271184d4b708378abbf5ceda284', 'request_id': 'req-cf41387e-d7f4-475f-b13c-dd73d6abf950'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:38.307301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cf41387e-d7f4-475f-b13c-dd73d6abf950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb7a271184d4b708378abbf5ceda284', 'request_id': 'req-cf41387e-d7f4-475f-b13c-dd73d6abf950'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:38.333020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cf41387e-d7f4-475f-b13c-dd73d6abf950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb7a271184d4b708378abbf5ceda284', 'request_id': 'req-cf41387e-d7f4-475f-b13c-dd73d6abf950'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:38.370278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cf41387e-d7f4-475f-b13c-dd73d6abf950 admin admin] The token cache is being invalidate because project 4cb7a271184d4b708378abbf5ceda284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:38.371148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cf41387e-d7f4-475f-b13c-dd73d6abf950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:38.374351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cf41387e-d7f4-475f-b13c-dd73d6abf950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:38.384098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1027/2030] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:37 2022] DELETE /identity/v3/projects/4cb7a271184d4b708378abbf5ceda284 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:38.386483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd08b1-8041-4123-9213-5e5c96e6dc5c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:38.387614 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd08b1-8041-4123-9213-5e5c96e6dc5c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:38.388039 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd08b1-8041-4123-9213-5e5c96e6dc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:38.497736 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f0cd08b1-8041-4123-9213-5e5c96e6dc5c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:38.499912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f0cd08b1-8041-4123-9213-5e5c96e6dc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:38.672812 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1004/2031] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:38.683470 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb1527-c31e-4d2c-873f-d1f20641a9c8 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:38.683791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb1527-c31e-4d2c-873f-d1f20641a9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:38.684526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb1527-c31e-4d2c-873f-d1f20641a9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:38.722601 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-edcb1527-c31e-4d2c-873f-d1f20641a9c8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:38.726698 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-edcb1527-c31e-4d2c-873f-d1f20641a9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:38.744150 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd08b1-8041-4123-9213-5e5c96e6dc5c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:38.754873 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1028/2032] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:08:38.762130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd08b1-8041-4123-9213-5e5c96e6dc5c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:38.770081 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed7663-03d9-47db-8e44-0c0fe3a27d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:38.771137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed7663-03d9-47db-8e44-0c0fe3a27d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:38.772130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed7663-03d9-47db-8e44-0c0fe3a27d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:38.772556 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed7663-03d9-47db-8e44-0c0fe3a27d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:38.773708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed7663-03d9-47db-8e44-0c0fe3a27d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:08:38.774202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed7663-03d9-47db-8e44-0c0fe3a27d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:38.779748 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed7663-03d9-47db-8e44-0c0fe3a27d46 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:38.819310 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1005/2033] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:08:38.823970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb1527-c31e-4d2c-873f-d1f20641a9c8 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:38.843557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb1527-c31e-4d2c-873f-d1f20641a9c8 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:38.850696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b5504-8d29-49d7-a835-39079117c8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:38.851499 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b5504-8d29-49d7-a835-39079117c8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:38.851775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b5504-8d29-49d7-a835-39079117c8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:38.852053 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b5504-8d29-49d7-a835-39079117c8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:38.852795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b5504-8d29-49d7-a835-39079117c8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:38.854924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b5504-8d29-49d7-a835-39079117c8d4 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:38.904198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed7663-03d9-47db-8e44-0c0fe3a27d46 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:38.910257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1029/2034] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:38 2022] POST /identity/v3/projects => generated 409 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:38.916032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed7663-03d9-47db-8e44-0c0fe3a27d46 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:38.966160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:39.038921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ca7e9-67f0-4e63-8993-cf49faed386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:39.040596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ca7e9-67f0-4e63-8993-cf49faed386b admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:39.040596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ca7e9-67f0-4e63-8993-cf49faed386b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:39.040994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ca7e9-67f0-4e63-8993-cf49faed386b admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:39.042027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ca7e9-67f0-4e63-8993-cf49faed386b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:39.045782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ca7e9-67f0-4e63-8993-cf49faed386b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:39.088302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1006/2035] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:38 2022] POST /identity/v3/users => generated 305 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:39.094008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b5504-8d29-49d7-a835-39079117c8d4 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:39.135331 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b5504-8d29-49d7-a835-39079117c8d4 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:39.151821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d75a7-4e5b-4417-97d1-172e6509ccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:39.152842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d75a7-4e5b-4417-97d1-172e6509ccee admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:39.153542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d75a7-4e5b-4417-97d1-172e6509ccee admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:39.154030 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d75a7-4e5b-4417-97d1-172e6509ccee admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:39.156689 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d75a7-4e5b-4417-97d1-172e6509ccee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:39.161224 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d75a7-4e5b-4417-97d1-172e6509ccee admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:39.264332 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ca7e9-67f0-4e63-8993-cf49faed386b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:39.265567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1030/2036] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:39.283190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ca7e9-67f0-4e63-8993-cf49faed386b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:39.299010 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c81f0c-f869-4ce9-b56c-4358e2b3d063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:39.299921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c81f0c-f869-4ce9-b56c-4358e2b3d063 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:39.300221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c81f0c-f869-4ce9-b56c-4358e2b3d063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:39.311080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c81f0c-f869-4ce9-b56c-4358e2b3d063 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:39.312289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c81f0c-f869-4ce9-b56c-4358e2b3d063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:39.314052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c81f0c-f869-4ce9-b56c-4358e2b3d063 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:39.362946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1007/2037] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:39.367563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d75a7-4e5b-4417-97d1-172e6509ccee admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:39.395884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c81f0c-f869-4ce9-b56c-4358e2b3d063 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:39.399159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-52c81f0c-f869-4ce9-b56c-4358e2b3d063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:39.418005 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d75a7-4e5b-4417-97d1-172e6509ccee admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:39.431250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33fce7-b10e-4a91-be18-bfcca9b1d7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:39.431861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c81f0c-f869-4ce9-b56c-4358e2b3d063 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:39.432417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33fce7-b10e-4a91-be18-bfcca9b1d7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:39.432912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33fce7-b10e-4a91-be18-bfcca9b1d7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:39.433396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33fce7-b10e-4a91-be18-bfcca9b1d7d4 admin admin] PATH_INFO: `/v3/projects/5a865299e01443e6ae94ee2c77ff25a6/users/8940e14dfab046a8b810d06c74082d07/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:39.444263 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da3d99-ac96-46da-ac67-fbb7979d4e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:39.445364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3d99-ac96-46da-ac67-fbb7979d4e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:39.445858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3d99-ac96-46da-ac67-fbb7979d4e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:39.446301 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3d99-ac96-46da-ac67-fbb7979d4e24 admin admin] PATH_INFO: `/v3/users/cf211a5efb03476fae047605d0907060` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:39.456728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da3d99-ac96-46da-ac67-fbb7979d4e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf211a5efb03476fae047605d0907060)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:39.459605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da3d99-ac96-46da-ac67-fbb7979d4e24 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:39.498593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33fce7-b10e-4a91-be18-bfcca9b1d7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a865299e01443e6ae94ee2c77ff25a6, user_id=8940e14dfab046a8b810d06c74082d07, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:39.508967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33fce7-b10e-4a91-be18-bfcca9b1d7d4 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:39.571059 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1031/2038] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:39 2022] PUT /identity/v3/projects/5a865299e01443e6ae94ee2c77ff25a6/users/8940e14dfab046a8b810d06c74082d07/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:39.575286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f10975-9d5e-45f3-acb5-bf0f201712e4 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:39.576073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f10975-9d5e-45f3-acb5-bf0f201712e4 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:39.576597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f10975-9d5e-45f3-acb5-bf0f201712e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:39.683378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-38f10975-9d5e-45f3-acb5-bf0f201712e4 None None] MFA Rules not processed for user `8940e14dfab046a8b810d06c74082d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:39.691786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-38f10975-9d5e-45f3-acb5-bf0f201712e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:39.698901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-10da3d99-ac96-46da-ac67-fbb7979d4e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf211a5efb03476fae047605d0907060'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:39.758616 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-10da3d99-ac96-46da-ac67-fbb7979d4e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf211a5efb03476fae047605d0907060'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:39.795719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-10da3d99-ac96-46da-ac67-fbb7979d4e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf211a5efb03476fae047605d0907060'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:39.796834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-10da3d99-ac96-46da-ac67-fbb7979d4e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf211a5efb03476fae047605d0907060'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:39.797970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-10da3d99-ac96-46da-ac67-fbb7979d4e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf211a5efb03476fae047605d0907060'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:39.847920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1008/2039] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:39 2022] DELETE /identity/v3/users/cf211a5efb03476fae047605d0907060 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:39.851258 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efe864-b946-4aff-82c6-4c7d52ae0c92 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:39.851743 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efe864-b946-4aff-82c6-4c7d52ae0c92 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:39.852208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efe864-b946-4aff-82c6-4c7d52ae0c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:39.926217 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-17efe864-b946-4aff-82c6-4c7d52ae0c92 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:39.928789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-17efe864-b946-4aff-82c6-4c7d52ae0c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:39.985442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1032/2040] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:39 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:39.992028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f10975-9d5e-45f3-acb5-bf0f201712e4 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:39.994812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-38f10975-9d5e-45f3-acb5-bf0f201712e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:40.028700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:40.154869 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f10975-9d5e-45f3-acb5-bf0f201712e4 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:40.247328 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1009/2041] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:40.340952 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efe864-b946-4aff-82c6-4c7d52ae0c92 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:40.342669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-17efe864-b946-4aff-82c6-4c7d52ae0c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:40.420223 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:40.465104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde60f70-f5e2-4327-8a11-fa9667ffa096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:40.465757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde60f70-f5e2-4327-8a11-fa9667ffa096 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:40.466042 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde60f70-f5e2-4327-8a11-fa9667ffa096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:40.466319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde60f70-f5e2-4327-8a11-fa9667ffa096 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:40.467069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde60f70-f5e2-4327-8a11-fa9667ffa096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:40.469101 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde60f70-f5e2-4327-8a11-fa9667ffa096 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:40.559231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efe864-b946-4aff-82c6-4c7d52ae0c92 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:40.581990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e7ae0-2dbc-4de2-bd4d-c2d47e222db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:40.585276 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7ae0-2dbc-4de2-bd4d-c2d47e222db8 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:40.586071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7ae0-2dbc-4de2-bd4d-c2d47e222db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:40.586779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7ae0-2dbc-4de2-bd4d-c2d47e222db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:40.604824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1033/2042] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:39 2022] POST /identity/v3/projects => generated 409 bytes in 615 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:40.605822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde60f70-f5e2-4327-8a11-fa9667ffa096 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:40.628189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e7ae0-2dbc-4de2-bd4d-c2d47e222db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:40.631287 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e7ae0-2dbc-4de2-bd4d-c2d47e222db8 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:40.675380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1010/2043] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:08:40.830569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde60f70-f5e2-4327-8a11-fa9667ffa096 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:40.841717 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875946c-4a54-49b1-a3d4-e387051b18d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:40.842679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875946c-4a54-49b1-a3d4-e387051b18d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:40.843237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875946c-4a54-49b1-a3d4-e387051b18d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:40.844125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875946c-4a54-49b1-a3d4-e387051b18d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:40.844745 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875946c-4a54-49b1-a3d4-e387051b18d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:40.848753 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875946c-4a54-49b1-a3d4-e387051b18d9 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:40.896426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1034/2044] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:40 2022] POST /identity/v3/users => generated 311 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:40.901291 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e7ae0-2dbc-4de2-bd4d-c2d47e222db8 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:40.921159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e7ae0-2dbc-4de2-bd4d-c2d47e222db8 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:40.931888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060e358-16dc-4b36-af56-9aac92ffb13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:40.933833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e358-16dc-4b36-af56-9aac92ffb13d admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:40.934463 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e358-16dc-4b36-af56-9aac92ffb13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:40.934950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e358-16dc-4b36-af56-9aac92ffb13d admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:40.936672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060e358-16dc-4b36-af56-9aac92ffb13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:40.942907 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060e358-16dc-4b36-af56-9aac92ffb13d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:40.978970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1011/2045] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:40.983605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875946c-4a54-49b1-a3d4-e387051b18d9 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:41.004306 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875946c-4a54-49b1-a3d4-e387051b18d9 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:41.011816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad313a-56a6-4e5a-a3c1-a060f0d4f511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:41.012779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad313a-56a6-4e5a-a3c1-a060f0d4f511 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:41.013073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad313a-56a6-4e5a-a3c1-a060f0d4f511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:41.013360 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad313a-56a6-4e5a-a3c1-a060f0d4f511 admin admin] PATH_INFO: `/v3/projects/ae4433a91cbe4580b19a7ac0a2bb0df3/users/25b8832d2cae4da4926892cee027d0ec/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:41.043771 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad313a-56a6-4e5a-a3c1-a060f0d4f511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4433a91cbe4580b19a7ac0a2bb0df3, user_id=25b8832d2cae4da4926892cee027d0ec, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:41.047275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad313a-56a6-4e5a-a3c1-a060f0d4f511 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:41.075540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060e358-16dc-4b36-af56-9aac92ffb13d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:41.085388 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1035/2046] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:40 2022] PUT /identity/v3/projects/ae4433a91cbe4580b19a7ac0a2bb0df3/users/25b8832d2cae4da4926892cee027d0ec/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:08:41.090318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060e358-16dc-4b36-af56-9aac92ffb13d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:41.228228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee54ae2-4a6b-4fbc-ae81-0f9690839cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:41.229397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee54ae2-4a6b-4fbc-ae81-0f9690839cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:41.229796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee54ae2-4a6b-4fbc-ae81-0f9690839cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:41.230251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee54ae2-4a6b-4fbc-ae81-0f9690839cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:41.231899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee54ae2-4a6b-4fbc-ae81-0f9690839cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:41.236336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee54ae2-4a6b-4fbc-ae81-0f9690839cd0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:41.260025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1012/2047] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:41.265187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad313a-56a6-4e5a-a3c1-a060f0d4f511 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:41.316145 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad313a-56a6-4e5a-a3c1-a060f0d4f511 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:41.339646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5dd3b-6ecb-4a3a-bf6e-37677fc6085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:41.341141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5dd3b-6ecb-4a3a-bf6e-37677fc6085f admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:41.341832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5dd3b-6ecb-4a3a-bf6e-37677fc6085f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:41.342315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5dd3b-6ecb-4a3a-bf6e-37677fc6085f admin admin] PATH_INFO: `/v3/projects/ae4433a91cbe4580b19a7ac0a2bb0df3/users/25b8832d2cae4da4926892cee027d0ec/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:41.350026 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5dd3b-6ecb-4a3a-bf6e-37677fc6085f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4433a91cbe4580b19a7ac0a2bb0df3, user_id=25b8832d2cae4da4926892cee027d0ec, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:41.359150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5dd3b-6ecb-4a3a-bf6e-37677fc6085f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:41.374836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:41.388513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1036/2048] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:41 2022] PUT /identity/v3/projects/ae4433a91cbe4580b19a7ac0a2bb0df3/users/25b8832d2cae4da4926892cee027d0ec/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:41.400978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854332c2-5a40-4480-b783-f230af96bfa0 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:41.401552 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854332c2-5a40-4480-b783-f230af96bfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:41.402129 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854332c2-5a40-4480-b783-f230af96bfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:41.445541 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-854332c2-5a40-4480-b783-f230af96bfa0 None None] MFA Rules not processed for user `25b8832d2cae4da4926892cee027d0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:41.449028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-854332c2-5a40-4480-b783-f230af96bfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:41.566846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1013/2049] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:41 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:41.578865 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5dd3b-6ecb-4a3a-bf6e-37677fc6085f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:41.581212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-bbf5dd3b-6ecb-4a3a-bf6e-37677fc6085f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:41.701867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5dd3b-6ecb-4a3a-bf6e-37677fc6085f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:41.709910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae4857-a1ca-4f88-abd2-5848c6777c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:41.711508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4857-a1ca-4f88-abd2-5848c6777c67 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:41.712040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4857-a1ca-4f88-abd2-5848c6777c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:41.712589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4857-a1ca-4f88-abd2-5848c6777c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:41.735330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae4857-a1ca-4f88-abd2-5848c6777c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:41.738510 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae4857-a1ca-4f88-abd2-5848c6777c67 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:41.768815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1037/2050] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:41 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:41.980706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854332c2-5a40-4480-b783-f230af96bfa0 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:41.983335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-854332c2-5a40-4480-b783-f230af96bfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:42.036150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae4857-a1ca-4f88-abd2-5848c6777c67 service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:42.053726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae4857-a1ca-4f88-abd2-5848c6777c67 service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:42.060466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ae937-dff4-4833-9e81-9bfd1787659d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:42.061823 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae937-dff4-4833-9e81-9bfd1787659d service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:42.061823 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae937-dff4-4833-9e81-9bfd1787659d service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:42.061823 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae937-dff4-4833-9e81-9bfd1787659d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:42.148016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:42.243854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854332c2-5a40-4480-b783-f230af96bfa0 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:42.269925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ae937-dff4-4833-9e81-9bfd1787659d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:42.276208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ae937-dff4-4833-9e81-9bfd1787659d service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:42.286980 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:42.291121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:42.291688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:42.292300 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] PATH_INFO: `/v3/projects/fdc3cb6a8c0b415687aea7510e34f8d9` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:42.295833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc3cb6a8c0b415687aea7510e34f8d9)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:42.297882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:42.301141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1038/2051] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:42 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:08:42.424050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc3cb6a8c0b415687aea7510e34f8d9', 'request_id': 'req-83e61c8a-5baa-4fa4-b492-b74710832d72'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:42.444472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc3cb6a8c0b415687aea7510e34f8d9', 'request_id': 'req-83e61c8a-5baa-4fa4-b492-b74710832d72'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:42.465302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc3cb6a8c0b415687aea7510e34f8d9', 'request_id': 'req-83e61c8a-5baa-4fa4-b492-b74710832d72'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:42.494438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] The token cache is being invalidate because project fdc3cb6a8c0b415687aea7510e34f8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:42.494788 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:42.501873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:42.509267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1014/2052] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:41 2022] DELETE /identity/v3/projects/fdc3cb6a8c0b415687aea7510e34f8d9 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:42.509556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ae937-dff4-4833-9e81-9bfd1787659d service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:42.536007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ae937-dff4-4833-9e81-9bfd1787659d service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:42.772938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:42.773373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:42.773662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:42.773995 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] PATH_INFO: `/v3/users/408018ed241146029d6f2d7e01dfa641` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:42.775796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=408018ed241146029d6f2d7e01dfa641)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:42.781687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:42.853791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:42.858445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408018ed241146029d6f2d7e01dfa641'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:42.874356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408018ed241146029d6f2d7e01dfa641'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:42.875392 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408018ed241146029d6f2d7e01dfa641'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:42.876531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408018ed241146029d6f2d7e01dfa641'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:42.901672 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408018ed241146029d6f2d7e01dfa641'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:42.922409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1039/2053] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:42 2022] DELETE /identity/v3/users/408018ed241146029d6f2d7e01dfa641 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:43.808789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:43.811971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:43.862521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e61c8a-5baa-4fa4-b492-b74710832d72 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:44.010802 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:44.012852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:44.013318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:44.013775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] PATH_INFO: `/v3/projects/8884721aeb764393a6172c89c2b8ad00` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:44.016554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8884721aeb764393a6172c89c2b8ad00)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:44.020012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:44.128253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8884721aeb764393a6172c89c2b8ad00', 'request_id': 'req-6400b910-f067-4825-9825-8e8daa2a8b68'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:44.144394 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8884721aeb764393a6172c89c2b8ad00', 'request_id': 'req-6400b910-f067-4825-9825-8e8daa2a8b68'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:44.163240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8884721aeb764393a6172c89c2b8ad00', 'request_id': 'req-6400b910-f067-4825-9825-8e8daa2a8b68'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:44.165135 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:44.188687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] The token cache is being invalidate because project 8884721aeb764393a6172c89c2b8ad00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:44.190174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:44.191254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:44.194780 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1015/2054] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:43 2022] DELETE /identity/v3/projects/8884721aeb764393a6172c89c2b8ad00 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:44.201337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:44.203816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:44.241185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18045d13-2a16-4cbb-abbe-14bae956fea8 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:44.407091 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279df98-a71a-4872-a410-840375e0f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:44.411265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279df98-a71a-4872-a410-840375e0f408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:44.412230 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279df98-a71a-4872-a410-840375e0f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:44.412540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279df98-a71a-4872-a410-840375e0f408 admin admin] PATH_INFO: `/v3/users/7b0dbe36e4e947a2a025655319edfe39` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:44.416002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279df98-a71a-4872-a410-840375e0f408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0dbe36e4e947a2a025655319edfe39)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:44.420746 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279df98-a71a-4872-a410-840375e0f408 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:44.579577 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5279df98-a71a-4872-a410-840375e0f408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0dbe36e4e947a2a025655319edfe39'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:44.609528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5279df98-a71a-4872-a410-840375e0f408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0dbe36e4e947a2a025655319edfe39'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:44.610929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5279df98-a71a-4872-a410-840375e0f408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0dbe36e4e947a2a025655319edfe39'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:44.611860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5279df98-a71a-4872-a410-840375e0f408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0dbe36e4e947a2a025655319edfe39'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:44.670605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5279df98-a71a-4872-a410-840375e0f408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0dbe36e4e947a2a025655319edfe39'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:44.706701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1040/2055] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:44 2022] DELETE /identity/v3/users/7b0dbe36e4e947a2a025655319edfe39 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:45.549326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:45.555294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:45.592744 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400b910-f067-4825-9825-8e8daa2a8b68 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:45.757082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74a8c0-91fc-459e-b107-73ecf41439b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:45.757904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74a8c0-91fc-459e-b107-73ecf41439b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:45.758339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74a8c0-91fc-459e-b107-73ecf41439b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:45.758662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74a8c0-91fc-459e-b107-73ecf41439b3 admin admin] PATH_INFO: `/v3/projects/cc5e238fe6994070b0289fae0d358bf5` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:45.760321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74a8c0-91fc-459e-b107-73ecf41439b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5e238fe6994070b0289fae0d358bf5)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:45.763861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74a8c0-91fc-459e-b107-73ecf41439b3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:45.916697 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f74a8c0-91fc-459e-b107-73ecf41439b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5e238fe6994070b0289fae0d358bf5', 'request_id': 'req-2f74a8c0-91fc-459e-b107-73ecf41439b3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:45.926399 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f74a8c0-91fc-459e-b107-73ecf41439b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5e238fe6994070b0289fae0d358bf5', 'request_id': 'req-2f74a8c0-91fc-459e-b107-73ecf41439b3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:45.946095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f74a8c0-91fc-459e-b107-73ecf41439b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5e238fe6994070b0289fae0d358bf5', 'request_id': 'req-2f74a8c0-91fc-459e-b107-73ecf41439b3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:45.964992 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f74a8c0-91fc-459e-b107-73ecf41439b3 admin admin] The token cache is being invalidate because project cc5e238fe6994070b0289fae0d358bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:45.965404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f74a8c0-91fc-459e-b107-73ecf41439b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:45.967160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2f74a8c0-91fc-459e-b107-73ecf41439b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:45.977885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1016/2056] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:45 2022] DELETE /identity/v3/projects/cc5e238fe6994070b0289fae0d358bf5 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:45.983201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4fc1b-64a5-43f0-925c-37dc145530f9 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:45.983948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4fc1b-64a5-43f0-925c-37dc145530f9 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:45.984234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4fc1b-64a5-43f0-925c-37dc145530f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:46.084713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-d6b4fc1b-64a5-43f0-925c-37dc145530f9 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:46.089926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d6b4fc1b-64a5-43f0-925c-37dc145530f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:46.286444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:46.437889 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1041/2057] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:46.439798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c35b9-2174-449a-9fa0-339c6e21ac22 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:46.440227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c35b9-2174-449a-9fa0-339c6e21ac22 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:46.440514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c35b9-2174-449a-9fa0-339c6e21ac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:46.539382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-173c35b9-2174-449a-9fa0-339c6e21ac22 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:46.540670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-173c35b9-2174-449a-9fa0-339c6e21ac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:46.583511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1017/2058] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:46.589972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4fc1b-64a5-43f0-925c-37dc145530f9 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:46.616176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4fc1b-64a5-43f0-925c-37dc145530f9 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:46.644854 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efd52f-6451-4fb7-ae95-1767a4fab847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:46.652533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efd52f-6451-4fb7-ae95-1767a4fab847 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:46.655008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efd52f-6451-4fb7-ae95-1767a4fab847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:46.655756 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efd52f-6451-4fb7-ae95-1767a4fab847 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:46.657924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efd52f-6451-4fb7-ae95-1767a4fab847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:08:46.658619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efd52f-6451-4fb7-ae95-1767a4fab847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:46.663362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efd52f-6451-4fb7-ae95-1767a4fab847 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:46.697423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1042/2059] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:08:46.698293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c35b9-2174-449a-9fa0-339c6e21ac22 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:46.717045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c35b9-2174-449a-9fa0-339c6e21ac22 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:46.744217 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9567fbb-868d-4b21-b936-09b82bed0c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:46.745136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9567fbb-868d-4b21-b936-09b82bed0c95 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:46.745424 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9567fbb-868d-4b21-b936-09b82bed0c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:46.745740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9567fbb-868d-4b21-b936-09b82bed0c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:46.754886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9567fbb-868d-4b21-b936-09b82bed0c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:46.758581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9567fbb-868d-4b21-b936-09b82bed0c95 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:46.849026 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1018/2060] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:46 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:46.855241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efd52f-6451-4fb7-ae95-1767a4fab847 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:46.877738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efd52f-6451-4fb7-ae95-1767a4fab847 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:47.133282 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770ffeb-37d9-4782-964f-9219e0f25b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:47.134669 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ffeb-37d9-4782-964f-9219e0f25b43 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:47.135194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ffeb-37d9-4782-964f-9219e0f25b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:47.135908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ffeb-37d9-4782-964f-9219e0f25b43 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:47.136924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770ffeb-37d9-4782-964f-9219e0f25b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:47.139286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770ffeb-37d9-4782-964f-9219e0f25b43 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:47.183942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1043/2061] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:46 2022] POST /identity/v3/users => generated 284 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:08:47.190300 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9567fbb-868d-4b21-b936-09b82bed0c95 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:47.215433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9567fbb-868d-4b21-b936-09b82bed0c95 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:47.237573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970259-b1fe-439f-b60c-09c9f91ee6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:47.239430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970259-b1fe-439f-b60c-09c9f91ee6db admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:47.240727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970259-b1fe-439f-b60c-09c9f91ee6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:47.241723 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970259-b1fe-439f-b60c-09c9f91ee6db admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:47.243471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37970259-b1fe-439f-b60c-09c9f91ee6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:47.247157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37970259-b1fe-439f-b60c-09c9f91ee6db admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:47.286604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1019/2062] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:47.293389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770ffeb-37d9-4782-964f-9219e0f25b43 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:47.333430 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770ffeb-37d9-4782-964f-9219e0f25b43 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:47.349814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900ef98-eb4a-45c8-a6d3-b51e3753a9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:47.352527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ef98-eb4a-45c8-a6d3-b51e3753a9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:47.353149 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ef98-eb4a-45c8-a6d3-b51e3753a9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:47.353627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ef98-eb4a-45c8-a6d3-b51e3753a9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:47.355285 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900ef98-eb4a-45c8-a6d3-b51e3753a9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:47.358910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900ef98-eb4a-45c8-a6d3-b51e3753a9f7 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:47.388242 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1044/2063] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:47.396778 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970259-b1fe-439f-b60c-09c9f91ee6db admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:47.411408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970259-b1fe-439f-b60c-09c9f91ee6db admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:47.418324 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4d3ab-90e6-409b-959a-5ab19a18405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:47.419460 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4d3ab-90e6-409b-959a-5ab19a18405a admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:47.419921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4d3ab-90e6-409b-959a-5ab19a18405a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:47.420349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4d3ab-90e6-409b-959a-5ab19a18405a admin admin] PATH_INFO: `/v3/projects/055f05f3953e48a5b8dfb966df665232/users/cf772d6cedfd4a2983d25c064297662a/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:47.442204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4d3ab-90e6-409b-959a-5ab19a18405a admin admin] RBAC: Authorizing `identity:create_grant(project_id=055f05f3953e48a5b8dfb966df665232, user_id=cf772d6cedfd4a2983d25c064297662a, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:47.446486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4d3ab-90e6-409b-959a-5ab19a18405a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:47.467647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1020/2064] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:47 2022] PUT /identity/v3/projects/055f05f3953e48a5b8dfb966df665232/users/cf772d6cedfd4a2983d25c064297662a/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:47.481403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d90bd6-09ca-429d-beac-c108de52c769 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:47.482110 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d90bd6-09ca-429d-beac-c108de52c769 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:47.482442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d90bd6-09ca-429d-beac-c108de52c769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:47.533181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-c5d90bd6-09ca-429d-beac-c108de52c769 None None] MFA Rules not processed for user `cf772d6cedfd4a2983d25c064297662a`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:47.533181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c5d90bd6-09ca-429d-beac-c108de52c769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:47.692017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1045/2065] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:47.699215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4d3ab-90e6-409b-959a-5ab19a18405a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:47.735041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:47.853216 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4d3ab-90e6-409b-959a-5ab19a18405a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:47.861211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cd87d-8367-4c49-9d58-f4a7540a87bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:47.862219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd87d-8367-4c49-9d58-f4a7540a87bd admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:47.862970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd87d-8367-4c49-9d58-f4a7540a87bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:47.863485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd87d-8367-4c49-9d58-f4a7540a87bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:47.864740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cd87d-8367-4c49-9d58-f4a7540a87bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:47.868607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cd87d-8367-4c49-9d58-f4a7540a87bd admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:47.918873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1021/2066] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:47 2022] POST /identity/v3/projects => generated 365 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:47.923926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d90bd6-09ca-429d-beac-c108de52c769 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:47.953056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d90bd6-09ca-429d-beac-c108de52c769 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:48.066345 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:48.169792 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82477e8-a030-4ae8-b33f-21f0abde569e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:48.171041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82477e8-a030-4ae8-b33f-21f0abde569e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:48.174345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82477e8-a030-4ae8-b33f-21f0abde569e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:48.189692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4993db-608e-48cc-9d5a-37738781b436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:48.190724 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4993db-608e-48cc-9d5a-37738781b436 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:48.191236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4993db-608e-48cc-9d5a-37738781b436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:48.191728 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4993db-608e-48cc-9d5a-37738781b436 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:48.193073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4993db-608e-48cc-9d5a-37738781b436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:48.211794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4993db-608e-48cc-9d5a-37738781b436 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:48.292434 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1046/2067] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:47 2022] POST /identity/v3/users => generated 289 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:48.297568 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4993db-608e-48cc-9d5a-37738781b436 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:48.303399 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b82477e8-a030-4ae8-b33f-21f0abde569e None None] MFA Rules not processed for user `9a2db0e2828a430f88c7a0484445a2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:48.316548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b82477e8-a030-4ae8-b33f-21f0abde569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:48.345517 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4993db-608e-48cc-9d5a-37738781b436 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:48.379875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57699e-df06-4115-a76e-7128e9d4a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:48.381588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57699e-df06-4115-a76e-7128e9d4a301 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:48.382343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57699e-df06-4115-a76e-7128e9d4a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:48.382891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57699e-df06-4115-a76e-7128e9d4a301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:48.384191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57699e-df06-4115-a76e-7128e9d4a301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:48.397946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57699e-df06-4115-a76e-7128e9d4a301 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:48.423802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1047/2068] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:48.431391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57699e-df06-4115-a76e-7128e9d4a301 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:48.457874 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57699e-df06-4115-a76e-7128e9d4a301 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:48.469578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3656f03-cfc7-4e30-b682-8fd1a8f5c96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:48.471033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3656f03-cfc7-4e30-b682-8fd1a8f5c96f admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:48.471761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3656f03-cfc7-4e30-b682-8fd1a8f5c96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:48.472263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3656f03-cfc7-4e30-b682-8fd1a8f5c96f admin admin] PATH_INFO: `/v3/projects/b9afc3425a4c44289859895c8c1e79ad/users/c9437b0d17d64254b0fca98d70079c10/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:48.523738 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1022/2069] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:08:48.527218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82477e8-a030-4ae8-b33f-21f0abde569e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:48.531405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b82477e8-a030-4ae8-b33f-21f0abde569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:48.541944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3656f03-cfc7-4e30-b682-8fd1a8f5c96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9afc3425a4c44289859895c8c1e79ad, user_id=c9437b0d17d64254b0fca98d70079c10, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:48.545526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3656f03-cfc7-4e30-b682-8fd1a8f5c96f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:48.550105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82477e8-a030-4ae8-b33f-21f0abde569e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:48.557452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3dfb1-4ae3-4793-ac2a-4527a0ffbf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:48.558161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3dfb1-4ae3-4793-ac2a-4527a0ffbf8b admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:48.558519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3dfb1-4ae3-4793-ac2a-4527a0ffbf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:48.558880 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3dfb1-4ae3-4793-ac2a-4527a0ffbf8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:48.559661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3dfb1-4ae3-4793-ac2a-4527a0ffbf8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:48.562964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3dfb1-4ae3-4793-ac2a-4527a0ffbf8b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:48.580911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1048/2070] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:48 2022] PUT /identity/v3/projects/b9afc3425a4c44289859895c8c1e79ad/users/c9437b0d17d64254b0fca98d70079c10/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:48.583067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3656f03-cfc7-4e30-b682-8fd1a8f5c96f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:48.620052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1023/2071] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:48 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:48.625323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3dfb1-4ae3-4793-ac2a-4527a0ffbf8b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:48.746812 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3dfb1-4ae3-4793-ac2a-4527a0ffbf8b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:48.759960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524153bb-e975-4651-a579-13a1703b113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:48.760615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524153bb-e975-4651-a579-13a1703b113e admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:48.761024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524153bb-e975-4651-a579-13a1703b113e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:48.761726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524153bb-e975-4651-a579-13a1703b113e admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:48.762429 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524153bb-e975-4651-a579-13a1703b113e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:48.764709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3656f03-cfc7-4e30-b682-8fd1a8f5c96f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:48.771283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524153bb-e975-4651-a579-13a1703b113e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:48.789968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198bbfc-7809-4b94-bd1d-5419a43317cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:48.791285 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198bbfc-7809-4b94-bd1d-5419a43317cd admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:48.792797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198bbfc-7809-4b94-bd1d-5419a43317cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:48.793433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198bbfc-7809-4b94-bd1d-5419a43317cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:48.795837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198bbfc-7809-4b94-bd1d-5419a43317cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:48.800098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198bbfc-7809-4b94-bd1d-5419a43317cd admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:48.810055 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1024/2072] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:48 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:48.811413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524153bb-e975-4651-a579-13a1703b113e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:48.819042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:48.828800 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1049/2073] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:48.831101 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198bbfc-7809-4b94-bd1d-5419a43317cd admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:48.832095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524153bb-e975-4651-a579-13a1703b113e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:48.841019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7563fa5-bfc4-484b-97ca-8c5a72022d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:48.841929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7563fa5-bfc4-484b-97ca-8c5a72022d32 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:48.842295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7563fa5-bfc4-484b-97ca-8c5a72022d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:48.842760 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7563fa5-bfc4-484b-97ca-8c5a72022d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:48.843899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7563fa5-bfc4-484b-97ca-8c5a72022d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:48.846256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7563fa5-bfc4-484b-97ca-8c5a72022d32 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:48.857898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198bbfc-7809-4b94-bd1d-5419a43317cd admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:48.864393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1025/2074] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:48.865727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7563fa5-bfc4-484b-97ca-8c5a72022d32 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:48.871492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a2fdf-0970-44e1-94c0-834fc30036f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:48.873832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a2fdf-0970-44e1-94c0-834fc30036f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:48.874774 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a2fdf-0970-44e1-94c0-834fc30036f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:48.875464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a2fdf-0970-44e1-94c0-834fc30036f1 admin admin] PATH_INFO: `/v3/projects/b9afc3425a4c44289859895c8c1e79ad/users/c9437b0d17d64254b0fca98d70079c10/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:48.878344 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7563fa5-bfc4-484b-97ca-8c5a72022d32 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:48.879651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a2fdf-0970-44e1-94c0-834fc30036f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9afc3425a4c44289859895c8c1e79ad, user_id=c9437b0d17d64254b0fca98d70079c10, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:48.885985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb819c77-e97a-4288-8eb1-2e27a9bf6e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:48.886821 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb819c77-e97a-4288-8eb1-2e27a9bf6e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:48.887189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a2fdf-0970-44e1-94c0-834fc30036f1 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:48.887367 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb819c77-e97a-4288-8eb1-2e27a9bf6e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:48.887452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb819c77-e97a-4288-8eb1-2e27a9bf6e52 admin admin] PATH_INFO: `/v3/projects/0007731c013e4c2387397fad7d900894/users/645dd2f8967f499d9c25c6da248df0a2/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:48.911124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1050/2075] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:48 2022] PUT /identity/v3/projects/b9afc3425a4c44289859895c8c1e79ad/users/c9437b0d17d64254b0fca98d70079c10/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:08:48.922761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb819c77-e97a-4288-8eb1-2e27a9bf6e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0007731c013e4c2387397fad7d900894, user_id=645dd2f8967f499d9c25c6da248df0a2, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:48.925397 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc13b-488b-44bb-968b-c5e7cba1108a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:48.927201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc13b-488b-44bb-968b-c5e7cba1108a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:48.927828 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc13b-488b-44bb-968b-c5e7cba1108a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:48.937062 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb819c77-e97a-4288-8eb1-2e27a9bf6e52 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:48.977189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1026/2076] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:48 2022] PUT /identity/v3/projects/0007731c013e4c2387397fad7d900894/users/645dd2f8967f499d9c25c6da248df0a2/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:48.978513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb819c77-e97a-4288-8eb1-2e27a9bf6e52 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:49.024799 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-079bc13b-488b-44bb-968b-c5e7cba1108a None None] MFA Rules not processed for user `c9437b0d17d64254b0fca98d70079c10`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:49.026985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-079bc13b-488b-44bb-968b-c5e7cba1108a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:49.165298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb819c77-e97a-4288-8eb1-2e27a9bf6e52 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:49.188092 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bdc6d-8a17-4341-9691-51afbd0a8abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:49.190523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bdc6d-8a17-4341-9691-51afbd0a8abe admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:49.194001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bdc6d-8a17-4341-9691-51afbd0a8abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:49.195343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bdc6d-8a17-4341-9691-51afbd0a8abe admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:49.200135 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bdc6d-8a17-4341-9691-51afbd0a8abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:49.207764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bdc6d-8a17-4341-9691-51afbd0a8abe admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:49.251652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1027/2077] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:49.259621 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bdc6d-8a17-4341-9691-51afbd0a8abe admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:49.261708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:49.295402 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1051/2078] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:49.299218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bdc6d-8a17-4341-9691-51afbd0a8abe admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:49.315837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5111-744c-4811-8fb8-3019239931c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:49.316851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5111-744c-4811-8fb8-3019239931c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:49.316851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5111-744c-4811-8fb8-3019239931c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:49.317175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5111-744c-4811-8fb8-3019239931c9 admin admin] PATH_INFO: `/v3/projects/0007731c013e4c2387397fad7d900894/users/645dd2f8967f499d9c25c6da248df0a2/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:49.319891 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e5111-744c-4811-8fb8-3019239931c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0007731c013e4c2387397fad7d900894, user_id=645dd2f8967f499d9c25c6da248df0a2, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:49.321665 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bc13b-488b-44bb-968b-c5e7cba1108a None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:49.322982 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e5111-744c-4811-8fb8-3019239931c9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:49.324150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-079bc13b-488b-44bb-968b-c5e7cba1108a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:49.391422 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1028/2079] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:49 2022] PUT /identity/v3/projects/0007731c013e4c2387397fad7d900894/users/645dd2f8967f499d9c25c6da248df0a2/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:08:49.446168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bc13b-488b-44bb-968b-c5e7cba1108a None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:49.586321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5111-744c-4811-8fb8-3019239931c9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:49.589488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-105e5111-744c-4811-8fb8-3019239931c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:49.603966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103863d0-8b91-4e46-8941-0d67db033684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:49.609682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103863d0-8b91-4e46-8941-0d67db033684 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:49.612528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103863d0-8b91-4e46-8941-0d67db033684 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:49.613807 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103863d0-8b91-4e46-8941-0d67db033684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:49.862180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103863d0-8b91-4e46-8941-0d67db033684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:49.865738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103863d0-8b91-4e46-8941-0d67db033684 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:49.893825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1052/2080] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:08:49.970216 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5111-744c-4811-8fb8-3019239931c9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:50.008484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf9a45-64f9-4184-a239-e8598b355815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:50.012088 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf9a45-64f9-4184-a239-e8598b355815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:50.012682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf9a45-64f9-4184-a239-e8598b355815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:50.013210 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf9a45-64f9-4184-a239-e8598b355815 admin admin] PATH_INFO: `/v3/users/8940e14dfab046a8b810d06c74082d07` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:50.023203 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf9a45-64f9-4184-a239-e8598b355815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8940e14dfab046a8b810d06c74082d07)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:50.029177 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf9a45-64f9-4184-a239-e8598b355815 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:50.149328 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103863d0-8b91-4e46-8941-0d67db033684 service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:50.165098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103863d0-8b91-4e46-8941-0d67db033684 service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:50.182434 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d03d94-aa1a-4f1c-a372-f1a8753b287e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:50.184058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d03d94-aa1a-4f1c-a372-f1a8753b287e service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:50.187422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d03d94-aa1a-4f1c-a372-f1a8753b287e service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:50.190934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d03d94-aa1a-4f1c-a372-f1a8753b287e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:50.233518 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1abf9a45-64f9-4184-a239-e8598b355815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8940e14dfab046a8b810d06c74082d07'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:50.241412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:50.292198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1abf9a45-64f9-4184-a239-e8598b355815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8940e14dfab046a8b810d06c74082d07'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:50.310436 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1abf9a45-64f9-4184-a239-e8598b355815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8940e14dfab046a8b810d06c74082d07'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:50.312314 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1abf9a45-64f9-4184-a239-e8598b355815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8940e14dfab046a8b810d06c74082d07'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:50.312738 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1abf9a45-64f9-4184-a239-e8598b355815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8940e14dfab046a8b810d06c74082d07'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:50.348235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1029/2081] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:49 2022] DELETE /identity/v3/users/8940e14dfab046a8b810d06c74082d07 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:08:50.355902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d790bce-83a1-47ec-b28d-5fd3ecba724a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:50.356444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d790bce-83a1-47ec-b28d-5fd3ecba724a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:50.356905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d790bce-83a1-47ec-b28d-5fd3ecba724a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:50.418966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9d790bce-83a1-47ec-b28d-5fd3ecba724a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:50.423947 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9d790bce-83a1-47ec-b28d-5fd3ecba724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:50.443835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d03d94-aa1a-4f1c-a372-f1a8753b287e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:50.452015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d03d94-aa1a-4f1c-a372-f1a8753b287e service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:50.514020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1053/2082] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:08:50.657350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1030/2083] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:08:50.679541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d03d94-aa1a-4f1c-a372-f1a8753b287e service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:50.682773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b9d03d94-aa1a-4f1c-a372-f1a8753b287e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:50.710060 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:51.036343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d03d94-aa1a-4f1c-a372-f1a8753b287e service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:51.290855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b1afb-f80d-41e7-8336-e7fc2c68f219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:51.291980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1afb-f80d-41e7-8336-e7fc2c68f219 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:51.292583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1afb-f80d-41e7-8336-e7fc2c68f219 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:51.293837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1afb-f80d-41e7-8336-e7fc2c68f219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:51.333475 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b1afb-f80d-41e7-8336-e7fc2c68f219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:51.338154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b1afb-f80d-41e7-8336-e7fc2c68f219 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:51.391011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1054/2084] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:53.657486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d790bce-83a1-47ec-b28d-5fd3ecba724a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:53.659927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9d790bce-83a1-47ec-b28d-5fd3ecba724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:53.692193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d790bce-83a1-47ec-b28d-5fd3ecba724a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:53.706862 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:53.707978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:53.708624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:53.709104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] PATH_INFO: `/v3/projects/5a865299e01443e6ae94ee2c77ff25a6` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:53.710949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a865299e01443e6ae94ee2c77ff25a6)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:53.715880 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:53.784239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b1afb-f80d-41e7-8336-e7fc2c68f219 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:53.785861 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3d4b1afb-f80d-41e7-8336-e7fc2c68f219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:53.883175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a865299e01443e6ae94ee2c77ff25a6', 'request_id': 'req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:53.903174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a865299e01443e6ae94ee2c77ff25a6', 'request_id': 'req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:53.917887 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a865299e01443e6ae94ee2c77ff25a6', 'request_id': 'req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:53.944503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b1afb-f80d-41e7-8336-e7fc2c68f219 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:53.947481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] The token cache is being invalidate because project 5a865299e01443e6ae94ee2c77ff25a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:53.947793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:53.949810 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:53.954924 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1031/2085] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:53 2022] DELETE /identity/v3/projects/5a865299e01443e6ae94ee2c77ff25a6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:53.960019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:53.961909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:54.092801 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae672c62-cfab-4e9b-a1a7-223429af5d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:54.093561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae672c62-cfab-4e9b-a1a7-223429af5d60 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:54.093919 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae672c62-cfab-4e9b-a1a7-223429af5d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:54.095625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae672c62-cfab-4e9b-a1a7-223429af5d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:54.100462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ae672c62-cfab-4e9b-a1a7-223429af5d60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:54.123638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:54.157211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a5ca0-9e7f-4fd7-a6ae-17fbb1eeb38c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:54.171506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9368b63-e3a7-4b78-a795-0ea4945238b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:54.173661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9368b63-e3a7-4b78-a795-0ea4945238b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:54.174860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9368b63-e3a7-4b78-a795-0ea4945238b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:54.175912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9368b63-e3a7-4b78-a795-0ea4945238b5 admin admin] PATH_INFO: `/v3/users/25b8832d2cae4da4926892cee027d0ec` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:54.179840 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9368b63-e3a7-4b78-a795-0ea4945238b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b8832d2cae4da4926892cee027d0ec)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:54.183983 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9368b63-e3a7-4b78-a795-0ea4945238b5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:54.187826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:54.273211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae672c62-cfab-4e9b-a1a7-223429af5d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:54.275029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae672c62-cfab-4e9b-a1a7-223429af5d60 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:54.287952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1055/2086] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:54.322211 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a9368b63-e3a7-4b78-a795-0ea4945238b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b8832d2cae4da4926892cee027d0ec'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:54.370995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a9368b63-e3a7-4b78-a795-0ea4945238b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b8832d2cae4da4926892cee027d0ec'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:54.387487 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a9368b63-e3a7-4b78-a795-0ea4945238b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b8832d2cae4da4926892cee027d0ec'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:54.387964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a9368b63-e3a7-4b78-a795-0ea4945238b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b8832d2cae4da4926892cee027d0ec'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:54.388646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a9368b63-e3a7-4b78-a795-0ea4945238b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b8832d2cae4da4926892cee027d0ec'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:54.424750 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1032/2087] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:53 2022] DELETE /identity/v3/users/25b8832d2cae4da4926892cee027d0ec => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:56.548382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae672c62-cfab-4e9b-a1a7-223429af5d60 service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:56.564429 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae672c62-cfab-4e9b-a1a7-223429af5d60 service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:56.725348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6153ace-971e-4978-b906-68717313efed None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:56.725348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6153ace-971e-4978-b906-68717313efed None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:56.726025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6153ace-971e-4978-b906-68717313efed None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:56.727198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1033/2088] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 21:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:08:56.740615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3946cf-fc31-4025-907f-e2de672df815 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:56.741023 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3946cf-fc31-4025-907f-e2de672df815 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:56.742163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3946cf-fc31-4025-907f-e2de672df815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:56.807197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:56.807197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:56.807197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:56.807197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] PATH_INFO: `/v3/projects/ae4433a91cbe4580b19a7ac0a2bb0df3` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:56.808485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4433a91cbe4580b19a7ac0a2bb0df3)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:56.808485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:56.811326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-fa3946cf-fc31-4025-907f-e2de672df815 None None] MFA Rules not processed for user `be0a8d40d21048afa4ce94706e3625c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:56.814750 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fa3946cf-fc31-4025-907f-e2de672df815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:56.928184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4433a91cbe4580b19a7ac0a2bb0df3', 'request_id': 'req-2c3302ad-f343-429b-96f6-a14c13c8cfe7'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:56.945350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4433a91cbe4580b19a7ac0a2bb0df3', 'request_id': 'req-2c3302ad-f343-429b-96f6-a14c13c8cfe7'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:56.961778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4433a91cbe4580b19a7ac0a2bb0df3', 'request_id': 'req-2c3302ad-f343-429b-96f6-a14c13c8cfe7'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:56.991741 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1034/2089] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:56.991911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] The token cache is being invalidate because project ae4433a91cbe4580b19a7ac0a2bb0df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:56.992088 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:56.996379 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:56.998168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1056/2090] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:56 2022] DELETE /identity/v3/projects/ae4433a91cbe4580b19a7ac0a2bb0df3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:57.003236 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412856c3-5382-4ed9-8772-19306eaeec32 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:57.003706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412856c3-5382-4ed9-8772-19306eaeec32 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:57.004517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412856c3-5382-4ed9-8772-19306eaeec32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:57.015417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:57.016880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:57.047696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-412856c3-5382-4ed9-8772-19306eaeec32 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:57.050191 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-412856c3-5382-4ed9-8772-19306eaeec32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:57.256945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:57.324596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1035/2091] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:57.328016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412856c3-5382-4ed9-8772-19306eaeec32 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:57.334152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-412856c3-5382-4ed9-8772-19306eaeec32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:57.353131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3302ad-f343-429b-96f6-a14c13c8cfe7 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:57.400121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1583658-27ee-4d7f-9954-cb616cd80191 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:57.401662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1583658-27ee-4d7f-9954-cb616cd80191 service placement] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:57.402169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1583658-27ee-4d7f-9954-cb616cd80191 service placement] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:57.404781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1583658-27ee-4d7f-9954-cb616cd80191 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:57.412053 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d1583658-27ee-4d7f-9954-cb616cd80191 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:57.424662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412856c3-5382-4ed9-8772-19306eaeec32 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:57.450613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:57.451656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:57.452003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:57.452290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] PATH_INFO: `/v3/users/fa3abf6b7b044a1b8ad16aef5413a0f5` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:57.457704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3abf6b7b044a1b8ad16aef5413a0f5)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:57.461038 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:57.467514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:57.497222 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1583658-27ee-4d7f-9954-cb616cd80191 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:57.523299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1583658-27ee-4d7f-9954-cb616cd80191 service placement] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:57.568477 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1057/2092] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:08:57.571022 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4826e-ec93-451e-aa8c-88f05f72762f None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:57.571527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4826e-ec93-451e-aa8c-88f05f72762f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:57.572036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4826e-ec93-451e-aa8c-88f05f72762f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:57.627902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3abf6b7b044a1b8ad16aef5413a0f5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:57.661272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-eac4826e-ec93-451e-aa8c-88f05f72762f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:57.667301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-eac4826e-ec93-451e-aa8c-88f05f72762f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:57.684821 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3abf6b7b044a1b8ad16aef5413a0f5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:57.699814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1058/2093] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:57.701636 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3abf6b7b044a1b8ad16aef5413a0f5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:57.702278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3abf6b7b044a1b8ad16aef5413a0f5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:57.703737 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3abf6b7b044a1b8ad16aef5413a0f5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:57.707641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4826e-ec93-451e-aa8c-88f05f72762f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:57.720530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4826e-ec93-451e-aa8c-88f05f72762f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:57.726022 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b1e76-ba22-4122-90aa-b231a27587df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:57.727405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1036/2094] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:57 2022] DELETE /identity/v3/users/fa3abf6b7b044a1b8ad16aef5413a0f5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:57.731096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b1e76-ba22-4122-90aa-b231a27587df admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:57.731882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b1e76-ba22-4122-90aa-b231a27587df admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:57.732617 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b1e76-ba22-4122-90aa-b231a27587df admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:57.734864 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b1e76-ba22-4122-90aa-b231a27587df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:08:57.735580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b1e76-ba22-4122-90aa-b231a27587df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:57.740171 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b1e76-ba22-4122-90aa-b231a27587df admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:57.778346 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1059/2095] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 21:08:57.784332 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:57.787993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:57.920999 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630ff59-fcd5-433a-a3e5-a580240d3014 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:57.931703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d1444-768c-44ac-bc2e-a69b8e602dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:57.932668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d1444-768c-44ac-bc2e-a69b8e602dab admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:57.933139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d1444-768c-44ac-bc2e-a69b8e602dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:57.933681 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d1444-768c-44ac-bc2e-a69b8e602dab admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:57.935040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d1444-768c-44ac-bc2e-a69b8e602dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:57.939743 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d1444-768c-44ac-bc2e-a69b8e602dab admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:57.994729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1037/2096] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:57 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:58.001006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b1e76-ba22-4122-90aa-b231a27587df admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:58.023875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b1e76-ba22-4122-90aa-b231a27587df admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:58.048109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d1444-768c-44ac-bc2e-a69b8e602dab admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:58.050281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ae8d1444-768c-44ac-bc2e-a69b8e602dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:58.123224 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b271d-dffc-4dd7-a338-4f007cb3d666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:58.144896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b271d-dffc-4dd7-a338-4f007cb3d666 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:58.144896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b271d-dffc-4dd7-a338-4f007cb3d666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:58.146025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b271d-dffc-4dd7-a338-4f007cb3d666 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:58.147531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b271d-dffc-4dd7-a338-4f007cb3d666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:58.149742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b271d-dffc-4dd7-a338-4f007cb3d666 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:58.192629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1060/2097] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:57 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:08:58.196999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b271d-dffc-4dd7-a338-4f007cb3d666 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:58.214298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d1444-768c-44ac-bc2e-a69b8e602dab admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:58.216542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b271d-dffc-4dd7-a338-4f007cb3d666 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:58.223208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfacda-cbdc-4d29-9cb0-3ae82ef94a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:58.223956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfacda-cbdc-4d29-9cb0-3ae82ef94a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:58.224546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfacda-cbdc-4d29-9cb0-3ae82ef94a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:58.225004 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfacda-cbdc-4d29-9cb0-3ae82ef94a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:58.226305 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfacda-cbdc-4d29-9cb0-3ae82ef94a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:58.226680 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339b1eb-9520-4efb-acbb-5f0b6f86b000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:58.227526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339b1eb-9520-4efb-acbb-5f0b6f86b000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:58.227964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339b1eb-9520-4efb-acbb-5f0b6f86b000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:58.228253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339b1eb-9520-4efb-acbb-5f0b6f86b000 admin admin] PATH_INFO: `/v3/projects/46cb2c907f00426aa3569007308075fe` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:58.228807 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfacda-cbdc-4d29-9cb0-3ae82ef94a57 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:58.233551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339b1eb-9520-4efb-acbb-5f0b6f86b000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46cb2c907f00426aa3569007308075fe)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:58.235794 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339b1eb-9520-4efb-acbb-5f0b6f86b000 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:58.253090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1061/2098] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:58.260451 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:58.260759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfacda-cbdc-4d29-9cb0-3ae82ef94a57 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:58.296836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfacda-cbdc-4d29-9cb0-3ae82ef94a57 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:58.315024 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9c988-432b-4c0b-b26b-e789c7cdd247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:58.315838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9c988-432b-4c0b-b26b-e789c7cdd247 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:58.316510 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9c988-432b-4c0b-b26b-e789c7cdd247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:58.316945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9c988-432b-4c0b-b26b-e789c7cdd247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:58.319956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9c988-432b-4c0b-b26b-e789c7cdd247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:58.325783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9c988-432b-4c0b-b26b-e789c7cdd247 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:58.370356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1062/2099] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:58.374502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9c988-432b-4c0b-b26b-e789c7cdd247 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:58.403531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9c988-432b-4c0b-b26b-e789c7cdd247 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:58.433421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c339b1eb-9520-4efb-acbb-5f0b6f86b000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46cb2c907f00426aa3569007308075fe', 'request_id': 'req-c339b1eb-9520-4efb-acbb-5f0b6f86b000'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:58.461437 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c339b1eb-9520-4efb-acbb-5f0b6f86b000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46cb2c907f00426aa3569007308075fe', 'request_id': 'req-c339b1eb-9520-4efb-acbb-5f0b6f86b000'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:58.480060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c339b1eb-9520-4efb-acbb-5f0b6f86b000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46cb2c907f00426aa3569007308075fe', 'request_id': 'req-c339b1eb-9520-4efb-acbb-5f0b6f86b000'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:58.531828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c339b1eb-9520-4efb-acbb-5f0b6f86b000 admin admin] The token cache is being invalidate because project 46cb2c907f00426aa3569007308075fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:08:58.532282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c339b1eb-9520-4efb-acbb-5f0b6f86b000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:58.535186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c339b1eb-9520-4efb-acbb-5f0b6f86b000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:58.557268 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1038/2100] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:08:58 2022] DELETE /identity/v3/projects/46cb2c907f00426aa3569007308075fe => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:08:58.565937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91ae36-7c02-45ab-957c-adbf99e19d74 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:58.571157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91ae36-7c02-45ab-957c-adbf99e19d74 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:58.571670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91ae36-7c02-45ab-957c-adbf99e19d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:58.618042 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a0915-28ac-4a72-b683-86cd6b1b9d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:58.619517 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a0915-28ac-4a72-b683-86cd6b1b9d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:58.620031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a0915-28ac-4a72-b683-86cd6b1b9d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:58.620566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a0915-28ac-4a72-b683-86cd6b1b9d97 admin admin] PATH_INFO: `/v3/projects/f3a0d5cab04e4ac0ae68860f090f3ef5/users/88a1d3a41e8846dda90a54d8591afc18/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:58.644535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a0915-28ac-4a72-b683-86cd6b1b9d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a0d5cab04e4ac0ae68860f090f3ef5, user_id=88a1d3a41e8846dda90a54d8591afc18, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:58.647884 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a0915-28ac-4a72-b683-86cd6b1b9d97 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:58.672350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1063/2101] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:08:58 2022] PUT /identity/v3/projects/f3a0d5cab04e4ac0ae68860f090f3ef5/users/88a1d3a41e8846dda90a54d8591afc18/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:58.699921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce61fc2-06c4-4704-a206-1074a0cfe4ba None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:58.700218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce61fc2-06c4-4704-a206-1074a0cfe4ba None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:58.700557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce61fc2-06c4-4704-a206-1074a0cfe4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:58.730781 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ef91ae36-7c02-45ab-957c-adbf99e19d74 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:58.732529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ef91ae36-7c02-45ab-957c-adbf99e19d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:58.836600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-cce61fc2-06c4-4704-a206-1074a0cfe4ba None None] MFA Rules not processed for user `88a1d3a41e8846dda90a54d8591afc18`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:58.841775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cce61fc2-06c4-4704-a206-1074a0cfe4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:58.882192 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:58.953861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1039/2102] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:58.963114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc6307-24ec-4ffe-91f0-985863f4b570 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:58.963938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc6307-24ec-4ffe-91f0-985863f4b570 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:58.964309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc6307-24ec-4ffe-91f0-985863f4b570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:59.026064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-85fc6307-24ec-4ffe-91f0-985863f4b570 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:59.028121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-85fc6307-24ec-4ffe-91f0-985863f4b570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:59.044682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1040/2103] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:59.051843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc6307-24ec-4ffe-91f0-985863f4b570 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:59.072381 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc6307-24ec-4ffe-91f0-985863f4b570 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:59.079148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1064/2104] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:59.079148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce61fc2-06c4-4704-a206-1074a0cfe4ba None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:59.079148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cce61fc2-06c4-4704-a206-1074a0cfe4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:59.090282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40058a54-9c80-4e6d-b5e7-e476b1588dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:59.091719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40058a54-9c80-4e6d-b5e7-e476b1588dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:59.092362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40058a54-9c80-4e6d-b5e7-e476b1588dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:59.093052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40058a54-9c80-4e6d-b5e7-e476b1588dd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:59.096500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40058a54-9c80-4e6d-b5e7-e476b1588dd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:08:59.097149 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40058a54-9c80-4e6d-b5e7-e476b1588dd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:59.100581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40058a54-9c80-4e6d-b5e7-e476b1588dd2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:59.109375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce61fc2-06c4-4704-a206-1074a0cfe4ba None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:59.118594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:59.119421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:59.119925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:59.120429 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] PATH_INFO: `/v3/users/cf772d6cedfd4a2983d25c064297662a` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:59.122658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf772d6cedfd4a2983d25c064297662a)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:59.124315 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1041/2105] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:08:59.125835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40058a54-9c80-4e6d-b5e7-e476b1588dd2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:59.126756 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:59.136020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-40058a54-9c80-4e6d-b5e7-e476b1588dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:59.167653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40058a54-9c80-4e6d-b5e7-e476b1588dd2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:59.177013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9575ac6-b9d6-4a9a-96e2-b37a43d78644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:59.179272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575ac6-b9d6-4a9a-96e2-b37a43d78644 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:59.179813 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575ac6-b9d6-4a9a-96e2-b37a43d78644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:59.180304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575ac6-b9d6-4a9a-96e2-b37a43d78644 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:59.181739 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9575ac6-b9d6-4a9a-96e2-b37a43d78644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:59.188125 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9575ac6-b9d6-4a9a-96e2-b37a43d78644 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:59.252662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1042/2106] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:59 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:59.253742 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9575ac6-b9d6-4a9a-96e2-b37a43d78644 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:59.264653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf772d6cedfd4a2983d25c064297662a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:59.288534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf772d6cedfd4a2983d25c064297662a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:59.291011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf772d6cedfd4a2983d25c064297662a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:59.292240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf772d6cedfd4a2983d25c064297662a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:59.320226 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf772d6cedfd4a2983d25c064297662a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:08:59.352241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1065/2107] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:08:59 2022] DELETE /identity/v3/users/cf772d6cedfd4a2983d25c064297662a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:08:59.352241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:59.353418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:59.354477 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:59.361880 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9575ac6-b9d6-4a9a-96e2-b37a43d78644 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:59.459700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970fd24-c604-4507-9838-dd3c57499900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:59.460689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fd24-c604-4507-9838-dd3c57499900 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:59.461056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fd24-c604-4507-9838-dd3c57499900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:59.461450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fd24-c604-4507-9838-dd3c57499900 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:59.462428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970fd24-c604-4507-9838-dd3c57499900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:59.465639 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970fd24-c604-4507-9838-dd3c57499900 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:59.508698 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e91db-984e-43ec-929f-82d69e5a0a36 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:59.508936 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1043/2108] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:08:59 2022] POST /identity/v3/projects => generated 381 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:59.508936 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714761ce-1497-4083-a227-519b6029ccbd None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:59.508936 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714761ce-1497-4083-a227-519b6029ccbd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:59.509572 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714761ce-1497-4083-a227-519b6029ccbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:59.542380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-714761ce-1497-4083-a227-519b6029ccbd None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:08:59.546021 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-714761ce-1497-4083-a227-519b6029ccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:59.559323 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:59.642817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d78b6-9cdb-4116-b1c7-589e551c5911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:59.644548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d78b6-9cdb-4116-b1c7-589e551c5911 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:59.644742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d78b6-9cdb-4116-b1c7-589e551c5911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:59.650806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d78b6-9cdb-4116-b1c7-589e551c5911 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:59.650806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d78b6-9cdb-4116-b1c7-589e551c5911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:59.653800 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d78b6-9cdb-4116-b1c7-589e551c5911 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:59.682325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1044/2109] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:08:59.683702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714761ce-1497-4083-a227-519b6029ccbd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:59.685643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-714761ce-1497-4083-a227-519b6029ccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:59.731488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1066/2110] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:59 2022] POST /identity/v3/users => generated 297 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:59.732970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d78b6-9cdb-4116-b1c7-589e551c5911 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:59.736022 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-370d78b6-9cdb-4116-b1c7-589e551c5911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:08:59.763657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714761ce-1497-4083-a227-519b6029ccbd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:59.791331 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391071f3-34ba-4531-ae62-0196470efa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:59.792454 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391071f3-34ba-4531-ae62-0196470efa71 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:59.792910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391071f3-34ba-4531-ae62-0196470efa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:59.793359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391071f3-34ba-4531-ae62-0196470efa71 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:59.795273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391071f3-34ba-4531-ae62-0196470efa71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:59.807410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391071f3-34ba-4531-ae62-0196470efa71 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:59.863343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1045/2111] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:08:59 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:08:59.866293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391071f3-34ba-4531-ae62-0196470efa71 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:59.885095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d78b6-9cdb-4116-b1c7-589e551c5911 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:59.894111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d83b-75cf-4202-8cef-fa091f1c836a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:59.895302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d83b-75cf-4202-8cef-fa091f1c836a service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:59.906217 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391071f3-34ba-4531-ae62-0196470efa71 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:59.914696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2155ce-956f-460b-9fad-4a9c96ac3e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:08:59.916900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2155ce-956f-460b-9fad-4a9c96ac3e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:08:59.917469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2155ce-956f-460b-9fad-4a9c96ac3e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:59.917859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2155ce-956f-460b-9fad-4a9c96ac3e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:59.918996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2155ce-956f-460b-9fad-4a9c96ac3e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:59.921036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2155ce-956f-460b-9fad-4a9c96ac3e88 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:08:59.921692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d83b-75cf-4202-8cef-fa091f1c836a service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:08:59.922281 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d83b-75cf-4202-8cef-fa091f1c836a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:08:59.939498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1046/2112] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:08:59.940958 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2155ce-956f-460b-9fad-4a9c96ac3e88 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:08:59.969666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2155ce-956f-460b-9fad-4a9c96ac3e88 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:08:59.984692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1d83b-75cf-4202-8cef-fa091f1c836a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:08:59.987986 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1d83b-75cf-4202-8cef-fa091f1c836a service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:00.001986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb25509-88aa-427c-ba71-10584433c2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:00.002608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb25509-88aa-427c-ba71-10584433c2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:00.002943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb25509-88aa-427c-ba71-10584433c2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:00.003201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb25509-88aa-427c-ba71-10584433c2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:00.004044 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb25509-88aa-427c-ba71-10584433c2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:00.007530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb25509-88aa-427c-ba71-10584433c2f4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:00.039502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1047/2113] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:00.042703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb25509-88aa-427c-ba71-10584433c2f4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:00.050376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1067/2114] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:00.054371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d83b-75cf-4202-8cef-fa091f1c836a service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:00.069542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb25509-88aa-427c-ba71-10584433c2f4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:00.087406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84801597-48d2-4b42-aa54-574f2546b17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:00.088242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84801597-48d2-4b42-aa54-574f2546b17a admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:00.088594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84801597-48d2-4b42-aa54-574f2546b17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:00.088940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84801597-48d2-4b42-aa54-574f2546b17a admin admin] PATH_INFO: `/v3/projects/af101ef5fab8448b85e7a4dc3d84b346/users/ab75a0a5195a4f839d3fddd9e3b1aac4/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:00.089305 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d83b-75cf-4202-8cef-fa091f1c836a service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:00.103877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d7c18-c1f2-428b-8133-ca1fbf988d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:00.105494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d7c18-c1f2-428b-8133-ca1fbf988d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:00.105800 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d7c18-c1f2-428b-8133-ca1fbf988d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:00.106085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d7c18-c1f2-428b-8133-ca1fbf988d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:00.106811 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d7c18-c1f2-428b-8133-ca1fbf988d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:00.110107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d7c18-c1f2-428b-8133-ca1fbf988d82 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:00.121751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84801597-48d2-4b42-aa54-574f2546b17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af101ef5fab8448b85e7a4dc3d84b346, user_id=ab75a0a5195a4f839d3fddd9e3b1aac4, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:00.124500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84801597-48d2-4b42-aa54-574f2546b17a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:00.141650 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1068/2115] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:00.148443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d7c18-c1f2-428b-8133-ca1fbf988d82 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:00.159242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1048/2116] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:00 2022] PUT /identity/v3/projects/af101ef5fab8448b85e7a4dc3d84b346/users/ab75a0a5195a4f839d3fddd9e3b1aac4/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:00.163936 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84801597-48d2-4b42-aa54-574f2546b17a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:00.179510 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d7c18-c1f2-428b-8133-ca1fbf988d82 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:00.205516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:00.285444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84801597-48d2-4b42-aa54-574f2546b17a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:00.308757 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8d6f8-2193-429d-82da-681cf32924e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:00.313770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d6f8-2193-429d-82da-681cf32924e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:00.318214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d6f8-2193-429d-82da-681cf32924e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:00.319315 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d6f8-2193-429d-82da-681cf32924e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:00.320938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8d6f8-2193-429d-82da-681cf32924e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:00.332608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8d6f8-2193-429d-82da-681cf32924e8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:00.386378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1049/2117] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:00.391368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e47d5f-d200-444e-9326-6961efa7f65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:00.392469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e47d5f-d200-444e-9326-6961efa7f65a admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:00.392837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e47d5f-d200-444e-9326-6961efa7f65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:00.393190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e47d5f-d200-444e-9326-6961efa7f65a admin admin] PATH_INFO: `/v3/projects/a004390a97e4480f89d037759260a703/users/3824fdbe5bc54a14b93ce1e7fbc8c271/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:00.393631 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8d6f8-2193-429d-82da-681cf32924e8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:00.419365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e47d5f-d200-444e-9326-6961efa7f65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a004390a97e4480f89d037759260a703, user_id=3824fdbe5bc54a14b93ce1e7fbc8c271, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:00.432845 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e47d5f-d200-444e-9326-6961efa7f65a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:00.473248 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1069/2118] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:00 2022] PUT /identity/v3/projects/a004390a97e4480f89d037759260a703/users/3824fdbe5bc54a14b93ce1e7fbc8c271/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:00.488095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8d6f8-2193-429d-82da-681cf32924e8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:00.495859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422649c-1473-45fd-8f14-c82039ebc6b8 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:00.496378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422649c-1473-45fd-8f14-c82039ebc6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:00.496886 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422649c-1473-45fd-8f14-c82039ebc6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:00.642699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385297c5-2c40-4eb1-aaa9-df1af66d39be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:00.642699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385297c5-2c40-4eb1-aaa9-df1af66d39be admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:00.643220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385297c5-2c40-4eb1-aaa9-df1af66d39be admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:00.643220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385297c5-2c40-4eb1-aaa9-df1af66d39be admin admin] PATH_INFO: `/v3/projects/af101ef5fab8448b85e7a4dc3d84b346/users/ab75a0a5195a4f839d3fddd9e3b1aac4/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:00.647254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385297c5-2c40-4eb1-aaa9-df1af66d39be admin admin] RBAC: Authorizing `identity:create_grant(project_id=af101ef5fab8448b85e7a4dc3d84b346, user_id=ab75a0a5195a4f839d3fddd9e3b1aac4, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:00.651535 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385297c5-2c40-4eb1-aaa9-df1af66d39be admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:00.653513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e422649c-1473-45fd-8f14-c82039ebc6b8 None None] MFA Rules not processed for user `3824fdbe5bc54a14b93ce1e7fbc8c271`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:00.655436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e422649c-1473-45fd-8f14-c82039ebc6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:00.683979 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1050/2119] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:00 2022] PUT /identity/v3/projects/af101ef5fab8448b85e7a4dc3d84b346/users/ab75a0a5195a4f839d3fddd9e3b1aac4/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:00.686208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9aaa9d-4b65-4409-95b0-a1a39d9421d5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:00.687457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9aaa9d-4b65-4409-95b0-a1a39d9421d5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:00.687457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9aaa9d-4b65-4409-95b0-a1a39d9421d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:00.726832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:00.744725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1d9aaa9d-4b65-4409-95b0-a1a39d9421d5 None None] MFA Rules not processed for user `ab75a0a5195a4f839d3fddd9e3b1aac4`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:00.747197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1d9aaa9d-4b65-4409-95b0-a1a39d9421d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:00.906510 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1051/2120] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:09:00.907591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9aaa9d-4b65-4409-95b0-a1a39d9421d5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:00.909527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1d9aaa9d-4b65-4409-95b0-a1a39d9421d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:00.935486 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1070/2121] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:09:00.937384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422649c-1473-45fd-8f14-c82039ebc6b8 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:00.981035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422649c-1473-45fd-8f14-c82039ebc6b8 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:00.982274 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:01.044603 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9aaa9d-4b65-4409-95b0-a1a39d9421d5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:01.053687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2d58e-d7ed-40a4-baf0-689c92da508a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:01.055294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2d58e-d7ed-40a4-baf0-689c92da508a service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:01.056205 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2d58e-d7ed-40a4-baf0-689c92da508a service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:01.056965 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2d58e-d7ed-40a4-baf0-689c92da508a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:01.084401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2d58e-d7ed-40a4-baf0-689c92da508a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:01.088070 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2d58e-d7ed-40a4-baf0-689c92da508a service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:01.092756 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168980cb-4544-40d5-8699-061c7942b19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:01.093390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168980cb-4544-40d5-8699-061c7942b19a admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:01.093677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168980cb-4544-40d5-8699-061c7942b19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:01.093960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168980cb-4544-40d5-8699-061c7942b19a admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:01.095164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168980cb-4544-40d5-8699-061c7942b19a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:01.097295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168980cb-4544-40d5-8699-061c7942b19a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:01.115764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1052/2122] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:01.160132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1071/2123] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:00 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:09:01.166454 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2d58e-d7ed-40a4-baf0-689c92da508a service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:01.185025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2d58e-d7ed-40a4-baf0-689c92da508a service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:01.272398 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168980cb-4544-40d5-8699-061c7942b19a admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:01.277653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-168980cb-4544-40d5-8699-061c7942b19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:01.369637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde57669-0d0b-43c0-a08f-e114910cc372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:01.372405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde57669-0d0b-43c0-a08f-e114910cc372 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:01.374659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde57669-0d0b-43c0-a08f-e114910cc372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:01.376500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde57669-0d0b-43c0-a08f-e114910cc372 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:01.377411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde57669-0d0b-43c0-a08f-e114910cc372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:01.382908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde57669-0d0b-43c0-a08f-e114910cc372 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:01.474968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1053/2124] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:01 2022] POST /identity/v3/users => generated 296 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:01.484635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde57669-0d0b-43c0-a08f-e114910cc372 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:01.503012 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168980cb-4544-40d5-8699-061c7942b19a admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:01.517768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde57669-0d0b-43c0-a08f-e114910cc372 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:01.521250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:01.524378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:01.526763 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:01.528180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] PATH_INFO: `/v3/projects/055f05f3953e48a5b8dfb966df665232` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:01.538170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=055f05f3953e48a5b8dfb966df665232)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:01.541181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:01.547799 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f411e-0b34-427b-b1ea-f8c7b3027b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:01.548959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f411e-0b34-427b-b1ea-f8c7b3027b7b admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:01.549342 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f411e-0b34-427b-b1ea-f8c7b3027b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:01.549725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f411e-0b34-427b-b1ea-f8c7b3027b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:01.550637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f411e-0b34-427b-b1ea-f8c7b3027b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:01.554380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f411e-0b34-427b-b1ea-f8c7b3027b7b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:01.603317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1054/2125] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:01.604771 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f411e-0b34-427b-b1ea-f8c7b3027b7b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:01.639068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f411e-0b34-427b-b1ea-f8c7b3027b7b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:01.657433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a86a1-4290-49eb-be79-cf4a0eef6f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:01.666793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a86a1-4290-49eb-be79-cf4a0eef6f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:01.666793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a86a1-4290-49eb-be79-cf4a0eef6f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:01.666793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a86a1-4290-49eb-be79-cf4a0eef6f4c admin admin] PATH_INFO: `/v3/projects/3279618bd1974c568cab3ab195a1ea40/users/e0f91bd3ab8d4c3f8f4b5d6cb37a42aa/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:01.715653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a86a1-4290-49eb-be79-cf4a0eef6f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3279618bd1974c568cab3ab195a1ea40, user_id=e0f91bd3ab8d4c3f8f4b5d6cb37a42aa, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:01.716176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:01.720818 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a86a1-4290-49eb-be79-cf4a0eef6f4c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:01.721726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055f05f3953e48a5b8dfb966df665232', 'request_id': 'req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:01.755972 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055f05f3953e48a5b8dfb966df665232', 'request_id': 'req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:01.798983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055f05f3953e48a5b8dfb966df665232', 'request_id': 'req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:01.808307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1055/2126] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:01 2022] PUT /identity/v3/projects/3279618bd1974c568cab3ab195a1ea40/users/e0f91bd3ab8d4c3f8f4b5d6cb37a42aa/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:01.814087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a86a1-4290-49eb-be79-cf4a0eef6f4c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:01.834144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] The token cache is being invalidate because project 055f05f3953e48a5b8dfb966df665232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:01.834648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:01.835904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:01.839364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1072/2127] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:01 2022] DELETE /identity/v3/projects/055f05f3953e48a5b8dfb966df665232 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:09:01.844242 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:01.852653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:01.945510 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a86a1-4290-49eb-be79-cf4a0eef6f4c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:01.951037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465ef1f-dd74-45a3-9781-c1c7894dbf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:01.951766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465ef1f-dd74-45a3-9781-c1c7894dbf1f admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:01.952122 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465ef1f-dd74-45a3-9781-c1c7894dbf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:01.952523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465ef1f-dd74-45a3-9781-c1c7894dbf1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:01.953431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465ef1f-dd74-45a3-9781-c1c7894dbf1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:01.956314 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465ef1f-dd74-45a3-9781-c1c7894dbf1f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:01.970798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1056/2128] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:01.971806 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465ef1f-dd74-45a3-9781-c1c7894dbf1f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:01.979847 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f465ef1f-dd74-45a3-9781-c1c7894dbf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:01.998374 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465ef1f-dd74-45a3-9781-c1c7894dbf1f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:02.007433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:02.008921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:02.011293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:02.012298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] PATH_INFO: `/v3/users/88a1d3a41e8846dda90a54d8591afc18` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:02.014502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a1d3a41e8846dda90a54d8591afc18)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:02.018881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:02.036066 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ec8ea-b3e2-4b37-8dec-d50e7bd09f4e admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:02.045395 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edd3b5-a2ed-49a9-93b3-8e02293751ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:02.046183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edd3b5-a2ed-49a9-93b3-8e02293751ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:02.046587 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edd3b5-a2ed-49a9-93b3-8e02293751ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:02.047036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edd3b5-a2ed-49a9-93b3-8e02293751ae admin admin] PATH_INFO: `/v3/users/c9437b0d17d64254b0fca98d70079c10` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:02.048631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edd3b5-a2ed-49a9-93b3-8e02293751ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9437b0d17d64254b0fca98d70079c10)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:02.051027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edd3b5-a2ed-49a9-93b3-8e02293751ae admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:02.074685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:02.115127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a1d3a41e8846dda90a54d8591afc18'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:02.144253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a1d3a41e8846dda90a54d8591afc18'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:02.147673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-89edd3b5-a2ed-49a9-93b3-8e02293751ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9437b0d17d64254b0fca98d70079c10'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:02.160172 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-89edd3b5-a2ed-49a9-93b3-8e02293751ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9437b0d17d64254b0fca98d70079c10'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:02.165194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-89edd3b5-a2ed-49a9-93b3-8e02293751ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9437b0d17d64254b0fca98d70079c10'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:02.165194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-89edd3b5-a2ed-49a9-93b3-8e02293751ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9437b0d17d64254b0fca98d70079c10'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:02.172253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a1d3a41e8846dda90a54d8591afc18'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:02.172960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a1d3a41e8846dda90a54d8591afc18'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:02.173616 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a1d3a41e8846dda90a54d8591afc18'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:02.192859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1057/2129] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:01 2022] DELETE /identity/v3/users/88a1d3a41e8846dda90a54d8591afc18 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:02.194388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:02.196344 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:02.205647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-89edd3b5-a2ed-49a9-93b3-8e02293751ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9437b0d17d64254b0fca98d70079c10'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:02.251647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1073/2130] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:01 2022] DELETE /identity/v3/users/c9437b0d17d64254b0fca98d70079c10 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:02.253757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f841-8379-495a-a9c7-96d2f1b79c4c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:02.260039 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f841-8379-495a-a9c7-96d2f1b79c4c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:02.260664 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f841-8379-495a-a9c7-96d2f1b79c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:02.306206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-3c65f841-8379-495a-a9c7-96d2f1b79c4c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:02.315666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3c65f841-8379-495a-a9c7-96d2f1b79c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:02.381329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16718538-b95b-4b05-9a49-240e2ce38c88 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:02.441597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:02.480557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1074/2131] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:02.503451 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f841-8379-495a-a9c7-96d2f1b79c4c None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:02.505162 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3c65f841-8379-495a-a9c7-96d2f1b79c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:02.505813 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e992c3-1745-4ea8-9509-b2c268e7ccc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:02.506906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e992c3-1745-4ea8-9509-b2c268e7ccc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:02.507199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e992c3-1745-4ea8-9509-b2c268e7ccc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:02.507484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e992c3-1745-4ea8-9509-b2c268e7ccc8 admin admin] PATH_INFO: `/v3/projects/3279618bd1974c568cab3ab195a1ea40/users/e0f91bd3ab8d4c3f8f4b5d6cb37a42aa/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:02.509910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e992c3-1745-4ea8-9509-b2c268e7ccc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3279618bd1974c568cab3ab195a1ea40, user_id=e0f91bd3ab8d4c3f8f4b5d6cb37a42aa, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:02.512758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e992c3-1745-4ea8-9509-b2c268e7ccc8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:02.549043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1058/2132] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:02 2022] PUT /identity/v3/projects/3279618bd1974c568cab3ab195a1ea40/users/e0f91bd3ab8d4c3f8f4b5d6cb37a42aa/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:02.560256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca90bd-52c9-4007-b726-778c5806bf9e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:02.560587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca90bd-52c9-4007-b726-778c5806bf9e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:02.560906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca90bd-52c9-4007-b726-778c5806bf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:02.634292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-79ca90bd-52c9-4007-b726-778c5806bf9e None None] MFA Rules not processed for user `e0f91bd3ab8d4c3f8f4b5d6cb37a42aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:02.636094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-79ca90bd-52c9-4007-b726-778c5806bf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:02.674618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f841-8379-495a-a9c7-96d2f1b79c4c None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:02.716892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:02.737237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef642a6a-f52b-4669-9e04-6ee278b660a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:02.738620 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef642a6a-f52b-4669-9e04-6ee278b660a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:02.738620 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef642a6a-f52b-4669-9e04-6ee278b660a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:02.745493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef642a6a-f52b-4669-9e04-6ee278b660a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:02.818914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1059/2133] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:09:02.841316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca90bd-52c9-4007-b726-778c5806bf9e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:02.842889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-79ca90bd-52c9-4007-b726-778c5806bf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:02.881579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef642a6a-f52b-4669-9e04-6ee278b660a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:02.883465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef642a6a-f52b-4669-9e04-6ee278b660a7 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:02.901075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1075/2134] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:09:02.970500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a686a0-6293-47d1-938e-c5f7433cd43b None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:02.970891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a686a0-6293-47d1-938e-c5f7433cd43b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:02.971186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a686a0-6293-47d1-938e-c5f7433cd43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:02.980174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca90bd-52c9-4007-b726-778c5806bf9e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:02.984793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d72b03-16e4-4708-a5a8-525ad877ea95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:02.985448 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d72b03-16e4-4708-a5a8-525ad877ea95 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:02.985791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d72b03-16e4-4708-a5a8-525ad877ea95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:02.986112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d72b03-16e4-4708-a5a8-525ad877ea95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:03.001231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d72b03-16e4-4708-a5a8-525ad877ea95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:03.002724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d72b03-16e4-4708-a5a8-525ad877ea95 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:03.017892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1060/2135] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:09:03.025011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-04a686a0-6293-47d1-938e-c5f7433cd43b None None] MFA Rules not processed for user `645dd2f8967f499d9c25c6da248df0a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:03.026726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-04a686a0-6293-47d1-938e-c5f7433cd43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:03.081651 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d72b03-16e4-4708-a5a8-525ad877ea95 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:03.083948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c6d72b03-16e4-4708-a5a8-525ad877ea95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:03.106315 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d72b03-16e4-4708-a5a8-525ad877ea95 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:03.111939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:03.112600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:03.112970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:03.113339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] PATH_INFO: `/v3/projects/b9afc3425a4c44289859895c8c1e79ad` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:03.115845 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9afc3425a4c44289859895c8c1e79ad)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:03.118026 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:03.159152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:03.218605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9afc3425a4c44289859895c8c1e79ad', 'request_id': 'req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:03.232309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1076/2136] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:09:03.233809 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a686a0-6293-47d1-938e-c5f7433cd43b None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:03.239362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9afc3425a4c44289859895c8c1e79ad', 'request_id': 'req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:03.257977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a686a0-6293-47d1-938e-c5f7433cd43b None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:03.261913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9afc3425a4c44289859895c8c1e79ad', 'request_id': 'req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:03.283939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] The token cache is being invalidate because project b9afc3425a4c44289859895c8c1e79ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:03.284249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:03.295560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:03.295560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1061/2137] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:03 2022] DELETE /identity/v3/projects/b9afc3425a4c44289859895c8c1e79ad => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:09:03.295560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:03.295560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:03.403184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346104-2527-490b-a292-2e51f815a3fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:03.403905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346104-2527-490b-a292-2e51f815a3fa service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:03.405404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346104-2527-490b-a292-2e51f815a3fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:03.405635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346104-2527-490b-a292-2e51f815a3fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:03.407600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-72346104-2527-490b-a292-2e51f815a3fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:03.456334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:03.497689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e6dcf-9c9c-4d07-a10c-2429bca5af7b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:03.536580 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fd7b7-80ee-43c6-8738-fc2b160a62ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:03.538350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72346104-2527-490b-a292-2e51f815a3fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:03.538843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fd7b7-80ee-43c6-8738-fc2b160a62ab service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:03.539329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fd7b7-80ee-43c6-8738-fc2b160a62ab service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:03.540323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fd7b7-80ee-43c6-8738-fc2b160a62ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:03.541432 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72346104-2527-490b-a292-2e51f815a3fa service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:03.544684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2c8fd7b7-80ee-43c6-8738-fc2b160a62ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:03.580671 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1077/2138] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:03.584092 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12b0e8-2154-4f9c-8990-7e601a019e1f None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:03.584657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12b0e8-2154-4f9c-8990-7e601a019e1f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:03.585495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12b0e8-2154-4f9c-8990-7e601a019e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:03.634478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-5d12b0e8-2154-4f9c-8990-7e601a019e1f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:03.636853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5d12b0e8-2154-4f9c-8990-7e601a019e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:03.673152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fd7b7-80ee-43c6-8738-fc2b160a62ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:03.678187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fd7b7-80ee-43c6-8738-fc2b160a62ab service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:03.713778 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1062/2139] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:03.715926 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fd7b7-80ee-43c6-8738-fc2b160a62ab service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:03.724153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2c8fd7b7-80ee-43c6-8738-fc2b160a62ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:03.819165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1078/2140] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:03.835499 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d3051-8a2c-4d9c-80be-071491e029fa None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:03.836063 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d3051-8a2c-4d9c-80be-071491e029fa None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:03.836316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d3051-8a2c-4d9c-80be-071491e029fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:03.914501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-3e9d3051-8a2c-4d9c-80be-071491e029fa None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:03.917785 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3e9d3051-8a2c-4d9c-80be-071491e029fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:03.939807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fd7b7-80ee-43c6-8738-fc2b160a62ab service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:03.941948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1079/2141] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:03.948288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d3051-8a2c-4d9c-80be-071491e029fa None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:03.968274 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:03.971210 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:03.971708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:03.972293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] PATH_INFO: `/v3/projects/f3a0d5cab04e4ac0ae68860f090f3ef5` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:03.979076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a0d5cab04e4ac0ae68860f090f3ef5)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:03.990883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:04.011131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d3051-8a2c-4d9c-80be-071491e029fa None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:04.024444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53dcd7-228f-4cb2-81aa-0bca440f56ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:04.026355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53dcd7-228f-4cb2-81aa-0bca440f56ff admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:04.026606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53dcd7-228f-4cb2-81aa-0bca440f56ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:04.027057 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53dcd7-228f-4cb2-81aa-0bca440f56ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:04.027819 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53dcd7-228f-4cb2-81aa-0bca440f56ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:09:04.028134 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53dcd7-228f-4cb2-81aa-0bca440f56ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:04.030625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53dcd7-228f-4cb2-81aa-0bca440f56ff admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:04.074867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1080/2142] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:09:04.080464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53dcd7-228f-4cb2-81aa-0bca440f56ff admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:04.100666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53dcd7-228f-4cb2-81aa-0bca440f56ff admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:04.141544 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a0d5cab04e4ac0ae68860f090f3ef5', 'request_id': 'req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:04.156143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:04.161354 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a0d5cab04e4ac0ae68860f090f3ef5', 'request_id': 'req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:04.183929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a0d5cab04e4ac0ae68860f090f3ef5', 'request_id': 'req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:04.208049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] The token cache is being invalidate because project f3a0d5cab04e4ac0ae68860f090f3ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:04.209069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:04.210673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:04.213160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1063/2143] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:03 2022] DELETE /identity/v3/projects/f3a0d5cab04e4ac0ae68860f090f3ef5 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:04.221605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:04.226359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:04.296638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:04.303869 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6041841-7a2b-4b69-9ef7-f8d10fca1890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:04.305102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6041841-7a2b-4b69-9ef7-f8d10fca1890 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:04.305385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6041841-7a2b-4b69-9ef7-f8d10fca1890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:04.305681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6041841-7a2b-4b69-9ef7-f8d10fca1890 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:04.308813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6041841-7a2b-4b69-9ef7-f8d10fca1890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:04.313349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6041841-7a2b-4b69-9ef7-f8d10fca1890 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:04.387310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1081/2144] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:04 2022] POST /identity/v3/projects => generated 373 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:04.391734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6041841-7a2b-4b69-9ef7-f8d10fca1890 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:04.394415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b6041841-7a2b-4b69-9ef7-f8d10fca1890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:04.443834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c877f38-59f0-4f2b-9341-9fa7aa75bce2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:04.574294 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6041841-7a2b-4b69-9ef7-f8d10fca1890 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:04.589900 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba86b25-b68b-41dd-9a49-63bb3452f4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:04.590832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba86b25-b68b-41dd-9a49-63bb3452f4dd admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:04.591131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba86b25-b68b-41dd-9a49-63bb3452f4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:04.591591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba86b25-b68b-41dd-9a49-63bb3452f4dd admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:04.592604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba86b25-b68b-41dd-9a49-63bb3452f4dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:04.594776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba86b25-b68b-41dd-9a49-63bb3452f4dd admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:04.625649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:04.626381 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:04.626679 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:04.627153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] PATH_INFO: `/v3/users/ab75a0a5195a4f839d3fddd9e3b1aac4` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:04.628440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab75a0a5195a4f839d3fddd9e3b1aac4)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:04.633440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:04.644227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1082/2145] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:04 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:04.653057 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba86b25-b68b-41dd-9a49-63bb3452f4dd admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:04.678445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba86b25-b68b-41dd-9a49-63bb3452f4dd admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:04.688254 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b73104-badd-400d-887a-30f048d1086a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:04.689322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b73104-badd-400d-887a-30f048d1086a admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:04.689860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b73104-badd-400d-887a-30f048d1086a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:04.690764 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b73104-badd-400d-887a-30f048d1086a admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:04.692554 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b73104-badd-400d-887a-30f048d1086a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:04.696271 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b73104-badd-400d-887a-30f048d1086a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:04.724551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1083/2146] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:09:04.729419 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b73104-badd-400d-887a-30f048d1086a admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:04.732515 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab75a0a5195a4f839d3fddd9e3b1aac4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:04.757311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab75a0a5195a4f839d3fddd9e3b1aac4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:04.760977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b73104-badd-400d-887a-30f048d1086a admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:04.774708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b82731-103b-4c28-b38c-ad0653adf229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:04.778107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b82731-103b-4c28-b38c-ad0653adf229 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:04.778301 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab75a0a5195a4f839d3fddd9e3b1aac4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:04.779033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b82731-103b-4c28-b38c-ad0653adf229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:04.779286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab75a0a5195a4f839d3fddd9e3b1aac4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:04.779812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b82731-103b-4c28-b38c-ad0653adf229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:04.780553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab75a0a5195a4f839d3fddd9e3b1aac4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:04.781327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b82731-103b-4c28-b38c-ad0653adf229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:04.785805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b82731-103b-4c28-b38c-ad0653adf229 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:04.819752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1064/2147] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:04 2022] DELETE /identity/v3/users/ab75a0a5195a4f839d3fddd9e3b1aac4 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:04.823424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1084/2148] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:04.836751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:04.844403 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:05.057534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:05.098117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c6c41-36cd-4bb6-832f-8edf6597c691 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:05.119975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bef84-2dff-441d-ad37-ab3c419e4ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:05.121290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bef84-2dff-441d-ad37-ab3c419e4ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:05.121666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bef84-2dff-441d-ad37-ab3c419e4ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:05.122246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bef84-2dff-441d-ad37-ab3c419e4ef7 admin admin] PATH_INFO: `/v3/projects/60814d0c5e6a4845baaf0ff56d423168/users/81c8c11e1adc467fa405bdd2f2f07017/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:05.186899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bef84-2dff-441d-ad37-ab3c419e4ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60814d0c5e6a4845baaf0ff56d423168, user_id=81c8c11e1adc467fa405bdd2f2f07017, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:05.192202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bef84-2dff-441d-ad37-ab3c419e4ef7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:05.221279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1065/2149] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:04 2022] PUT /identity/v3/projects/60814d0c5e6a4845baaf0ff56d423168/users/81c8c11e1adc467fa405bdd2f2f07017/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:05.232736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea04e86-cb31-49fa-8d76-3a8779d8f9cc None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:05.233026 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea04e86-cb31-49fa-8d76-3a8779d8f9cc None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:05.233310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea04e86-cb31-49fa-8d76-3a8779d8f9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:05.298635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-6ea04e86-cb31-49fa-8d76-3a8779d8f9cc None None] MFA Rules not processed for user `81c8c11e1adc467fa405bdd2f2f07017`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:05.299967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6ea04e86-cb31-49fa-8d76-3a8779d8f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:05.501414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bef84-2dff-441d-ad37-ab3c419e4ef7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:05.503463 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-720bef84-2dff-441d-ad37-ab3c419e4ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:05.550859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1085/2150] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:05.552999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea04e86-cb31-49fa-8d76-3a8779d8f9cc None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:05.575540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:05.749055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea04e86-cb31-49fa-8d76-3a8779d8f9cc None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:05.758303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f437c59-59d1-4e30-a9fb-ba5d930a0fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:05.759477 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f437c59-59d1-4e30-a9fb-ba5d930a0fad admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:05.759953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f437c59-59d1-4e30-a9fb-ba5d930a0fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:05.760682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f437c59-59d1-4e30-a9fb-ba5d930a0fad admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:05.761838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f437c59-59d1-4e30-a9fb-ba5d930a0fad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:05.766934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f437c59-59d1-4e30-a9fb-ba5d930a0fad admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:05.836798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bef84-2dff-441d-ad37-ab3c419e4ef7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:05.843817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1086/2151] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:05 2022] POST /identity/v3/projects => generated 375 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:05.847416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f437c59-59d1-4e30-a9fb-ba5d930a0fad admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:05.963389 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1319fb5-003c-48b0-9fb6-e5e0323067e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:05.964219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1319fb5-003c-48b0-9fb6-e5e0323067e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:05.964658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1319fb5-003c-48b0-9fb6-e5e0323067e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:05.965049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1319fb5-003c-48b0-9fb6-e5e0323067e3 admin admin] PATH_INFO: `/v3/projects/af101ef5fab8448b85e7a4dc3d84b346` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:05.967740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1319fb5-003c-48b0-9fb6-e5e0323067e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af101ef5fab8448b85e7a4dc3d84b346)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:05.972062 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1319fb5-003c-48b0-9fb6-e5e0323067e3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:06.151553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c1319fb5-003c-48b0-9fb6-e5e0323067e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af101ef5fab8448b85e7a4dc3d84b346', 'request_id': 'req-c1319fb5-003c-48b0-9fb6-e5e0323067e3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:06.183044 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c1319fb5-003c-48b0-9fb6-e5e0323067e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af101ef5fab8448b85e7a4dc3d84b346', 'request_id': 'req-c1319fb5-003c-48b0-9fb6-e5e0323067e3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:06.207801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c1319fb5-003c-48b0-9fb6-e5e0323067e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af101ef5fab8448b85e7a4dc3d84b346', 'request_id': 'req-c1319fb5-003c-48b0-9fb6-e5e0323067e3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:06.214104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f437c59-59d1-4e30-a9fb-ba5d930a0fad admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:06.242982 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c1319fb5-003c-48b0-9fb6-e5e0323067e3 admin admin] The token cache is being invalidate because project af101ef5fab8448b85e7a4dc3d84b346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:06.243421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c1319fb5-003c-48b0-9fb6-e5e0323067e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:06.244993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c1319fb5-003c-48b0-9fb6-e5e0323067e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:06.252875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1066/2152] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:05 2022] DELETE /identity/v3/projects/af101ef5fab8448b85e7a4dc3d84b346 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:09:06.272661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412efc0-3c4b-4700-8f7e-72ead033c0b5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:06.274814 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412efc0-3c4b-4700-8f7e-72ead033c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:06.275277 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412efc0-3c4b-4700-8f7e-72ead033c0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:06.353630 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b412efc0-3c4b-4700-8f7e-72ead033c0b5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:06.357307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b412efc0-3c4b-4700-8f7e-72ead033c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:06.376048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:06.394528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a42de-55f9-4358-8f45-3aa817957270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:06.395492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a42de-55f9-4358-8f45-3aa817957270 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:06.396783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a42de-55f9-4358-8f45-3aa817957270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:06.397043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a42de-55f9-4358-8f45-3aa817957270 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:06.397845 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a42de-55f9-4358-8f45-3aa817957270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:06.403020 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a42de-55f9-4358-8f45-3aa817957270 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:06.445829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1087/2153] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:05 2022] POST /identity/v3/users => generated 294 bytes in 600 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:06.452015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a42de-55f9-4358-8f45-3aa817957270 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:06.462096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-191a42de-55f9-4358-8f45-3aa817957270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:06.535809 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a42de-55f9-4358-8f45-3aa817957270 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:06.551235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1067/2154] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:06.571874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d59dc-e486-4736-baa4-9deceb415ccb None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:06.572500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d59dc-e486-4736-baa4-9deceb415ccb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:06.573078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d59dc-e486-4736-baa4-9deceb415ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:06.574228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69a026-c6a2-4fc3-864e-ee9c7b49d7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:06.575798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69a026-c6a2-4fc3-864e-ee9c7b49d7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:06.577182 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69a026-c6a2-4fc3-864e-ee9c7b49d7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:06.577709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69a026-c6a2-4fc3-864e-ee9c7b49d7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:06.579495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69a026-c6a2-4fc3-864e-ee9c7b49d7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:06.582113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69a026-c6a2-4fc3-864e-ee9c7b49d7b7 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:06.625950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1088/2155] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:06.628922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-140d59dc-e486-4736-baa4-9deceb415ccb None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:06.630161 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69a026-c6a2-4fc3-864e-ee9c7b49d7b7 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:06.635267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-140d59dc-e486-4736-baa4-9deceb415ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:06.661741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69a026-c6a2-4fc3-864e-ee9c7b49d7b7 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:06.671540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707a374-357c-4d43-8267-95084882c4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:06.673552 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707a374-357c-4d43-8267-95084882c4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:06.674435 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707a374-357c-4d43-8267-95084882c4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:06.680465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707a374-357c-4d43-8267-95084882c4f4 admin admin] PATH_INFO: `/v3/projects/7ff5c82a603148fab6a86404feae485b/users/44f7134671b94de187c9e1d78eddea06/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:06.701801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1068/2156] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:06.702608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:06.705900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d59dc-e486-4736-baa4-9deceb415ccb None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:06.707690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707a374-357c-4d43-8267-95084882c4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff5c82a603148fab6a86404feae485b, user_id=44f7134671b94de187c9e1d78eddea06, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:06.712627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707a374-357c-4d43-8267-95084882c4f4 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:06.734391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1089/2157] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:06 2022] PUT /identity/v3/projects/7ff5c82a603148fab6a86404feae485b/users/44f7134671b94de187c9e1d78eddea06/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:06.757708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707a374-357c-4d43-8267-95084882c4f4 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:06.782035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d59dc-e486-4736-baa4-9deceb415ccb None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:06.956522 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a189115-0cd2-4f93-b09e-08204a8898e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:06.957772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a189115-0cd2-4f93-b09e-08204a8898e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:06.957772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a189115-0cd2-4f93-b09e-08204a8898e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:06.959639 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a189115-0cd2-4f93-b09e-08204a8898e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:06.961074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a189115-0cd2-4f93-b09e-08204a8898e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:09:06.961813 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a189115-0cd2-4f93-b09e-08204a8898e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:06.967303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a189115-0cd2-4f93-b09e-08204a8898e8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:06.998515 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1069/2158] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:09:07.002075 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa513482-ab17-4e15-99e1-c30549668133 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:07.002462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa513482-ab17-4e15-99e1-c30549668133 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:07.004751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa513482-ab17-4e15-99e1-c30549668133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:07.070701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-aa513482-ab17-4e15-99e1-c30549668133 None None] MFA Rules not processed for user `9a2db0e2828a430f88c7a0484445a2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:07.072491 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-aa513482-ab17-4e15-99e1-c30549668133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:07.076562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707a374-357c-4d43-8267-95084882c4f4 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:07.095640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa407fde-a762-4e32-96eb-69b4f532fbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:07.098201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa407fde-a762-4e32-96eb-69b4f532fbfd admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:07.100034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa407fde-a762-4e32-96eb-69b4f532fbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:07.100713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa407fde-a762-4e32-96eb-69b4f532fbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:07.102456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa407fde-a762-4e32-96eb-69b4f532fbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:07.109158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa407fde-a762-4e32-96eb-69b4f532fbfd admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:07.152571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1090/2159] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:07.155304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa407fde-a762-4e32-96eb-69b4f532fbfd admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:07.207872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa407fde-a762-4e32-96eb-69b4f532fbfd admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:07.226200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1070/2160] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:07.227232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa513482-ab17-4e15-99e1-c30549668133 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:07.232540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac7603-a9f5-4537-aa3c-f43bb03f1847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:07.235518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac7603-a9f5-4537-aa3c-f43bb03f1847 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:07.235956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac7603-a9f5-4537-aa3c-f43bb03f1847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:07.237286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac7603-a9f5-4537-aa3c-f43bb03f1847 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:07.238151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac7603-a9f5-4537-aa3c-f43bb03f1847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:07.246769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac7603-a9f5-4537-aa3c-f43bb03f1847 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:07.282869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa513482-ab17-4e15-99e1-c30549668133 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:07.308499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a22bda-d02e-4042-8208-27caa9a767d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:07.326201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a22bda-d02e-4042-8208-27caa9a767d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:07.326713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a22bda-d02e-4042-8208-27caa9a767d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:07.327229 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a22bda-d02e-4042-8208-27caa9a767d3 admin admin] PATH_INFO: `/v3/projects/7ff5c82a603148fab6a86404feae485b/users/44f7134671b94de187c9e1d78eddea06/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:07.341381 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a22bda-d02e-4042-8208-27caa9a767d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff5c82a603148fab6a86404feae485b, user_id=44f7134671b94de187c9e1d78eddea06, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:07.344905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1091/2161] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:07 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:07.351734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac7603-a9f5-4537-aa3c-f43bb03f1847 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:07.357638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a22bda-d02e-4042-8208-27caa9a767d3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:07.407826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1071/2162] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:07 2022] PUT /identity/v3/projects/7ff5c82a603148fab6a86404feae485b/users/44f7134671b94de187c9e1d78eddea06/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:07.417158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d547d7-3c54-4ae0-b595-1571a12e5dae None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:07.418397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d547d7-3c54-4ae0-b595-1571a12e5dae None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:07.419384 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d547d7-3c54-4ae0-b595-1571a12e5dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:07.559886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-46d547d7-3c54-4ae0-b595-1571a12e5dae None None] MFA Rules not processed for user `44f7134671b94de187c9e1d78eddea06`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:07.566987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-46d547d7-3c54-4ae0-b595-1571a12e5dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:07.656379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:07.689318 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac7603-a9f5-4537-aa3c-f43bb03f1847 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:07.828300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e0f8c-27d9-43b2-b1c7-08355f09430f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:07.830000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e0f8c-27d9-43b2-b1c7-08355f09430f admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:07.830518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e0f8c-27d9-43b2-b1c7-08355f09430f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:07.831204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e0f8c-27d9-43b2-b1c7-08355f09430f admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:07.832127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e0f8c-27d9-43b2-b1c7-08355f09430f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:07.835440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e0f8c-27d9-43b2-b1c7-08355f09430f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:07.879791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1092/2163] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:07 2022] POST /identity/v3/users => generated 293 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:09:07.891043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e0f8c-27d9-43b2-b1c7-08355f09430f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:07.903271 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:07.917803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e0f8c-27d9-43b2-b1c7-08355f09430f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:07.932638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1072/2164] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:09:07.934524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b480f-948e-426d-a526-02d4f394cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:07.935227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b480f-948e-426d-a526-02d4f394cbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:07.936571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b480f-948e-426d-a526-02d4f394cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:07.936878 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b480f-948e-426d-a526-02d4f394cbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:07.937642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b480f-948e-426d-a526-02d4f394cbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:07.939567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b480f-948e-426d-a526-02d4f394cbe5 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:07.958729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1093/2165] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:07.962349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d547d7-3c54-4ae0-b595-1571a12e5dae None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:07.996427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d547d7-3c54-4ae0-b595-1571a12e5dae None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:08.011675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616ce43-92db-46e3-b02e-81e0ca942074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:08.013143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616ce43-92db-46e3-b02e-81e0ca942074 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:08.016045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616ce43-92db-46e3-b02e-81e0ca942074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:08.016526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616ce43-92db-46e3-b02e-81e0ca942074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:08.017978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616ce43-92db-46e3-b02e-81e0ca942074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:08.023978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616ce43-92db-46e3-b02e-81e0ca942074 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:08.042409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1073/2166] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:08.043849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b480f-948e-426d-a526-02d4f394cbe5 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:08.046604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-274b480f-948e-426d-a526-02d4f394cbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:08.051766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616ce43-92db-46e3-b02e-81e0ca942074 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:08.085901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616ce43-92db-46e3-b02e-81e0ca942074 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:08.106187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fe517-071d-47d9-9484-c724e4ca04bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:08.107350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fe517-071d-47d9-9484-c724e4ca04bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:08.107795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fe517-071d-47d9-9484-c724e4ca04bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:08.108240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fe517-071d-47d9-9484-c724e4ca04bc admin admin] PATH_INFO: `/v3/projects/7a8b85b7ac304a679f12110edd2c63a8/users/9f6af3e17f9c4d3080f841d0743f52af/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:08.132769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fe517-071d-47d9-9484-c724e4ca04bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8b85b7ac304a679f12110edd2c63a8, user_id=9f6af3e17f9c4d3080f841d0743f52af, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:08.136215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fe517-071d-47d9-9484-c724e4ca04bc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:08.167193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1074/2167] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:08 2022] PUT /identity/v3/projects/7a8b85b7ac304a679f12110edd2c63a8/users/9f6af3e17f9c4d3080f841d0743f52af/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:08.168769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b480f-948e-426d-a526-02d4f394cbe5 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:08.182675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16078370-af46-4417-9152-af519e3e88c0 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:08.183069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16078370-af46-4417-9152-af519e3e88c0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:08.183422 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16078370-af46-4417-9152-af519e3e88c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:08.228507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-16078370-af46-4417-9152-af519e3e88c0 None None] MFA Rules not processed for user `9f6af3e17f9c4d3080f841d0743f52af`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:08.229828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-16078370-af46-4417-9152-af519e3e88c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:08.311390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa244fe-37f0-450b-b770-61120f03120f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:08.312268 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa244fe-37f0-450b-b770-61120f03120f service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:08.312478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa244fe-37f0-450b-b770-61120f03120f service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:08.313004 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa244fe-37f0-450b-b770-61120f03120f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:08.315472 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2aa244fe-37f0-450b-b770-61120f03120f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:08.412627 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1075/2168] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:09:08.423276 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16078370-af46-4417-9152-af519e3e88c0 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:08.463969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa244fe-37f0-450b-b770-61120f03120f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:08.467183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa244fe-37f0-450b-b770-61120f03120f service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:08.524227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1094/2169] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:09:08.621470 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16078370-af46-4417-9152-af519e3e88c0 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:08.631636 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a480b2-ce1a-4085-bc58-91d9be1040d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:08.632796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a480b2-ce1a-4085-bc58-91d9be1040d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:08.637109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a480b2-ce1a-4085-bc58-91d9be1040d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:08.637735 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a480b2-ce1a-4085-bc58-91d9be1040d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:08.638856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a480b2-ce1a-4085-bc58-91d9be1040d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:08.640876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a480b2-ce1a-4085-bc58-91d9be1040d6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:08.668188 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:08.708654 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1076/2170] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:08 2022] POST /identity/v3/projects => generated 381 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:09:08.715965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa244fe-37f0-450b-b770-61120f03120f service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:08.768987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa244fe-37f0-450b-b770-61120f03120f service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:08.928586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d8eda-bc93-40f7-84b1-dce520d2cd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:08.929662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d8eda-bc93-40f7-84b1-dce520d2cd6f admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:08.930181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d8eda-bc93-40f7-84b1-dce520d2cd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:08.931132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d8eda-bc93-40f7-84b1-dce520d2cd6f admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:08.932296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d8eda-bc93-40f7-84b1-dce520d2cd6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:08.935663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d8eda-bc93-40f7-84b1-dce520d2cd6f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:08.967034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:09.010227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1095/2171] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:08 2022] POST /identity/v3/users => generated 291 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:09.013480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a480b2-ce1a-4085-bc58-91d9be1040d6 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:09.030194 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a480b2-ce1a-4085-bc58-91d9be1040d6 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:09.044044 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6f4e9-e601-4349-92db-04c545c6a43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:09.046570 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6f4e9-e601-4349-92db-04c545c6a43b admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:09.047008 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6f4e9-e601-4349-92db-04c545c6a43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:09.047648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6f4e9-e601-4349-92db-04c545c6a43b admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:09.049236 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6f4e9-e601-4349-92db-04c545c6a43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:09.054195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6f4e9-e601-4349-92db-04c545c6a43b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:09.081360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1077/2172] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:09.085455 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d8eda-bc93-40f7-84b1-dce520d2cd6f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:09.113818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d8eda-bc93-40f7-84b1-dce520d2cd6f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:09.146563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb473e-4dda-4a6c-bad4-aeb8fd822573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:09.147196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb473e-4dda-4a6c-bad4-aeb8fd822573 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:09.147673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb473e-4dda-4a6c-bad4-aeb8fd822573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:09.148130 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb473e-4dda-4a6c-bad4-aeb8fd822573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:09.149291 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb473e-4dda-4a6c-bad4-aeb8fd822573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:09.154038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb473e-4dda-4a6c-bad4-aeb8fd822573 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:09.193114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1096/2173] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:09.194912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6f4e9-e601-4349-92db-04c545c6a43b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:09.217456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6f4e9-e601-4349-92db-04c545c6a43b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:09.238858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c2696-7e81-4888-a960-26f25760fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:09.240793 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c2696-7e81-4888-a960-26f25760fb94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:09.241187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c2696-7e81-4888-a960-26f25760fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:09.244595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c2696-7e81-4888-a960-26f25760fb94 admin admin] PATH_INFO: `/v3/projects/1c5285af9110415493c3fc9ae198914b/users/9e9f637c45434c83bfd8cde9db09963b/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:09.310406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c2696-7e81-4888-a960-26f25760fb94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5285af9110415493c3fc9ae198914b, user_id=9e9f637c45434c83bfd8cde9db09963b, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:09.317664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c2696-7e81-4888-a960-26f25760fb94 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:09.356658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1078/2174] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:09 2022] PUT /identity/v3/projects/1c5285af9110415493c3fc9ae198914b/users/9e9f637c45434c83bfd8cde9db09963b/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:09.377382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca3b49-293a-4a08-a0b1-5f7441bb8214 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:09.378088 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca3b49-293a-4a08-a0b1-5f7441bb8214 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:09.378635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca3b49-293a-4a08-a0b1-5f7441bb8214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:09.442277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-d9ca3b49-293a-4a08-a0b1-5f7441bb8214 None None] MFA Rules not processed for user `9e9f637c45434c83bfd8cde9db09963b`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:09.452912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d9ca3b49-293a-4a08-a0b1-5f7441bb8214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:09.610282 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1097/2175] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:09.615734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c2696-7e81-4888-a960-26f25760fb94 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:09.713943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c2696-7e81-4888-a960-26f25760fb94 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:09.719370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946afee-ae26-421b-975c-d3e7d69ba3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:09.720119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946afee-ae26-421b-975c-d3e7d69ba3dd admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:09.720494 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946afee-ae26-421b-975c-d3e7d69ba3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:09.720908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946afee-ae26-421b-975c-d3e7d69ba3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:09.721656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946afee-ae26-421b-975c-d3e7d69ba3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:09.723990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946afee-ae26-421b-975c-d3e7d69ba3dd admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:09.788557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca3b49-293a-4a08-a0b1-5f7441bb8214 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:09.798111 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1079/2176] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:09 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:09.813695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca3b49-293a-4a08-a0b1-5f7441bb8214 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:09.939362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d10e-4e86-4ff9-845d-f3759161d05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:09.940126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d10e-4e86-4ff9-845d-f3759161d05e admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:09.940479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d10e-4e86-4ff9-845d-f3759161d05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:09.940768 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d10e-4e86-4ff9-845d-f3759161d05e admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:09.941973 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d10e-4e86-4ff9-845d-f3759161d05e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:09.946124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d10e-4e86-4ff9-845d-f3759161d05e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:10.018961 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1098/2177] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:09 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:10.027743 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946afee-ae26-421b-975c-d3e7d69ba3dd admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:10.068477 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946afee-ae26-421b-975c-d3e7d69ba3dd admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:10.082008 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776c96-153d-4e43-a34b-a23613afe471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:10.086086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776c96-153d-4e43-a34b-a23613afe471 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:10.086669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776c96-153d-4e43-a34b-a23613afe471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:10.087219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776c96-153d-4e43-a34b-a23613afe471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:10.092135 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2776c96-153d-4e43-a34b-a23613afe471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:10.099875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2776c96-153d-4e43-a34b-a23613afe471 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:10.128587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1080/2178] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:10.136883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d10e-4e86-4ff9-845d-f3759161d05e admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:10.175040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d10e-4e86-4ff9-845d-f3759161d05e admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:10.204603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da86b7-f27b-4edb-a1cb-54e6045ccb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:10.217414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da86b7-f27b-4edb-a1cb-54e6045ccb76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:10.217414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da86b7-f27b-4edb-a1cb-54e6045ccb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:10.217414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da86b7-f27b-4edb-a1cb-54e6045ccb76 admin admin] PATH_INFO: `/v3/projects/bf82031f08eb4097bb84056dcecba3f6/users/480cc53bd88b4ef995d1e175182c5e01/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:10.259567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da86b7-f27b-4edb-a1cb-54e6045ccb76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf82031f08eb4097bb84056dcecba3f6, user_id=480cc53bd88b4ef995d1e175182c5e01, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:10.262544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da86b7-f27b-4edb-a1cb-54e6045ccb76 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:10.313627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1099/2179] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:10 2022] PUT /identity/v3/projects/bf82031f08eb4097bb84056dcecba3f6/users/480cc53bd88b4ef995d1e175182c5e01/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:10.319305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776c96-153d-4e43-a34b-a23613afe471 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:10.338107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776c96-153d-4e43-a34b-a23613afe471 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:10.498386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f866cc8-d471-40a8-b988-8e0b89e44cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:10.500264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f866cc8-d471-40a8-b988-8e0b89e44cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:10.501041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f866cc8-d471-40a8-b988-8e0b89e44cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:10.501546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f866cc8-d471-40a8-b988-8e0b89e44cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:10.502454 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f866cc8-d471-40a8-b988-8e0b89e44cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:10.504414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f866cc8-d471-40a8-b988-8e0b89e44cc2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:10.518255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1081/2180] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:10.521817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da86b7-f27b-4edb-a1cb-54e6045ccb76 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:10.578413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da86b7-f27b-4edb-a1cb-54e6045ccb76 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:10.589315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3819f-5249-49b2-97cd-a812cb7a425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:10.590974 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3819f-5249-49b2-97cd-a812cb7a425c admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:10.591760 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3819f-5249-49b2-97cd-a812cb7a425c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:10.592500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3819f-5249-49b2-97cd-a812cb7a425c admin admin] PATH_INFO: `/v3/projects/bf82031f08eb4097bb84056dcecba3f6/users/480cc53bd88b4ef995d1e175182c5e01/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:10.596277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3819f-5249-49b2-97cd-a812cb7a425c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf82031f08eb4097bb84056dcecba3f6, user_id=480cc53bd88b4ef995d1e175182c5e01, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:10.603500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3819f-5249-49b2-97cd-a812cb7a425c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:10.645661 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1100/2181] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:10 2022] PUT /identity/v3/projects/bf82031f08eb4097bb84056dcecba3f6/users/480cc53bd88b4ef995d1e175182c5e01/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:10.682231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47eee4-eb5b-4d2c-92d8-f1b19d96e1c0 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:10.682791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47eee4-eb5b-4d2c-92d8-f1b19d96e1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:10.694272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47eee4-eb5b-4d2c-92d8-f1b19d96e1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:10.780456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ea47eee4-eb5b-4d2c-92d8-f1b19d96e1c0 None None] MFA Rules not processed for user `480cc53bd88b4ef995d1e175182c5e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:10.781941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ea47eee4-eb5b-4d2c-92d8-f1b19d96e1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:10.813253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:10.889650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1082/2182] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:10.902482 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3819f-5249-49b2-97cd-a812cb7a425c admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:10.904381 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-43e3819f-5249-49b2-97cd-a812cb7a425c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:10.941333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:10.994415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3819f-5249-49b2-97cd-a812cb7a425c admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:10.999233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704fbe5-d0a9-4cab-b6b3-6227b429a34f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:11.000354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704fbe5-d0a9-4cab-b6b3-6227b429a34f service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:11.000642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704fbe5-d0a9-4cab-b6b3-6227b429a34f service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:11.000919 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704fbe5-d0a9-4cab-b6b3-6227b429a34f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:11.107960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704fbe5-d0a9-4cab-b6b3-6227b429a34f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:11.109875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704fbe5-d0a9-4cab-b6b3-6227b429a34f service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:11.122038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1101/2183] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:09:11.822059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47eee4-eb5b-4d2c-92d8-f1b19d96e1c0 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:11.938057 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47eee4-eb5b-4d2c-92d8-f1b19d96e1c0 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:11.944668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:11.945397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:11.945752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:11.946085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] PATH_INFO: `/v3/users/81c8c11e1adc467fa405bdd2f2f07017` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:11.947428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c8c11e1adc467fa405bdd2f2f07017)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:11.949495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:12.053169 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c8c11e1adc467fa405bdd2f2f07017'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:12.078254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c8c11e1adc467fa405bdd2f2f07017'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:12.094443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c8c11e1adc467fa405bdd2f2f07017'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:12.096156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c8c11e1adc467fa405bdd2f2f07017'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:12.098059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c8c11e1adc467fa405bdd2f2f07017'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:12.135095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1083/2184] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:11 2022] DELETE /identity/v3/users/81c8c11e1adc467fa405bdd2f2f07017 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:12.141596 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089cb0e-8c6e-436e-9c38-8597699e39b9 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:12.142209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089cb0e-8c6e-436e-9c38-8597699e39b9 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:12.144210 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089cb0e-8c6e-436e-9c38-8597699e39b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:12.178852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-c089cb0e-8c6e-436e-9c38-8597699e39b9 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:12.180834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c089cb0e-8c6e-436e-9c38-8597699e39b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:12.275609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1102/2185] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:12.293987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:12.296653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:12.420961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:12.456373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2b017-211e-43d1-aa4b-ec5eb2cc6836 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:12.462661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868092d-4dde-42ba-b962-c03482ba4612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:12.463500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868092d-4dde-42ba-b962-c03482ba4612 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:12.463835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868092d-4dde-42ba-b962-c03482ba4612 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:12.464179 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868092d-4dde-42ba-b962-c03482ba4612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:12.476763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868092d-4dde-42ba-b962-c03482ba4612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:12.478713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868092d-4dde-42ba-b962-c03482ba4612 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:12.494808 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1084/2186] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:12.953951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089cb0e-8c6e-436e-9c38-8597699e39b9 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:12.955744 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c089cb0e-8c6e-436e-9c38-8597699e39b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:12.979775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089cb0e-8c6e-436e-9c38-8597699e39b9 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:12.986206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:12.986822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:12.987123 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:12.987397 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] PATH_INFO: `/v3/projects/60814d0c5e6a4845baaf0ff56d423168` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:12.988699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] RBAC: Authorizing `identity:delete_project(project_id=60814d0c5e6a4845baaf0ff56d423168)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:12.990799 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:13.057611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60814d0c5e6a4845baaf0ff56d423168', 'request_id': 'req-87df77a8-a6f0-4072-b779-ab07a552722b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:13.067207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60814d0c5e6a4845baaf0ff56d423168', 'request_id': 'req-87df77a8-a6f0-4072-b779-ab07a552722b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:13.078986 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60814d0c5e6a4845baaf0ff56d423168', 'request_id': 'req-87df77a8-a6f0-4072-b779-ab07a552722b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:13.087474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:13.092828 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] The token cache is being invalidate because project 60814d0c5e6a4845baaf0ff56d423168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:13.093235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:13.093980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:13.096248 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1103/2187] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:12 2022] DELETE /identity/v3/projects/60814d0c5e6a4845baaf0ff56d423168 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:13.100257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868092d-4dde-42ba-b962-c03482ba4612 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:13.100907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:13.102385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1868092d-4dde-42ba-b962-c03482ba4612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:13.103062 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:13.180802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df77a8-a6f0-4072-b779-ab07a552722b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:13.186023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:13.186690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:13.187050 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:13.188606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] PATH_INFO: `/v3/users/44f7134671b94de187c9e1d78eddea06` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:13.189283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f7134671b94de187c9e1d78eddea06)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:13.191394 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:13.211406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868092d-4dde-42ba-b962-c03482ba4612 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:13.276963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f7134671b94de187c9e1d78eddea06'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:13.289476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f7134671b94de187c9e1d78eddea06'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:13.290111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f7134671b94de187c9e1d78eddea06'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:13.290769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f7134671b94de187c9e1d78eddea06'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:13.305623 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f7134671b94de187c9e1d78eddea06'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:13.322241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1104/2188] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:13 2022] DELETE /identity/v3/users/44f7134671b94de187c9e1d78eddea06 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:13.323326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd2f39-56af-4b88-92a4-6d84b2be0dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:13.324191 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd2f39-56af-4b88-92a4-6d84b2be0dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:13.324514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd2f39-56af-4b88-92a4-6d84b2be0dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:13.324826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd2f39-56af-4b88-92a4-6d84b2be0dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:13.327229 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f2cd2f39-56af-4b88-92a4-6d84b2be0dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:13.411023 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd2f39-56af-4b88-92a4-6d84b2be0dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:13.412869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd2f39-56af-4b88-92a4-6d84b2be0dd5 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:13.423625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1085/2189] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:13.757474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:13.759137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:13.822014 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd2f39-56af-4b88-92a4-6d84b2be0dd5 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:13.824265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f2cd2f39-56af-4b88-92a4-6d84b2be0dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:13.850359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd2f39-56af-4b88-92a4-6d84b2be0dd5 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:13.917375 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:13.932816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bb2ec-70d7-4000-a146-cf9385f8222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:13.933897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bb2ec-70d7-4000-a146-cf9385f8222a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:13.934402 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bb2ec-70d7-4000-a146-cf9385f8222a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:13.934908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bb2ec-70d7-4000-a146-cf9385f8222a admin admin] PATH_INFO: `/v3/projects/7ff5c82a603148fab6a86404feae485b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:13.937339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bb2ec-70d7-4000-a146-cf9385f8222a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff5c82a603148fab6a86404feae485b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:13.940517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bb2ec-70d7-4000-a146-cf9385f8222a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:13.951587 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a837e0a-a76c-4e08-9eb4-fca378352f5a admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:13.956851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af2e4a-ff6b-40db-b22f-c7cb2023acc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:13.957593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af2e4a-ff6b-40db-b22f-c7cb2023acc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:13.957876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af2e4a-ff6b-40db-b22f-c7cb2023acc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:13.958180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af2e4a-ff6b-40db-b22f-c7cb2023acc2 admin admin] PATH_INFO: `/v3/users/3824fdbe5bc54a14b93ce1e7fbc8c271` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:13.959765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af2e4a-ff6b-40db-b22f-c7cb2023acc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3824fdbe5bc54a14b93ce1e7fbc8c271)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:13.961764 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af2e4a-ff6b-40db-b22f-c7cb2023acc2 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:14.000728 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:14.030851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-267bb2ec-70d7-4000-a146-cf9385f8222a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff5c82a603148fab6a86404feae485b', 'request_id': 'req-267bb2ec-70d7-4000-a146-cf9385f8222a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:14.050343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-267bb2ec-70d7-4000-a146-cf9385f8222a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff5c82a603148fab6a86404feae485b', 'request_id': 'req-267bb2ec-70d7-4000-a146-cf9385f8222a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:14.050946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-87af2e4a-ff6b-40db-b22f-c7cb2023acc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3824fdbe5bc54a14b93ce1e7fbc8c271'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:14.065300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-87af2e4a-ff6b-40db-b22f-c7cb2023acc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3824fdbe5bc54a14b93ce1e7fbc8c271'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:14.066337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-87af2e4a-ff6b-40db-b22f-c7cb2023acc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3824fdbe5bc54a14b93ce1e7fbc8c271'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:14.067342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-87af2e4a-ff6b-40db-b22f-c7cb2023acc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3824fdbe5bc54a14b93ce1e7fbc8c271'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:14.068562 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-267bb2ec-70d7-4000-a146-cf9385f8222a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff5c82a603148fab6a86404feae485b', 'request_id': 'req-267bb2ec-70d7-4000-a146-cf9385f8222a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:14.093790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-267bb2ec-70d7-4000-a146-cf9385f8222a admin admin] The token cache is being invalidate because project 7ff5c82a603148fab6a86404feae485b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:14.094313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-267bb2ec-70d7-4000-a146-cf9385f8222a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:14.097078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-267bb2ec-70d7-4000-a146-cf9385f8222a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:14.099655 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-87af2e4a-ff6b-40db-b22f-c7cb2023acc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3824fdbe5bc54a14b93ce1e7fbc8c271'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:14.104589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1086/2190] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:13 2022] DELETE /identity/v3/projects/7ff5c82a603148fab6a86404feae485b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:14.112975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0d18-4a27-41ee-af6d-4cabdfe2432b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:14.116046 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0d18-4a27-41ee-af6d-4cabdfe2432b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:14.116912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0d18-4a27-41ee-af6d-4cabdfe2432b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:14.136026 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1105/2191] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:13 2022] DELETE /identity/v3/users/3824fdbe5bc54a14b93ce1e7fbc8c271 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:09:14.144485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0466852-0f1f-409f-86dd-5871ddca2e91 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:14.144935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0466852-0f1f-409f-86dd-5871ddca2e91 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:14.146349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0466852-0f1f-409f-86dd-5871ddca2e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:14.180584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4a9e0d18-4a27-41ee-af6d-4cabdfe2432b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:14.180584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4a9e0d18-4a27-41ee-af6d-4cabdfe2432b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:14.217707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-b0466852-0f1f-409f-86dd-5871ddca2e91 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:14.221202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b0466852-0f1f-409f-86dd-5871ddca2e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:14.352752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1087/2192] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:14.366024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea73678-dffc-4a85-adce-8b5f44c03b11 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:14.366785 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea73678-dffc-4a85-adce-8b5f44c03b11 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:14.367064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea73678-dffc-4a85-adce-8b5f44c03b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:14.426286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1106/2193] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:14.427874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7ea73678-dffc-4a85-adce-8b5f44c03b11 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:14.429959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7ea73678-dffc-4a85-adce-8b5f44c03b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:14.431895 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0466852-0f1f-409f-86dd-5871ddca2e91 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:14.433654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b0466852-0f1f-409f-86dd-5871ddca2e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:14.440001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1088/2194] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:14.441068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea73678-dffc-4a85-adce-8b5f44c03b11 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:14.448437 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7ea73678-dffc-4a85-adce-8b5f44c03b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:14.521594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea73678-dffc-4a85-adce-8b5f44c03b11 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:14.525722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f61c2-ef4b-4056-83c8-ade335840e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:14.526423 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f61c2-ef4b-4056-83c8-ade335840e5b service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:14.526711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f61c2-ef4b-4056-83c8-ade335840e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:14.527385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f61c2-ef4b-4056-83c8-ade335840e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:14.531090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0466852-0f1f-409f-86dd-5871ddca2e91 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:14.535156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395641d-f5be-4341-9efe-d0f52e802383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:14.538401 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395641d-f5be-4341-9efe-d0f52e802383 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:14.538401 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395641d-f5be-4341-9efe-d0f52e802383 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:14.538401 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395641d-f5be-4341-9efe-d0f52e802383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:14.541270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f61c2-ef4b-4056-83c8-ade335840e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:14.542878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f61c2-ef4b-4056-83c8-ade335840e5b service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:14.543832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-d395641d-f5be-4341-9efe-d0f52e802383 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:14.555362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1089/2195] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:14.556528 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f61c2-ef4b-4056-83c8-ade335840e5b service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:14.568336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f61c2-ef4b-4056-83c8-ade335840e5b service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:14.574456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baebf58-4633-4b0b-aaba-7555c76ea20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:14.575327 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baebf58-4633-4b0b-aaba-7555c76ea20a admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:14.575688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baebf58-4633-4b0b-aaba-7555c76ea20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:14.576190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baebf58-4633-4b0b-aaba-7555c76ea20a admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:14.577066 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baebf58-4633-4b0b-aaba-7555c76ea20a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:09:14.577449 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baebf58-4633-4b0b-aaba-7555c76ea20a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:14.580775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baebf58-4633-4b0b-aaba-7555c76ea20a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:14.598432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1090/2196] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:09:14.600415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baebf58-4633-4b0b-aaba-7555c76ea20a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:14.605907 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:14.616820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baebf58-4633-4b0b-aaba-7555c76ea20a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:14.625933 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3795ad-d1ab-4ad2-a8f2-e9a87b3efad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:14.627304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3795ad-d1ab-4ad2-a8f2-e9a87b3efad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:14.627769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3795ad-d1ab-4ad2-a8f2-e9a87b3efad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:14.628054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3795ad-d1ab-4ad2-a8f2-e9a87b3efad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:14.629143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3795ad-d1ab-4ad2-a8f2-e9a87b3efad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:14.632610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3795ad-d1ab-4ad2-a8f2-e9a87b3efad8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:14.638277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:14.670069 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395641d-f5be-4341-9efe-d0f52e802383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:14.671890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395641d-f5be-4341-9efe-d0f52e802383 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:14.675906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1091/2197] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:14 2022] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:14.683602 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3795ad-d1ab-4ad2-a8f2-e9a87b3efad8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:14.697520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1107/2198] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:14.794661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3795ad-d1ab-4ad2-a8f2-e9a87b3efad8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:14.801136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e048de-61ca-4042-861a-42babafc5b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:14.802901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e048de-61ca-4042-861a-42babafc5b92 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:14.803203 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e048de-61ca-4042-861a-42babafc5b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:14.803485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e048de-61ca-4042-861a-42babafc5b92 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:14.804294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e048de-61ca-4042-861a-42babafc5b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:14.806298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e048de-61ca-4042-861a-42babafc5b92 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:14.877248 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1092/2199] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:14 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:09:14.878688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395641d-f5be-4341-9efe-d0f52e802383 service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:14.900305 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395641d-f5be-4341-9efe-d0f52e802383 service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:14.909158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df80a2-a75f-4b88-b214-61596d265b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:14.910130 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df80a2-a75f-4b88-b214-61596d265b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:14.910489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df80a2-a75f-4b88-b214-61596d265b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:14.911408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df80a2-a75f-4b88-b214-61596d265b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:14.914223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df80a2-a75f-4b88-b214-61596d265b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:14.917231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df80a2-a75f-4b88-b214-61596d265b79 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:14.939104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1108/2200] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:14.940507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e048de-61ca-4042-861a-42babafc5b92 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:14.957257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e048de-61ca-4042-861a-42babafc5b92 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:14.969968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49ec8c-f297-4507-a038-b58060b62b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:14.969968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49ec8c-f297-4507-a038-b58060b62b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:14.969968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49ec8c-f297-4507-a038-b58060b62b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:14.969968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49ec8c-f297-4507-a038-b58060b62b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:14.970692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49ec8c-f297-4507-a038-b58060b62b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:14.972459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49ec8c-f297-4507-a038-b58060b62b0e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:14.996765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1093/2201] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:09:14.998204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df80a2-a75f-4b88-b214-61596d265b79 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:15.018299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df80a2-a75f-4b88-b214-61596d265b79 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:15.024200 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33115f69-ca0a-4a38-ba16-299305d83226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:15.024900 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33115f69-ca0a-4a38-ba16-299305d83226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:15.025188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33115f69-ca0a-4a38-ba16-299305d83226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:15.025464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33115f69-ca0a-4a38-ba16-299305d83226 admin admin] PATH_INFO: `/v3/projects/87d2d20590574a4a83983f24a6e7a6c2/users/ddc70815fe164287ae7c44e31a414253/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:15.056957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33115f69-ca0a-4a38-ba16-299305d83226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d2d20590574a4a83983f24a6e7a6c2, user_id=ddc70815fe164287ae7c44e31a414253, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:15.060827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33115f69-ca0a-4a38-ba16-299305d83226 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:15.085459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1109/2202] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:14 2022] PUT /identity/v3/projects/87d2d20590574a4a83983f24a6e7a6c2/users/ddc70815fe164287ae7c44e31a414253/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:15.107341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404a47e-335a-4c8d-a5a6-c219e1962e61 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:15.108253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404a47e-335a-4c8d-a5a6-c219e1962e61 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:15.108253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404a47e-335a-4c8d-a5a6-c219e1962e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:15.148414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6404a47e-335a-4c8d-a5a6-c219e1962e61 None None] MFA Rules not processed for user `ddc70815fe164287ae7c44e31a414253`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:15.149757 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6404a47e-335a-4c8d-a5a6-c219e1962e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:15.154704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33115f69-ca0a-4a38-ba16-299305d83226 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:15.156383 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-33115f69-ca0a-4a38-ba16-299305d83226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:15.259185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1094/2203] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:15.274431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33115f69-ca0a-4a38-ba16-299305d83226 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:15.280523 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:15.281280 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:15.281956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:15.282296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] PATH_INFO: `/v3/projects/a004390a97e4480f89d037759260a703` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:15.283498 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a004390a97e4480f89d037759260a703)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:15.284028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404a47e-335a-4c8d-a5a6-c219e1962e61 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:15.285518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:15.287832 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6404a47e-335a-4c8d-a5a6-c219e1962e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:15.344811 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a004390a97e4480f89d037759260a703', 'request_id': 'req-48089f88-a794-4356-bc63-0c5d5bc9a3ab'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:15.355693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a004390a97e4480f89d037759260a703', 'request_id': 'req-48089f88-a794-4356-bc63-0c5d5bc9a3ab'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:15.363461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a004390a97e4480f89d037759260a703', 'request_id': 'req-48089f88-a794-4356-bc63-0c5d5bc9a3ab'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:15.379496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] The token cache is being invalidate because project a004390a97e4480f89d037759260a703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:15.379798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:15.381609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:15.383924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1110/2204] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:15 2022] DELETE /identity/v3/projects/a004390a97e4480f89d037759260a703 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:15.386370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:15.391716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:15.394319 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:15.425556 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404a47e-335a-4c8d-a5a6-c219e1962e61 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:15.487281 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:15.522793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48089f88-a794-4356-bc63-0c5d5bc9a3ab admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:15.524730 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e531da4-b259-48af-bf6e-0fd886aa0c26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b105e7094aea9dcc7423d6205c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:15.525561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e531da4-b259-48af-bf6e-0fd886aa0c26 service glance] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:15.526083 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e531da4-b259-48af-bf6e-0fd886aa0c26 service glance] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:15.526682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e531da4-b259-48af-bf6e-0fd886aa0c26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:15.528780 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4e531da4-b259-48af-bf6e-0fd886aa0c26 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:15.530321 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ed4cf-30b3-4709-b11e-0a0e75adcfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:15.532174 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ed4cf-30b3-4709-b11e-0a0e75adcfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:15.532651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ed4cf-30b3-4709-b11e-0a0e75adcfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:15.533088 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ed4cf-30b3-4709-b11e-0a0e75adcfc3 admin admin] PATH_INFO: `/v3/users/e0f91bd3ab8d4c3f8f4b5d6cb37a42aa` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:15.534607 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ed4cf-30b3-4709-b11e-0a0e75adcfc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f91bd3ab8d4c3f8f4b5d6cb37a42aa)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:15.537254 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ed4cf-30b3-4709-b11e-0a0e75adcfc3 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:15.636856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0c8ed4cf-30b3-4709-b11e-0a0e75adcfc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f91bd3ab8d4c3f8f4b5d6cb37a42aa'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:15.656677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0c8ed4cf-30b3-4709-b11e-0a0e75adcfc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f91bd3ab8d4c3f8f4b5d6cb37a42aa'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:15.657382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e531da4-b259-48af-bf6e-0fd886aa0c26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:15.658533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0c8ed4cf-30b3-4709-b11e-0a0e75adcfc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f91bd3ab8d4c3f8f4b5d6cb37a42aa'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:15.660218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0c8ed4cf-30b3-4709-b11e-0a0e75adcfc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f91bd3ab8d4c3f8f4b5d6cb37a42aa'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:15.660556 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e531da4-b259-48af-bf6e-0fd886aa0c26 service glance] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:15.689192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1095/2205] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:09:15.700075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0c8ed4cf-30b3-4709-b11e-0a0e75adcfc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f91bd3ab8d4c3f8f4b5d6cb37a42aa'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:15.721993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1111/2206] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:15 2022] DELETE /identity/v3/users/e0f91bd3ab8d4c3f8f4b5d6cb37a42aa => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:16.233247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e531da4-b259-48af-bf6e-0fd886aa0c26 service glance] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:16.246462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e531da4-b259-48af-bf6e-0fd886aa0c26 service glance] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:16.359530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:16.360255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:16.360583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:16.360868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d admin admin] PATH_INFO: `/v3/projects/3279618bd1974c568cab3ab195a1ea40` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:16.362063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3279618bd1974c568cab3ab195a1ea40)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:16.364113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:16.469970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:16.486325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3279618bd1974c568cab3ab195a1ea40', 'request_id': 'req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:16.499720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3279618bd1974c568cab3ab195a1ea40', 'request_id': 'req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:16.512548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3279618bd1974c568cab3ab195a1ea40', 'request_id': 'req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:16.545439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d admin admin] The token cache is being invalidate because project 3279618bd1974c568cab3ab195a1ea40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:16.545988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:16.547192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e735bf82-dcb1-4a05-99ff-ae0e8bdcf11d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:16.549763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1096/2207] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:16 2022] DELETE /identity/v3/projects/3279618bd1974c568cab3ab195a1ea40 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:16.558279 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22fa3b-e3f8-4e36-a7e5-a19523901b8a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:16.558931 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22fa3b-e3f8-4e36-a7e5-a19523901b8a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:16.559350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22fa3b-e3f8-4e36-a7e5-a19523901b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:16.602177 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-5b22fa3b-e3f8-4e36-a7e5-a19523901b8a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:16.604299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5b22fa3b-e3f8-4e36-a7e5-a19523901b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:16.692015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1112/2208] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:16.702329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61b3cd-0b87-4411-b002-d16b40ae71a5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:16.702698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61b3cd-0b87-4411-b002-d16b40ae71a5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:16.703151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61b3cd-0b87-4411-b002-d16b40ae71a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:16.737498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ff61b3cd-0b87-4411-b002-d16b40ae71a5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:16.745373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ff61b3cd-0b87-4411-b002-d16b40ae71a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:16.755587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1097/2209] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:16.765383 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22fa3b-e3f8-4e36-a7e5-a19523901b8a None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:16.783351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22fa3b-e3f8-4e36-a7e5-a19523901b8a None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:16.794526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c3e53-f932-4f16-b526-3149351a98a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:16.795448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c3e53-f932-4f16-b526-3149351a98a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:16.795731 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c3e53-f932-4f16-b526-3149351a98a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:16.796013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c3e53-f932-4f16-b526-3149351a98a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:16.796853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c3e53-f932-4f16-b526-3149351a98a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:09:16.797192 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c3e53-f932-4f16-b526-3149351a98a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:16.798938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c3e53-f932-4f16-b526-3149351a98a7 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:16.825071 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1113/2210] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:09:16.830142 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61b3cd-0b87-4411-b002-d16b40ae71a5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:16.848061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61b3cd-0b87-4411-b002-d16b40ae71a5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:16.858350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48ca94-e8f3-4df0-ae11-e491386ce0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:16.859586 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48ca94-e8f3-4df0-ae11-e491386ce0cc admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:16.860102 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48ca94-e8f3-4df0-ae11-e491386ce0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:16.860625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48ca94-e8f3-4df0-ae11-e491386ce0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:16.861771 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48ca94-e8f3-4df0-ae11-e491386ce0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:16.865885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48ca94-e8f3-4df0-ae11-e491386ce0cc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:16.913147 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1098/2211] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:16 2022] POST /identity/v3/projects => generated 357 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:16.917867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c3e53-f932-4f16-b526-3149351a98a7 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:16.929670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c3e53-f932-4f16-b526-3149351a98a7 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:16.995124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:17.011179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8723e-b586-4c2e-8230-7a324562710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:17.020491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8723e-b586-4c2e-8230-7a324562710f admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:17.022333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8723e-b586-4c2e-8230-7a324562710f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:17.022333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8723e-b586-4c2e-8230-7a324562710f admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:17.024635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8723e-b586-4c2e-8230-7a324562710f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:17.028532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8723e-b586-4c2e-8230-7a324562710f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:17.062889 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1114/2212] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:16 2022] POST /identity/v3/users => generated 279 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:17.067627 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48ca94-e8f3-4df0-ae11-e491386ce0cc admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:17.087908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48ca94-e8f3-4df0-ae11-e491386ce0cc admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:17.095245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096da3-c27a-419f-bb75-4b81eed91c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:17.096720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096da3-c27a-419f-bb75-4b81eed91c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:17.097287 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096da3-c27a-419f-bb75-4b81eed91c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:17.097868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096da3-c27a-419f-bb75-4b81eed91c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:17.098826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096da3-c27a-419f-bb75-4b81eed91c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:17.101120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096da3-c27a-419f-bb75-4b81eed91c93 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:17.115141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1099/2213] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:17.118797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8723e-b586-4c2e-8230-7a324562710f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:17.139422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8723e-b586-4c2e-8230-7a324562710f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:17.148936 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2e2a4-83ff-41d9-8c8f-b99b72ec9d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:17.150057 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2e2a4-83ff-41d9-8c8f-b99b72ec9d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:17.150549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2e2a4-83ff-41d9-8c8f-b99b72ec9d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:17.151310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2e2a4-83ff-41d9-8c8f-b99b72ec9d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:17.152626 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2e2a4-83ff-41d9-8c8f-b99b72ec9d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:17.158211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2e2a4-83ff-41d9-8c8f-b99b72ec9d15 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:17.181993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1115/2214] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:17.187648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096da3-c27a-419f-bb75-4b81eed91c93 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:17.201155 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096da3-c27a-419f-bb75-4b81eed91c93 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:17.212101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f6a0d-9553-4ed9-9cce-f505e02957cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:17.213189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f6a0d-9553-4ed9-9cce-f505e02957cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:17.213526 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f6a0d-9553-4ed9-9cce-f505e02957cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:17.213859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f6a0d-9553-4ed9-9cce-f505e02957cb admin admin] PATH_INFO: `/v3/projects/d509f434423f40589c09219066503d58/users/121630608c7d4da0ad0976b22a0bac27/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:17.238726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f6a0d-9553-4ed9-9cce-f505e02957cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d509f434423f40589c09219066503d58, user_id=121630608c7d4da0ad0976b22a0bac27, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:17.242293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f6a0d-9553-4ed9-9cce-f505e02957cb admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:17.282993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1100/2215] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:17 2022] PUT /identity/v3/projects/d509f434423f40589c09219066503d58/users/121630608c7d4da0ad0976b22a0bac27/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:09:17.289392 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24316f58-c42c-45cd-aa80-48f8b2f49d40 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:17.289887 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24316f58-c42c-45cd-aa80-48f8b2f49d40 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:17.290533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24316f58-c42c-45cd-aa80-48f8b2f49d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:17.343385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-24316f58-c42c-45cd-aa80-48f8b2f49d40 None None] MFA Rules not processed for user `121630608c7d4da0ad0976b22a0bac27`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:17.345379 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-24316f58-c42c-45cd-aa80-48f8b2f49d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:17.481430 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1116/2216] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:17.486256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f6a0d-9553-4ed9-9cce-f505e02957cb admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:17.604080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f6a0d-9553-4ed9-9cce-f505e02957cb admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:17.608646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229f10c-fbd2-4d65-962e-4535ed771249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:17.609595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229f10c-fbd2-4d65-962e-4535ed771249 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:17.610087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229f10c-fbd2-4d65-962e-4535ed771249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:17.610878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229f10c-fbd2-4d65-962e-4535ed771249 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:17.612075 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229f10c-fbd2-4d65-962e-4535ed771249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:17.615316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229f10c-fbd2-4d65-962e-4535ed771249 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:17.685233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24316f58-c42c-45cd-aa80-48f8b2f49d40 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:17.686215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1101/2217] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:17 2022] POST /identity/v3/projects => generated 357 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:09:17.710670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24316f58-c42c-45cd-aa80-48f8b2f49d40 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:17.828142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c396728-0d35-4fbb-bba6-c0218537c448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:17.829740 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c396728-0d35-4fbb-bba6-c0218537c448 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:17.830345 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c396728-0d35-4fbb-bba6-c0218537c448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:17.830968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c396728-0d35-4fbb-bba6-c0218537c448 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:17.832288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c396728-0d35-4fbb-bba6-c0218537c448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:17.836730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c396728-0d35-4fbb-bba6-c0218537c448 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:17.875003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1117/2218] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:17 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:17.883214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229f10c-fbd2-4d65-962e-4535ed771249 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:17.894701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229f10c-fbd2-4d65-962e-4535ed771249 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:17.900887 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c7cf2-319b-4233-98bd-1f35a55aec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:17.901529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c7cf2-319b-4233-98bd-1f35a55aec8b admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:17.902238 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c7cf2-319b-4233-98bd-1f35a55aec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:17.902238 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c7cf2-319b-4233-98bd-1f35a55aec8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:17.903107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c7cf2-319b-4233-98bd-1f35a55aec8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:17.905100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c7cf2-319b-4233-98bd-1f35a55aec8b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:17.918670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1102/2219] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:09:17.923529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c396728-0d35-4fbb-bba6-c0218537c448 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:17.935473 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c396728-0d35-4fbb-bba6-c0218537c448 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:17.940377 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25704-4a87-4a1d-a78c-b74393321d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:17.941151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25704-4a87-4a1d-a78c-b74393321d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:17.941492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25704-4a87-4a1d-a78c-b74393321d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:17.941841 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25704-4a87-4a1d-a78c-b74393321d64 admin admin] PATH_INFO: `/v3/projects/678e50cc3b634fc1bf708e7d5d1fe2bb/users/abc5ee505e7949dfb07d3267ce501189/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:17.962024 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb25704-4a87-4a1d-a78c-b74393321d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=678e50cc3b634fc1bf708e7d5d1fe2bb, user_id=abc5ee505e7949dfb07d3267ce501189, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:17.966101 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb25704-4a87-4a1d-a78c-b74393321d64 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:17.995030 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1118/2220] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:17 2022] PUT /identity/v3/projects/678e50cc3b634fc1bf708e7d5d1fe2bb/users/abc5ee505e7949dfb07d3267ce501189/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:17.999916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c7cf2-319b-4233-98bd-1f35a55aec8b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:18.014449 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c7cf2-319b-4233-98bd-1f35a55aec8b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:18.072464 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:18.096598 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a573d-0be5-4e99-a44f-61a8a8ff6d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:18.097243 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a573d-0be5-4e99-a44f-61a8a8ff6d9d admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:18.097563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a573d-0be5-4e99-a44f-61a8a8ff6d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:18.097835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a573d-0be5-4e99-a44f-61a8a8ff6d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:18.098499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a573d-0be5-4e99-a44f-61a8a8ff6d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:18.100411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a573d-0be5-4e99-a44f-61a8a8ff6d9d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:18.111669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1103/2221] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:18.117439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25704-4a87-4a1d-a78c-b74393321d64 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:18.137396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25704-4a87-4a1d-a78c-b74393321d64 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:18.145394 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143dfd0-a21b-4615-96ae-7ec4e100954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:18.147143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143dfd0-a21b-4615-96ae-7ec4e100954d admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:18.148910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143dfd0-a21b-4615-96ae-7ec4e100954d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:18.148910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143dfd0-a21b-4615-96ae-7ec4e100954d admin admin] PATH_INFO: `/v3/projects/678e50cc3b634fc1bf708e7d5d1fe2bb/users/abc5ee505e7949dfb07d3267ce501189/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:18.157718 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143dfd0-a21b-4615-96ae-7ec4e100954d admin admin] RBAC: Authorizing `identity:create_grant(project_id=678e50cc3b634fc1bf708e7d5d1fe2bb, user_id=abc5ee505e7949dfb07d3267ce501189, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:18.165669 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143dfd0-a21b-4615-96ae-7ec4e100954d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:18.182419 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1119/2222] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:18 2022] PUT /identity/v3/projects/678e50cc3b634fc1bf708e7d5d1fe2bb/users/abc5ee505e7949dfb07d3267ce501189/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:18.197015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27715502-5287-43a2-9f06-b4058b544732 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:18.197481 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27715502-5287-43a2-9f06-b4058b544732 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:18.197836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27715502-5287-43a2-9f06-b4058b544732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:18.236998 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-27715502-5287-43a2-9f06-b4058b544732 None None] MFA Rules not processed for user `abc5ee505e7949dfb07d3267ce501189`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:18.241147 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-27715502-5287-43a2-9f06-b4058b544732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:18.332275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1104/2223] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:18.351543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143dfd0-a21b-4615-96ae-7ec4e100954d admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:18.354191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a143dfd0-a21b-4615-96ae-7ec4e100954d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:18.381514 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:18.444940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143dfd0-a21b-4615-96ae-7ec4e100954d admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:18.452779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426051ce-2bf3-456e-8acc-07297aab49dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:18.453708 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426051ce-2bf3-456e-8acc-07297aab49dd service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:18.454159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426051ce-2bf3-456e-8acc-07297aab49dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:18.454604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426051ce-2bf3-456e-8acc-07297aab49dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:18.472553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426051ce-2bf3-456e-8acc-07297aab49dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:18.476824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426051ce-2bf3-456e-8acc-07297aab49dd service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:18.495862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1120/2224] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:18.598547 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27715502-5287-43a2-9f06-b4058b544732 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:18.613410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27715502-5287-43a2-9f06-b4058b544732 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:18.618316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee3efe-1692-437d-94b7-be9f8b7c93ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:18.619256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee3efe-1692-437d-94b7-be9f8b7c93ea service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:18.619798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee3efe-1692-437d-94b7-be9f8b7c93ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:18.620394 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee3efe-1692-437d-94b7-be9f8b7c93ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:18.725016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee3efe-1692-437d-94b7-be9f8b7c93ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:18.727729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee3efe-1692-437d-94b7-be9f8b7c93ea service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:18.746585 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1105/2225] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:09:19.153453 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426051ce-2bf3-456e-8acc-07297aab49dd service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:19.155494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-426051ce-2bf3-456e-8acc-07297aab49dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:19.250313 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426051ce-2bf3-456e-8acc-07297aab49dd service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:19.255260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:19.255922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:19.256300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:19.256605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] PATH_INFO: `/v3/users/9f6af3e17f9c4d3080f841d0743f52af` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:19.258012 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f6af3e17f9c4d3080f841d0743f52af)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:19.260248 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:19.326705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f6af3e17f9c4d3080f841d0743f52af'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:19.337665 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f6af3e17f9c4d3080f841d0743f52af'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:19.338333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f6af3e17f9c4d3080f841d0743f52af'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:19.338965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f6af3e17f9c4d3080f841d0743f52af'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:19.354484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f6af3e17f9c4d3080f841d0743f52af'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:19.373710 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1121/2226] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:19 2022] DELETE /identity/v3/users/9f6af3e17f9c4d3080f841d0743f52af => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:09:19.378714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e0542-bbbb-4f0d-aaec-7d2e3b727b03 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:19.379298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e0542-bbbb-4f0d-aaec-7d2e3b727b03 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:19.379298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e0542-bbbb-4f0d-aaec-7d2e3b727b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:19.405455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-3c9e0542-bbbb-4f0d-aaec-7d2e3b727b03 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:19.406719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3c9e0542-bbbb-4f0d-aaec-7d2e3b727b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:19.508046 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:19.517163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1106/2227] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:09:19.530998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:19.532601 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:19.578536 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:19.615409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f7da3-80e8-4f49-8443-96d030e733b9 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:19.619326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4107256-bd26-4130-9fbf-85835adbaef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:19.619974 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4107256-bd26-4130-9fbf-85835adbaef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:19.620397 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4107256-bd26-4130-9fbf-85835adbaef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:19.620556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4107256-bd26-4130-9fbf-85835adbaef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:19.631968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4107256-bd26-4130-9fbf-85835adbaef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:19.633424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4107256-bd26-4130-9fbf-85835adbaef2 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:19.649083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1122/2228] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:09:20.195294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e0542-bbbb-4f0d-aaec-7d2e3b727b03 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:20.203209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3c9e0542-bbbb-4f0d-aaec-7d2e3b727b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:20.265521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e0542-bbbb-4f0d-aaec-7d2e3b727b03 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:20.285123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:20.285960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:20.286456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:20.287044 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] PATH_INFO: `/v3/projects/7a8b85b7ac304a679f12110edd2c63a8` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:20.293986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8b85b7ac304a679f12110edd2c63a8)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:20.296325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:20.381738 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8b85b7ac304a679f12110edd2c63a8', 'request_id': 'req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:20.393483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8b85b7ac304a679f12110edd2c63a8', 'request_id': 'req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:20.413255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8b85b7ac304a679f12110edd2c63a8', 'request_id': 'req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:20.429566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] The token cache is being invalidate because project 7a8b85b7ac304a679f12110edd2c63a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:20.430590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:20.432799 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:20.435389 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1107/2229] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:20 2022] DELETE /identity/v3/projects/7a8b85b7ac304a679f12110edd2c63a8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:20.441529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4107256-bd26-4130-9fbf-85835adbaef2 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:20.462091 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4107256-bd26-4130-9fbf-85835adbaef2 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:20.580676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:20.582011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:20.582670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:20.583860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] PATH_INFO: `/v3/users/9e9f637c45434c83bfd8cde9db09963b` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:20.586255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9f637c45434c83bfd8cde9db09963b)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:20.593881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:20.693655 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9f637c45434c83bfd8cde9db09963b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:20.705202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9f637c45434c83bfd8cde9db09963b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:20.706506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9f637c45434c83bfd8cde9db09963b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:20.707631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9f637c45434c83bfd8cde9db09963b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:20.735569 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9f637c45434c83bfd8cde9db09963b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:20.758104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1123/2230] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:20 2022] DELETE /identity/v3/users/9e9f637c45434c83bfd8cde9db09963b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:21.566129 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:21.569562 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:21.629608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071c5fd-38d0-4562-a9ff-a74fa3b6ba13 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:21.798227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:21.799307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:21.800333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:21.800999 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] PATH_INFO: `/v3/projects/1c5285af9110415493c3fc9ae198914b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:21.804721 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5285af9110415493c3fc9ae198914b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:21.809740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:21.928247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5285af9110415493c3fc9ae198914b', 'request_id': 'req-11a208ea-a090-48a6-a08b-42ca21c9a0a7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:21.962294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5285af9110415493c3fc9ae198914b', 'request_id': 'req-11a208ea-a090-48a6-a08b-42ca21c9a0a7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:21.983310 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5285af9110415493c3fc9ae198914b', 'request_id': 'req-11a208ea-a090-48a6-a08b-42ca21c9a0a7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:22.009230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] The token cache is being invalidate because project 1c5285af9110415493c3fc9ae198914b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:22.009562 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:22.012709 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:22.014543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1108/2231] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:21 2022] DELETE /identity/v3/projects/1c5285af9110415493c3fc9ae198914b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:09:22.019220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:22.028738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:22.073472 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749aa5b-8daa-438b-a99c-bf1e2dd831e7 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:22.182813 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:22.198149 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:22.200949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:22.201791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:22.202465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] PATH_INFO: `/v3/users/480cc53bd88b4ef995d1e175182c5e01` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:22.205199 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=480cc53bd88b4ef995d1e175182c5e01)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:22.210658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:22.270239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:22.273407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:22.308505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480cc53bd88b4ef995d1e175182c5e01'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:22.319081 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a208ea-a090-48a6-a08b-42ca21c9a0a7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:22.326539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:22.326837 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480cc53bd88b4ef995d1e175182c5e01'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:22.327307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:22.327533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:22.327791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] PATH_INFO: `/v3/users/c8eed745175b4c02af199f7655ea0231` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:22.327907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480cc53bd88b4ef995d1e175182c5e01'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:22.328809 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480cc53bd88b4ef995d1e175182c5e01'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:22.328997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8eed745175b4c02af199f7655ea0231)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:22.331016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:22.340126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:22.353862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480cc53bd88b4ef995d1e175182c5e01'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:22.387676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1124/2232] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:22 2022] DELETE /identity/v3/users/480cc53bd88b4ef995d1e175182c5e01 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:22.411434 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8eed745175b4c02af199f7655ea0231'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:22.432858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8eed745175b4c02af199f7655ea0231'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:22.446578 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8eed745175b4c02af199f7655ea0231'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:22.447743 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8eed745175b4c02af199f7655ea0231'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:22.448849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8eed745175b4c02af199f7655ea0231'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:22.474233 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1109/2233] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:22 2022] DELETE /identity/v3/users/c8eed745175b4c02af199f7655ea0231 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:22.820423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:22.823616 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:22.840056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:22.841713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:22.949294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1183e-9bbf-4c00-9ca0-8e2dbe060e41 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:22.967951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:22.969094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:22.969590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:22.970018 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af admin admin] PATH_INFO: `/v3/projects/bf82031f08eb4097bb84056dcecba3f6` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:22.972064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf82031f08eb4097bb84056dcecba3f6)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:22.977372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:23.025320 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb9009-4012-4998-8879-84a107395cb0 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:23.040500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:23.041663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:23.042183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:23.058409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] PATH_INFO: `/v3/projects/3e9e50c4294641f38b63c3c421ec1abc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:23.058409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9e50c4294641f38b63c3c421ec1abc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:23.058409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:23.084241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf82031f08eb4097bb84056dcecba3f6', 'request_id': 'req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.093829 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf82031f08eb4097bb84056dcecba3f6', 'request_id': 'req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.106989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf82031f08eb4097bb84056dcecba3f6', 'request_id': 'req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.151078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af admin admin] The token cache is being invalidate because project bf82031f08eb4097bb84056dcecba3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:23.154821 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.156977 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-18647dcf-23df-4a64-b6d4-d2f20cf1c1af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.165592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1110/2234] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:22 2022] DELETE /identity/v3/projects/bf82031f08eb4097bb84056dcecba3f6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:09:23.168231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b49af-975d-48db-b6cd-415d3577cca4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:23.168727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b49af-975d-48db-b6cd-415d3577cca4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:23.169228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b49af-975d-48db-b6cd-415d3577cca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:23.186942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9e50c4294641f38b63c3c421ec1abc', 'request_id': 'req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.203544 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9e50c4294641f38b63c3c421ec1abc', 'request_id': 'req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.209978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9e8b49af-975d-48db-b6cd-415d3577cca4 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:23.212184 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9e8b49af-975d-48db-b6cd-415d3577cca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:23.231384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9e50c4294641f38b63c3c421ec1abc', 'request_id': 'req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.239322 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:23.248553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] The token cache is being invalidate because project 3e9e50c4294641f38b63c3c421ec1abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:23.249267 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.250322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.255877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1125/2235] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:22 2022] DELETE /identity/v3/projects/3e9e50c4294641f38b63c3c421ec1abc => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:09:23.258945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:23.261086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:23.271709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:23.369877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1111/2236] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:23.371779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bdac8-c4a5-4d7a-9c17-ffa5e218ee49 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:23.372117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bdac8-c4a5-4d7a-9c17-ffa5e218ee49 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:23.372638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bdac8-c4a5-4d7a-9c17-ffa5e218ee49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:23.386997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfb4e6-1531-431a-b0a7-ceb5c0b1e0b0 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:23.393621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaf37a-30ea-41ae-8015-221c3f2a3493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:23.393621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaf37a-30ea-41ae-8015-221c3f2a3493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:23.394225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaf37a-30ea-41ae-8015-221c3f2a3493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:23.394225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaf37a-30ea-41ae-8015-221c3f2a3493 admin admin] PATH_INFO: `/v3/users/ae5e4a0fa5044537856129960a8a44de` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:23.396213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aaf37a-30ea-41ae-8015-221c3f2a3493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5e4a0fa5044537856129960a8a44de)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:23.400629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aaf37a-30ea-41ae-8015-221c3f2a3493 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:23.410199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5c6bdac8-c4a5-4d7a-9c17-ffa5e218ee49 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:23.412180 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5c6bdac8-c4a5-4d7a-9c17-ffa5e218ee49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:23.424984 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1112/2237] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:09:23.430291 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bdac8-c4a5-4d7a-9c17-ffa5e218ee49 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:23.440388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bdac8-c4a5-4d7a-9c17-ffa5e218ee49 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:23.447113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46edb2-4c04-40f2-a9f5-a4ebb856100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:23.447738 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46edb2-4c04-40f2-a9f5-a4ebb856100f admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:23.448019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46edb2-4c04-40f2-a9f5-a4ebb856100f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:23.448297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46edb2-4c04-40f2-a9f5-a4ebb856100f admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:23.449001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46edb2-4c04-40f2-a9f5-a4ebb856100f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:09:23.449632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46edb2-4c04-40f2-a9f5-a4ebb856100f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:23.452045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46edb2-4c04-40f2-a9f5-a4ebb856100f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:23.474229 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1113/2238] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:09:23.479030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46edb2-4c04-40f2-a9f5-a4ebb856100f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:23.497322 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46edb2-4c04-40f2-a9f5-a4ebb856100f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:23.503244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-90aaf37a-30ea-41ae-8015-221c3f2a3493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5e4a0fa5044537856129960a8a44de'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.503762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8e920-835d-44a3-99e9-c6dbd25a773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:23.504393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8e920-835d-44a3-99e9-c6dbd25a773c admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:23.504678 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8e920-835d-44a3-99e9-c6dbd25a773c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:23.505542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8e920-835d-44a3-99e9-c6dbd25a773c admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:23.506495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8e920-835d-44a3-99e9-c6dbd25a773c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:23.508805 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8e920-835d-44a3-99e9-c6dbd25a773c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:23.516897 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-90aaf37a-30ea-41ae-8015-221c3f2a3493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5e4a0fa5044537856129960a8a44de'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.518571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-90aaf37a-30ea-41ae-8015-221c3f2a3493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5e4a0fa5044537856129960a8a44de'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.519617 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-90aaf37a-30ea-41ae-8015-221c3f2a3493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5e4a0fa5044537856129960a8a44de'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.551507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1114/2239] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:23 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:09:23.556546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8e920-835d-44a3-99e9-c6dbd25a773c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:23.558394 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-90aaf37a-30ea-41ae-8015-221c3f2a3493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5e4a0fa5044537856129960a8a44de'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:23.559955 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-34f8e920-835d-44a3-99e9-c6dbd25a773c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:23.581617 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1126/2240] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:23 2022] DELETE /identity/v3/users/ae5e4a0fa5044537856129960a8a44de => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:23.657229 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8e920-835d-44a3-99e9-c6dbd25a773c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:23.780350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca797273-ed2b-4866-a45f-f41b14d89617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:23.781581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca797273-ed2b-4866-a45f-f41b14d89617 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:23.782091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca797273-ed2b-4866-a45f-f41b14d89617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:23.782610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca797273-ed2b-4866-a45f-f41b14d89617 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:23.783896 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca797273-ed2b-4866-a45f-f41b14d89617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:23.788429 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca797273-ed2b-4866-a45f-f41b14d89617 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:23.843575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1115/2241] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:23 2022] POST /identity/v3/users => generated 286 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:09:23.851465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaf37a-30ea-41ae-8015-221c3f2a3493 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:23.881880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaf37a-30ea-41ae-8015-221c3f2a3493 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:23.893433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea3d0a-8323-43eb-a923-5e856a581748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:23.894712 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea3d0a-8323-43eb-a923-5e856a581748 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:23.895452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea3d0a-8323-43eb-a923-5e856a581748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:23.896800 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea3d0a-8323-43eb-a923-5e856a581748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:23.897863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea3d0a-8323-43eb-a923-5e856a581748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:23.899651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea3d0a-8323-43eb-a923-5e856a581748 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:23.916043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca797273-ed2b-4866-a45f-f41b14d89617 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:23.918883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1127/2242] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:23.920709 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ca797273-ed2b-4866-a45f-f41b14d89617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:23.924374 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea3d0a-8323-43eb-a923-5e856a581748 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:23.947194 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca797273-ed2b-4866-a45f-f41b14d89617 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:23.958927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea3d0a-8323-43eb-a923-5e856a581748 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:23.965371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578b5ac-cd9a-47e5-a888-af3beb6e5253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:23.966251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578b5ac-cd9a-47e5-a888-af3beb6e5253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:23.966629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578b5ac-cd9a-47e5-a888-af3beb6e5253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:23.967370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578b5ac-cd9a-47e5-a888-af3beb6e5253 admin admin] PATH_INFO: `/v3/projects/3d678693e1ee4635be237a7faa3fafb1` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:23.968031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021eb39-5d2e-4094-80bc-fae94be1db8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:23.968863 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578b5ac-cd9a-47e5-a888-af3beb6e5253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d678693e1ee4635be237a7faa3fafb1)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:23.969081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021eb39-5d2e-4094-80bc-fae94be1db8d admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:23.969081 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021eb39-5d2e-4094-80bc-fae94be1db8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:23.969339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021eb39-5d2e-4094-80bc-fae94be1db8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:23.970851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578b5ac-cd9a-47e5-a888-af3beb6e5253 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:23.971034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021eb39-5d2e-4094-80bc-fae94be1db8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:23.974476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021eb39-5d2e-4094-80bc-fae94be1db8d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:23.984235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:23.986879 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1128/2243] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:23.992892 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021eb39-5d2e-4094-80bc-fae94be1db8d admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:24.006212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021eb39-5d2e-4094-80bc-fae94be1db8d admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:24.015158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf1b1a-99f1-4f16-b259-e7b13a67ab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:24.017508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf1b1a-99f1-4f16-b259-e7b13a67ab79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:24.018355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf1b1a-99f1-4f16-b259-e7b13a67ab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:24.018845 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf1b1a-99f1-4f16-b259-e7b13a67ab79 admin admin] PATH_INFO: `/v3/projects/e648803a23e244b3acd05b5956e7b5ad/users/bdb7a936e17f43a0960ebdf6d93d3909/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:24.046048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf1b1a-99f1-4f16-b259-e7b13a67ab79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e648803a23e244b3acd05b5956e7b5ad, user_id=bdb7a936e17f43a0960ebdf6d93d3909, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:24.050354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf1b1a-99f1-4f16-b259-e7b13a67ab79 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:24.082947 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1129/2244] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:23 2022] PUT /identity/v3/projects/e648803a23e244b3acd05b5956e7b5ad/users/bdb7a936e17f43a0960ebdf6d93d3909/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:09:24.102158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46248d3-12e0-4876-a1d0-0b5d294d6cbe None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:24.103231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46248d3-12e0-4876-a1d0-0b5d294d6cbe None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:24.103600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46248d3-12e0-4876-a1d0-0b5d294d6cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:24.113061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5578b5ac-cd9a-47e5-a888-af3beb6e5253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d678693e1ee4635be237a7faa3fafb1', 'request_id': 'req-5578b5ac-cd9a-47e5-a888-af3beb6e5253'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:24.122389 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5578b5ac-cd9a-47e5-a888-af3beb6e5253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d678693e1ee4635be237a7faa3fafb1', 'request_id': 'req-5578b5ac-cd9a-47e5-a888-af3beb6e5253'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:24.134098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5578b5ac-cd9a-47e5-a888-af3beb6e5253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d678693e1ee4635be237a7faa3fafb1', 'request_id': 'req-5578b5ac-cd9a-47e5-a888-af3beb6e5253'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:24.141094 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-f46248d3-12e0-4876-a1d0-0b5d294d6cbe None None] MFA Rules not processed for user `bdb7a936e17f43a0960ebdf6d93d3909`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:24.143154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f46248d3-12e0-4876-a1d0-0b5d294d6cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:24.178353 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5578b5ac-cd9a-47e5-a888-af3beb6e5253 admin admin] The token cache is being invalidate because project 3d678693e1ee4635be237a7faa3fafb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:24.179355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5578b5ac-cd9a-47e5-a888-af3beb6e5253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:24.180676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-5578b5ac-cd9a-47e5-a888-af3beb6e5253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:24.183064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1116/2245] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:23 2022] DELETE /identity/v3/projects/3d678693e1ee4635be237a7faa3fafb1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:24.190626 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:24.193575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdfeee-2904-4ffc-b44f-99dcd0f1964b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:24.194583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdfeee-2904-4ffc-b44f-99dcd0f1964b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:24.195332 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdfeee-2904-4ffc-b44f-99dcd0f1964b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:24.232899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-fabdfeee-2904-4ffc-b44f-99dcd0f1964b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:24.234395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fabdfeee-2904-4ffc-b44f-99dcd0f1964b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:24.248608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1130/2246] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:09:24.264496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46248d3-12e0-4876-a1d0-0b5d294d6cbe None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:24.266262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f46248d3-12e0-4876-a1d0-0b5d294d6cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:24.371607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1117/2247] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:24.380555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79573421-3611-43fd-982f-dc6e83fc58af None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:24.380555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79573421-3611-43fd-982f-dc6e83fc58af None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:24.380555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79573421-3611-43fd-982f-dc6e83fc58af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:24.385843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46248d3-12e0-4876-a1d0-0b5d294d6cbe None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:24.390992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8048438-afbd-40dc-9af5-289fb6ba4333 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b105e7094aea9dcc7423d6205c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:24.391644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8048438-afbd-40dc-9af5-289fb6ba4333 service glance] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:24.391921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8048438-afbd-40dc-9af5-289fb6ba4333 service glance] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:24.392288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8048438-afbd-40dc-9af5-289fb6ba4333 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:24.408785 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8048438-afbd-40dc-9af5-289fb6ba4333 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:24.410721 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8048438-afbd-40dc-9af5-289fb6ba4333 service glance] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:24.416598 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-79573421-3611-43fd-982f-dc6e83fc58af None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:24.418534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-79573421-3611-43fd-982f-dc6e83fc58af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:24.426082 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1131/2248] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:24.433340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1118/2249] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:24.437448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8048438-afbd-40dc-9af5-289fb6ba4333 service glance] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:24.462369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8048438-afbd-40dc-9af5-289fb6ba4333 service glance] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:24.490784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a48cca-8c77-4342-98fe-dbdd28d86759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:24.491727 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a48cca-8c77-4342-98fe-dbdd28d86759 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:24.492828 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a48cca-8c77-4342-98fe-dbdd28d86759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:24.493880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a48cca-8c77-4342-98fe-dbdd28d86759 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:24.495854 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a48cca-8c77-4342-98fe-dbdd28d86759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:09:24.496383 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a48cca-8c77-4342-98fe-dbdd28d86759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:24.499680 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a48cca-8c77-4342-98fe-dbdd28d86759 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:24.531557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1132/2250] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 21:09:24.538357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79573421-3611-43fd-982f-dc6e83fc58af None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:24.554476 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79573421-3611-43fd-982f-dc6e83fc58af None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:24.560372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479f3c3-10a3-4ea8-96d1-b73d45cee52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:24.561337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479f3c3-10a3-4ea8-96d1-b73d45cee52f admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:24.561875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479f3c3-10a3-4ea8-96d1-b73d45cee52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:24.562040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479f3c3-10a3-4ea8-96d1-b73d45cee52f admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:24.562561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479f3c3-10a3-4ea8-96d1-b73d45cee52f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:24.565073 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479f3c3-10a3-4ea8-96d1-b73d45cee52f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:24.617376 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1119/2251] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:24 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:24.618771 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a48cca-8c77-4342-98fe-dbdd28d86759 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:24.638159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a48cca-8c77-4342-98fe-dbdd28d86759 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:24.765262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b95973-79ae-4bbe-bdfa-55cc79b1d5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:24.766096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b95973-79ae-4bbe-bdfa-55cc79b1d5be admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:24.766527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b95973-79ae-4bbe-bdfa-55cc79b1d5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:24.767025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b95973-79ae-4bbe-bdfa-55cc79b1d5be admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:24.768545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b95973-79ae-4bbe-bdfa-55cc79b1d5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:24.773661 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b95973-79ae-4bbe-bdfa-55cc79b1d5be admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:24.811861 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1133/2252] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:24 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:09:24.818501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479f3c3-10a3-4ea8-96d1-b73d45cee52f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:24.836859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479f3c3-10a3-4ea8-96d1-b73d45cee52f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:24.842704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35609d59-e549-40fd-8579-ac4c950fb97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:24.843361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35609d59-e549-40fd-8579-ac4c950fb97f admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:24.843641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35609d59-e549-40fd-8579-ac4c950fb97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:24.844381 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35609d59-e549-40fd-8579-ac4c950fb97f admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:24.844563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35609d59-e549-40fd-8579-ac4c950fb97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:24.846224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35609d59-e549-40fd-8579-ac4c950fb97f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:24.863422 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1120/2253] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:24.870692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b95973-79ae-4bbe-bdfa-55cc79b1d5be admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:24.889249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b95973-79ae-4bbe-bdfa-55cc79b1d5be admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:24.898826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a753bad-f23d-4089-a85d-3de448026411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:24.900157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a753bad-f23d-4089-a85d-3de448026411 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:24.900753 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a753bad-f23d-4089-a85d-3de448026411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:24.901402 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a753bad-f23d-4089-a85d-3de448026411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:24.902875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a753bad-f23d-4089-a85d-3de448026411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:24.906131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a753bad-f23d-4089-a85d-3de448026411 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:24.932975 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1134/2254] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:24.945234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35609d59-e549-40fd-8579-ac4c950fb97f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:24.964191 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35609d59-e549-40fd-8579-ac4c950fb97f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:24.972068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597678a5-1234-4a55-b15e-d56f07026fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:24.973173 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597678a5-1234-4a55-b15e-d56f07026fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:24.974534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597678a5-1234-4a55-b15e-d56f07026fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:24.975301 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597678a5-1234-4a55-b15e-d56f07026fe0 admin admin] PATH_INFO: `/v3/projects/0cb673e76fec4d459b1c0739f2b01247/users/8c7608ab9ed1446895ae25238efb48fd/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:24.996400 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597678a5-1234-4a55-b15e-d56f07026fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb673e76fec4d459b1c0739f2b01247, user_id=8c7608ab9ed1446895ae25238efb48fd, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:24.999826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597678a5-1234-4a55-b15e-d56f07026fe0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:25.027366 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1121/2255] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:24 2022] PUT /identity/v3/projects/0cb673e76fec4d459b1c0739f2b01247/users/8c7608ab9ed1446895ae25238efb48fd/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:25.046350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d2157-5017-44b6-980d-85b806407313 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:25.047111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d2157-5017-44b6-980d-85b806407313 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:25.047111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d2157-5017-44b6-980d-85b806407313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:25.085196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-0c0d2157-5017-44b6-980d-85b806407313 None None] MFA Rules not processed for user `8c7608ab9ed1446895ae25238efb48fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:25.086707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0c0d2157-5017-44b6-980d-85b806407313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:25.118142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:25.226826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1135/2256] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:25.312352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597678a5-1234-4a55-b15e-d56f07026fe0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:25.314903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-597678a5-1234-4a55-b15e-d56f07026fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:25.368581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:25.415500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597678a5-1234-4a55-b15e-d56f07026fe0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:25.419548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158db2d-4f5a-4432-bc1d-f95a3d98ab4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:25.420182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158db2d-4f5a-4432-bc1d-f95a3d98ab4b service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:25.420465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158db2d-4f5a-4432-bc1d-f95a3d98ab4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:25.420740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158db2d-4f5a-4432-bc1d-f95a3d98ab4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:25.431869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158db2d-4f5a-4432-bc1d-f95a3d98ab4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:25.433264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158db2d-4f5a-4432-bc1d-f95a3d98ab4b service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:25.445322 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1122/2257] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:09:25.470444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d2157-5017-44b6-980d-85b806407313 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:25.565337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d2157-5017-44b6-980d-85b806407313 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:25.572178 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:25.572726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:25.572989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:25.573324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] PATH_INFO: `/v3/users/8c7608ab9ed1446895ae25238efb48fd` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:25.574665 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7608ab9ed1446895ae25238efb48fd)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:25.576994 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:25.658998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7608ab9ed1446895ae25238efb48fd'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:25.668360 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7608ab9ed1446895ae25238efb48fd'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:25.669214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7608ab9ed1446895ae25238efb48fd'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:25.669929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7608ab9ed1446895ae25238efb48fd'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:25.688685 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7608ab9ed1446895ae25238efb48fd'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:25.706220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1136/2258] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:25 2022] DELETE /identity/v3/users/8c7608ab9ed1446895ae25238efb48fd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:25.713788 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55be9-43dd-479d-bda2-8f96b3ec5236 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:25.714091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55be9-43dd-479d-bda2-8f96b3ec5236 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:25.714447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55be9-43dd-479d-bda2-8f96b3ec5236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:25.754570 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-52d55be9-43dd-479d-bda2-8f96b3ec5236 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:25.757588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-52d55be9-43dd-479d-bda2-8f96b3ec5236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:25.865807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1123/2259] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:09:25.875918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:25.877508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:25.942596 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:25.962349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d17b2-cc4c-4ede-8bf4-6240993f2dce admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:25.967609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18807358-fe71-4cd1-83c6-d3218e0931f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:25.968489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18807358-fe71-4cd1-83c6-d3218e0931f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:25.968983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18807358-fe71-4cd1-83c6-d3218e0931f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:25.969353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18807358-fe71-4cd1-83c6-d3218e0931f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:25.987673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18807358-fe71-4cd1-83c6-d3218e0931f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:25.987673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18807358-fe71-4cd1-83c6-d3218e0931f9 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:26.002790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1137/2260] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:26.372941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d55be9-43dd-479d-bda2-8f96b3ec5236 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:26.375446 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-52d55be9-43dd-479d-bda2-8f96b3ec5236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:26.418471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d55be9-43dd-479d-bda2-8f96b3ec5236 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:26.435103 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04a6dc-854f-46aa-92f7-b45318c87925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:26.435762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04a6dc-854f-46aa-92f7-b45318c87925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:26.436491 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04a6dc-854f-46aa-92f7-b45318c87925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:26.437208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04a6dc-854f-46aa-92f7-b45318c87925 admin admin] PATH_INFO: `/v3/projects/0cb673e76fec4d459b1c0739f2b01247` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:26.439259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04a6dc-854f-46aa-92f7-b45318c87925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb673e76fec4d459b1c0739f2b01247)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:26.441809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04a6dc-854f-46aa-92f7-b45318c87925 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:26.526251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2e04a6dc-854f-46aa-92f7-b45318c87925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb673e76fec4d459b1c0739f2b01247', 'request_id': 'req-2e04a6dc-854f-46aa-92f7-b45318c87925'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:26.533475 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2e04a6dc-854f-46aa-92f7-b45318c87925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb673e76fec4d459b1c0739f2b01247', 'request_id': 'req-2e04a6dc-854f-46aa-92f7-b45318c87925'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:26.546266 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2e04a6dc-854f-46aa-92f7-b45318c87925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb673e76fec4d459b1c0739f2b01247', 'request_id': 'req-2e04a6dc-854f-46aa-92f7-b45318c87925'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:26.563341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2e04a6dc-854f-46aa-92f7-b45318c87925 admin admin] The token cache is being invalidate because project 0cb673e76fec4d459b1c0739f2b01247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:26.563810 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2e04a6dc-854f-46aa-92f7-b45318c87925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:26.564498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2e04a6dc-854f-46aa-92f7-b45318c87925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:26.566063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1124/2261] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:26 2022] DELETE /identity/v3/projects/0cb673e76fec4d459b1c0739f2b01247 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:26.572017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f503a-f5d1-4b24-8e33-c47e30f126c2 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:26.572571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f503a-f5d1-4b24-8e33-c47e30f126c2 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:26.572710 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f503a-f5d1-4b24-8e33-c47e30f126c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:26.598178 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-109f503a-f5d1-4b24-8e33-c47e30f126c2 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:26.601656 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-109f503a-f5d1-4b24-8e33-c47e30f126c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:26.712446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1138/2262] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:09:26.724759 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efa895-e969-4aa6-8293-25b29a0b327e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:26.725163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efa895-e969-4aa6-8293-25b29a0b327e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:26.725637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efa895-e969-4aa6-8293-25b29a0b327e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:26.748014 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-47efa895-e969-4aa6-8293-25b29a0b327e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:26.749385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-47efa895-e969-4aa6-8293-25b29a0b327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:26.760987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1125/2263] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:26.768953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f503a-f5d1-4b24-8e33-c47e30f126c2 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:26.790467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f503a-f5d1-4b24-8e33-c47e30f126c2 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:26.799356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e561b-3a25-496e-a47b-6bdef6ab21a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:26.800470 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e561b-3a25-496e-a47b-6bdef6ab21a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:26.800945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e561b-3a25-496e-a47b-6bdef6ab21a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:26.801427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e561b-3a25-496e-a47b-6bdef6ab21a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:26.802914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e561b-3a25-496e-a47b-6bdef6ab21a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:09:26.803487 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e561b-3a25-496e-a47b-6bdef6ab21a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:26.806636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e561b-3a25-496e-a47b-6bdef6ab21a5 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:26.829716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1139/2264] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:09:26.835906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efa895-e969-4aa6-8293-25b29a0b327e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:26.852484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efa895-e969-4aa6-8293-25b29a0b327e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:26.861410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8bef3-521c-4643-9e14-50ef533be992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:26.865620 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8bef3-521c-4643-9e14-50ef533be992 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:26.866120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8bef3-521c-4643-9e14-50ef533be992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:26.867045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8bef3-521c-4643-9e14-50ef533be992 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:26.876117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8bef3-521c-4643-9e14-50ef533be992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:26.881361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8bef3-521c-4643-9e14-50ef533be992 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:26.920395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1126/2265] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:26 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:26.926511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e561b-3a25-496e-a47b-6bdef6ab21a5 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:26.947185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e561b-3a25-496e-a47b-6bdef6ab21a5 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:27.061540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8278b0-591a-49e6-a1f4-37fac58a8792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:27.062184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8278b0-591a-49e6-a1f4-37fac58a8792 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:27.062466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8278b0-591a-49e6-a1f4-37fac58a8792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:27.062755 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8278b0-591a-49e6-a1f4-37fac58a8792 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:27.067518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8278b0-591a-49e6-a1f4-37fac58a8792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:27.075851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8278b0-591a-49e6-a1f4-37fac58a8792 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:27.116791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1140/2266] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:26 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:27.121108 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8bef3-521c-4643-9e14-50ef533be992 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:27.133735 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8bef3-521c-4643-9e14-50ef533be992 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:27.138536 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4aaa2-eaee-4d4a-8d6f-214edc9ac225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:27.139347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4aaa2-eaee-4d4a-8d6f-214edc9ac225 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:27.139659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4aaa2-eaee-4d4a-8d6f-214edc9ac225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:27.139974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4aaa2-eaee-4d4a-8d6f-214edc9ac225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:27.140738 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4aaa2-eaee-4d4a-8d6f-214edc9ac225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:27.142540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4aaa2-eaee-4d4a-8d6f-214edc9ac225 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:27.154165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1127/2267] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:27.158812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8278b0-591a-49e6-a1f4-37fac58a8792 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:27.171601 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8278b0-591a-49e6-a1f4-37fac58a8792 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:27.177787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a4a40-f0e3-4640-8f17-ef041448371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:27.178513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a4a40-f0e3-4640-8f17-ef041448371b admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:27.178937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a4a40-f0e3-4640-8f17-ef041448371b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:27.179226 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a4a40-f0e3-4640-8f17-ef041448371b admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:27.179942 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a4a40-f0e3-4640-8f17-ef041448371b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:27.181550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a4a40-f0e3-4640-8f17-ef041448371b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:27.193839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1141/2268] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:27.200145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4aaa2-eaee-4d4a-8d6f-214edc9ac225 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:27.216005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4aaa2-eaee-4d4a-8d6f-214edc9ac225 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:27.224747 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b256dd-e66b-4bf2-a4d8-86c86b66b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:27.225893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b256dd-e66b-4bf2-a4d8-86c86b66b118 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:27.226527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b256dd-e66b-4bf2-a4d8-86c86b66b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:27.227146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b256dd-e66b-4bf2-a4d8-86c86b66b118 admin admin] PATH_INFO: `/v3/projects/b0f4a4fbd9cc4c3bb96c816b200b4d7e/users/1762e003b6a64d51a42f4f57502712bc/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:27.252214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b256dd-e66b-4bf2-a4d8-86c86b66b118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f4a4fbd9cc4c3bb96c816b200b4d7e, user_id=1762e003b6a64d51a42f4f57502712bc, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:27.255054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b256dd-e66b-4bf2-a4d8-86c86b66b118 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:27.257618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:27.277415 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1128/2269] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:27 2022] PUT /identity/v3/projects/b0f4a4fbd9cc4c3bb96c816b200b4d7e/users/1762e003b6a64d51a42f4f57502712bc/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:27.283014 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fce57-3dfe-42f3-b83b-05e5ca70f358 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:27.283291 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fce57-3dfe-42f3-b83b-05e5ca70f358 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:27.283598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fce57-3dfe-42f3-b83b-05e5ca70f358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:27.307737 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-c53fce57-3dfe-42f3-b83b-05e5ca70f358 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:27.309899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c53fce57-3dfe-42f3-b83b-05e5ca70f358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:27.384356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:27.412145 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1142/2270] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:27.423216 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b256dd-e66b-4bf2-a4d8-86c86b66b118 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:27.425064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-12b256dd-e66b-4bf2-a4d8-86c86b66b118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:27.503244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b256dd-e66b-4bf2-a4d8-86c86b66b118 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:27.508316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f143ee0-e225-4e02-92c3-28c4b4847af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:27.508826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143ee0-e225-4e02-92c3-28c4b4847af0 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:27.509109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143ee0-e225-4e02-92c3-28c4b4847af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:27.509388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143ee0-e225-4e02-92c3-28c4b4847af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:27.519915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f143ee0-e225-4e02-92c3-28c4b4847af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:27.521401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f143ee0-e225-4e02-92c3-28c4b4847af0 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:27.531830 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1129/2271] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:28.304188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b7c65-c08e-46ca-8ee8-974779670420 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:28.306215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b7c65-c08e-46ca-8ee8-974779670420 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:28.306824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b7c65-c08e-46ca-8ee8-974779670420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:28.358373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-3b4b7c65-c08e-46ca-8ee8-974779670420 None None] MFA Rules not processed for user `1762e003b6a64d51a42f4f57502712bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:28.359750 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3b4b7c65-c08e-46ca-8ee8-974779670420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:28.488614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1143/2272] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:28.598413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f143ee0-e225-4e02-92c3-28c4b4847af0 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:28.601506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1f143ee0-e225-4e02-92c3-28c4b4847af0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:28.713593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f143ee0-e225-4e02-92c3-28c4b4847af0 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:28.718426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d08c55-b073-40a0-8288-5865c29e80ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:28.719717 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08c55-b073-40a0-8288-5865c29e80ba service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:28.720335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08c55-b073-40a0-8288-5865c29e80ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:28.721377 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08c55-b073-40a0-8288-5865c29e80ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:28.761308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d08c55-b073-40a0-8288-5865c29e80ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:28.762657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d08c55-b073-40a0-8288-5865c29e80ba service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:28.776152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1130/2273] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:30.185433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4edb8b-6540-42da-94f9-b65762cb8d03 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:30.186048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4edb8b-6540-42da-94f9-b65762cb8d03 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:30.186048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4edb8b-6540-42da-94f9-b65762cb8d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:30.215517 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-3f4edb8b-6540-42da-94f9-b65762cb8d03 None None] MFA Rules not processed for user `1762e003b6a64d51a42f4f57502712bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:30.218208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3f4edb8b-6540-42da-94f9-b65762cb8d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:30.228312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1144/2274] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:09:38.466559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d08c55-b073-40a0-8288-5865c29e80ba service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:38.469230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-84d08c55-b073-40a0-8288-5865c29e80ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:38.498535 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d08c55-b073-40a0-8288-5865c29e80ba service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:38.504313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:38.505944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:38.506444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:38.508342 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] PATH_INFO: `/v3/users/121630608c7d4da0ad0976b22a0bac27` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:38.510048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121630608c7d4da0ad0976b22a0bac27)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:38.512560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:38.625023 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121630608c7d4da0ad0976b22a0bac27'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:38.659101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121630608c7d4da0ad0976b22a0bac27'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:38.690485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121630608c7d4da0ad0976b22a0bac27'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:38.691740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121630608c7d4da0ad0976b22a0bac27'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:38.694799 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121630608c7d4da0ad0976b22a0bac27'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:38.724327 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1131/2275] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:38 2022] DELETE /identity/v3/users/121630608c7d4da0ad0976b22a0bac27 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:38.730206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36149f-5563-4cfa-80cf-b4b6ad8bb9f9 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:38.731125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36149f-5563-4cfa-80cf-b4b6ad8bb9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:38.731125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36149f-5563-4cfa-80cf-b4b6ad8bb9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:38.756669 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-2a36149f-5563-4cfa-80cf-b4b6ad8bb9f9 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:38.758261 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2a36149f-5563-4cfa-80cf-b4b6ad8bb9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:38.855509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1145/2276] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:38.867170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:38.869012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:38.884523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:38.939685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc82c4-fc5d-49d6-9529-1338c03709b9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:38.944910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b358-3295-4115-b274-70ebc9d27c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:38.945784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b358-3295-4115-b274-70ebc9d27c7c service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:38.946133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b358-3295-4115-b274-70ebc9d27c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:38.946537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b358-3295-4115-b274-70ebc9d27c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:38.963692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667b358-3295-4115-b274-70ebc9d27c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:38.966561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667b358-3295-4115-b274-70ebc9d27c7c service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:38.986365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1132/2277] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:09:39.998682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36149f-5563-4cfa-80cf-b4b6ad8bb9f9 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:40.009836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2a36149f-5563-4cfa-80cf-b4b6ad8bb9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:40.040413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36149f-5563-4cfa-80cf-b4b6ad8bb9f9 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:40.056004 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:40.056666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:40.056953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:40.057233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] PATH_INFO: `/v3/projects/d509f434423f40589c09219066503d58` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:40.058553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d509f434423f40589c09219066503d58)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:40.060654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:40.177142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd509f434423f40589c09219066503d58', 'request_id': 'req-aabde462-b51f-4713-b907-dbd34e4c4969'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:40.196604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd509f434423f40589c09219066503d58', 'request_id': 'req-aabde462-b51f-4713-b907-dbd34e4c4969'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:40.210191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd509f434423f40589c09219066503d58', 'request_id': 'req-aabde462-b51f-4713-b907-dbd34e4c4969'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:40.247421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:40.261382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] The token cache is being invalidate because project d509f434423f40589c09219066503d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:40.261382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:40.263076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:40.267161 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1146/2278] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:39 2022] DELETE /identity/v3/projects/d509f434423f40589c09219066503d58 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:40.272253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b358-3295-4115-b274-70ebc9d27c7c service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:40.287250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b358-3295-4115-b274-70ebc9d27c7c service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:40.531492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15be7eb-5d8e-4476-b8d2-90fcb8eac6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:40.532404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15be7eb-5d8e-4476-b8d2-90fcb8eac6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:40.532818 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15be7eb-5d8e-4476-b8d2-90fcb8eac6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:40.533380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15be7eb-5d8e-4476-b8d2-90fcb8eac6fc admin admin] PATH_INFO: `/v3/users/abc5ee505e7949dfb07d3267ce501189` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:40.538356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15be7eb-5d8e-4476-b8d2-90fcb8eac6fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc5ee505e7949dfb07d3267ce501189)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:40.544868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15be7eb-5d8e-4476-b8d2-90fcb8eac6fc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:40.653879 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e15be7eb-5d8e-4476-b8d2-90fcb8eac6fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc5ee505e7949dfb07d3267ce501189'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:40.676026 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e15be7eb-5d8e-4476-b8d2-90fcb8eac6fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc5ee505e7949dfb07d3267ce501189'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:40.695639 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e15be7eb-5d8e-4476-b8d2-90fcb8eac6fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc5ee505e7949dfb07d3267ce501189'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:40.696391 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e15be7eb-5d8e-4476-b8d2-90fcb8eac6fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc5ee505e7949dfb07d3267ce501189'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:40.697017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e15be7eb-5d8e-4476-b8d2-90fcb8eac6fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc5ee505e7949dfb07d3267ce501189'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:40.722400 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1133/2279] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:09:40 2022] DELETE /identity/v3/users/abc5ee505e7949dfb07d3267ce501189 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:41.303591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:41.309555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:41.326416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabde462-b51f-4713-b907-dbd34e4c4969 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:41.414493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c3844-ae3c-4574-8c3c-0f96310dba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:41.415223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c3844-ae3c-4574-8c3c-0f96310dba3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:41.415555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c3844-ae3c-4574-8c3c-0f96310dba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:41.415806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c3844-ae3c-4574-8c3c-0f96310dba3c admin admin] PATH_INFO: `/v3/projects/678e50cc3b634fc1bf708e7d5d1fe2bb` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:41.417619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c3844-ae3c-4574-8c3c-0f96310dba3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=678e50cc3b634fc1bf708e7d5d1fe2bb)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:41.419527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c3844-ae3c-4574-8c3c-0f96310dba3c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:41.530552 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-391c3844-ae3c-4574-8c3c-0f96310dba3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '678e50cc3b634fc1bf708e7d5d1fe2bb', 'request_id': 'req-391c3844-ae3c-4574-8c3c-0f96310dba3c'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:41.558042 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-391c3844-ae3c-4574-8c3c-0f96310dba3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '678e50cc3b634fc1bf708e7d5d1fe2bb', 'request_id': 'req-391c3844-ae3c-4574-8c3c-0f96310dba3c'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:41.575469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-391c3844-ae3c-4574-8c3c-0f96310dba3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '678e50cc3b634fc1bf708e7d5d1fe2bb', 'request_id': 'req-391c3844-ae3c-4574-8c3c-0f96310dba3c'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:41.618440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-391c3844-ae3c-4574-8c3c-0f96310dba3c admin admin] The token cache is being invalidate because project 678e50cc3b634fc1bf708e7d5d1fe2bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:09:41.618997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-391c3844-ae3c-4574-8c3c-0f96310dba3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:41.620138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-391c3844-ae3c-4574-8c3c-0f96310dba3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:09:41.624514 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1147/2280] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:09:41 2022] DELETE /identity/v3/projects/678e50cc3b634fc1bf708e7d5d1fe2bb => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:41.628374 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1416-d91c-4bd1-8521-1169256b81a7 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:41.628986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1416-d91c-4bd1-8521-1169256b81a7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:41.628986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1416-d91c-4bd1-8521-1169256b81a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:41.663081 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-950b1416-d91c-4bd1-8521-1169256b81a7 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:41.665746 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-950b1416-d91c-4bd1-8521-1169256b81a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:41.713676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:41.783978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1134/2281] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:09:41.792415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc01a8-abc1-4932-95e0-ed5525d3e59d None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:41.792707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc01a8-abc1-4932-95e0-ed5525d3e59d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:41.792992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc01a8-abc1-4932-95e0-ed5525d3e59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:41.820092 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-f0cc01a8-abc1-4932-95e0-ed5525d3e59d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:41.823640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f0cc01a8-abc1-4932-95e0-ed5525d3e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:41.845711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1148/2282] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:41.850855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b1416-d91c-4bd1-8521-1169256b81a7 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:41.879535 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b1416-d91c-4bd1-8521-1169256b81a7 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:41.890547 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d6705-12b0-4af5-afdb-ff746d10e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:41.891754 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d6705-12b0-4af5-afdb-ff746d10e644 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:41.892657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d6705-12b0-4af5-afdb-ff746d10e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:41.894897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d6705-12b0-4af5-afdb-ff746d10e644 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:41.896733 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d6705-12b0-4af5-afdb-ff746d10e644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:09:41.897972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d6705-12b0-4af5-afdb-ff746d10e644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:41.902286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d6705-12b0-4af5-afdb-ff746d10e644 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:41.920908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1135/2283] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:09:41.928880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc01a8-abc1-4932-95e0-ed5525d3e59d None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:41.968543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc01a8-abc1-4932-95e0-ed5525d3e59d None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:41.979263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1462bc9-0268-4183-b41b-f28e27dd84fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:41.980551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1462bc9-0268-4183-b41b-f28e27dd84fc admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:41.981179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1462bc9-0268-4183-b41b-f28e27dd84fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:41.981691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1462bc9-0268-4183-b41b-f28e27dd84fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:41.983323 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1462bc9-0268-4183-b41b-f28e27dd84fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:41.987943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1462bc9-0268-4183-b41b-f28e27dd84fc admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:42.055075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1149/2284] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:41 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:42.057531 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d6705-12b0-4af5-afdb-ff746d10e644 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:42.077571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d6705-12b0-4af5-afdb-ff746d10e644 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:42.156856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d17b2-9400-4d1f-9c7c-6281611ee8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:42.157825 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d17b2-9400-4d1f-9c7c-6281611ee8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:42.158174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d17b2-9400-4d1f-9c7c-6281611ee8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:42.158507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d17b2-9400-4d1f-9c7c-6281611ee8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:42.159329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d17b2-9400-4d1f-9c7c-6281611ee8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:42.162335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d17b2-9400-4d1f-9c7c-6281611ee8e9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:42.196789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1136/2285] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:42 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:09:42.203899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1462bc9-0268-4183-b41b-f28e27dd84fc admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:42.217722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1462bc9-0268-4183-b41b-f28e27dd84fc admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:42.225004 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc46f8-70d1-4f9b-aa0c-b870662bb95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:42.225755 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc46f8-70d1-4f9b-aa0c-b870662bb95c admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:42.226042 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc46f8-70d1-4f9b-aa0c-b870662bb95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:42.226324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc46f8-70d1-4f9b-aa0c-b870662bb95c admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:42.227059 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc46f8-70d1-4f9b-aa0c-b870662bb95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:42.228966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc46f8-70d1-4f9b-aa0c-b870662bb95c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:42.244226 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1150/2286] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:09:42.249711 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d17b2-9400-4d1f-9c7c-6281611ee8e9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:42.269060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d17b2-9400-4d1f-9c7c-6281611ee8e9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:42.286900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876d7da-b550-48b3-9f0a-6094599e7fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:42.287645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876d7da-b550-48b3-9f0a-6094599e7fad admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:42.287935 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876d7da-b550-48b3-9f0a-6094599e7fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:42.288220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876d7da-b550-48b3-9f0a-6094599e7fad admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:42.288992 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876d7da-b550-48b3-9f0a-6094599e7fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:42.290982 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876d7da-b550-48b3-9f0a-6094599e7fad admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:42.311079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1137/2287] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:42.312559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc46f8-70d1-4f9b-aa0c-b870662bb95c admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:42.332367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc46f8-70d1-4f9b-aa0c-b870662bb95c admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:42.341458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a6d4f-6c3f-4870-815b-1f317237417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:42.342484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a6d4f-6c3f-4870-815b-1f317237417f admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:42.342858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a6d4f-6c3f-4870-815b-1f317237417f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:42.343361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a6d4f-6c3f-4870-815b-1f317237417f admin admin] PATH_INFO: `/v3/projects/0002087acef64c80a3dba81c4eddcc08/users/347fea6db0964ce38773b0ab889cc063/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:42.377523 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a6d4f-6c3f-4870-815b-1f317237417f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0002087acef64c80a3dba81c4eddcc08, user_id=347fea6db0964ce38773b0ab889cc063, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:42.382849 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a6d4f-6c3f-4870-815b-1f317237417f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:42.412366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1151/2288] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:42 2022] PUT /identity/v3/projects/0002087acef64c80a3dba81c4eddcc08/users/347fea6db0964ce38773b0ab889cc063/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:42.433525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4b35-f47f-4286-a77b-09b52869eb05 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:42.434024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4b35-f47f-4286-a77b-09b52869eb05 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:42.434524 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4b35-f47f-4286-a77b-09b52869eb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:42.487882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7e7e4b35-f47f-4286-a77b-09b52869eb05 None None] MFA Rules not processed for user `347fea6db0964ce38773b0ab889cc063`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:42.490270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7e7e4b35-f47f-4286-a77b-09b52869eb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:42.628018 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1138/2289] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:42.631238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a6d4f-6c3f-4870-815b-1f317237417f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:42.930125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:42.983166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a6d4f-6c3f-4870-815b-1f317237417f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:42.990145 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12a367-fce0-4b13-9faf-9b17c6c43d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:42.990974 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12a367-fce0-4b13-9faf-9b17c6c43d19 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:42.991396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12a367-fce0-4b13-9faf-9b17c6c43d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:42.991848 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12a367-fce0-4b13-9faf-9b17c6c43d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:42.992740 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12a367-fce0-4b13-9faf-9b17c6c43d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:42.995250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12a367-fce0-4b13-9faf-9b17c6c43d19 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:43.035349 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1152/2290] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:09:42 2022] POST /identity/v3/projects => generated 373 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:09:43.040434 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e4b35-f47f-4286-a77b-09b52869eb05 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:43.052596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e4b35-f47f-4286-a77b-09b52869eb05 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:43.087219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:43.127145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea179d3-fa13-446b-9560-7d2d93b9352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:43.128204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea179d3-fa13-446b-9560-7d2d93b9352f admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:43.128704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea179d3-fa13-446b-9560-7d2d93b9352f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:43.129206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea179d3-fa13-446b-9560-7d2d93b9352f admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:43.131115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea179d3-fa13-446b-9560-7d2d93b9352f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:43.135153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea179d3-fa13-446b-9560-7d2d93b9352f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:43.168864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1139/2291] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:09:43 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:09:43.175777 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12a367-fce0-4b13-9faf-9b17c6c43d19 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:43.197887 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12a367-fce0-4b13-9faf-9b17c6c43d19 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:43.204705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0cfe7-86ad-4be1-afd8-de9d76845903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:43.205453 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0cfe7-86ad-4be1-afd8-de9d76845903 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:43.205779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0cfe7-86ad-4be1-afd8-de9d76845903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:43.206090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0cfe7-86ad-4be1-afd8-de9d76845903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:43.206830 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0cfe7-86ad-4be1-afd8-de9d76845903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:43.209285 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0cfe7-86ad-4be1-afd8-de9d76845903 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:43.224495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1153/2292] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:43.227719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea179d3-fa13-446b-9560-7d2d93b9352f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:43.238853 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea179d3-fa13-446b-9560-7d2d93b9352f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:43.249730 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9b6fd-15ff-43cf-9da1-1d1f53509ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:43.250431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9b6fd-15ff-43cf-9da1-1d1f53509ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:43.250715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9b6fd-15ff-43cf-9da1-1d1f53509ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:43.251034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9b6fd-15ff-43cf-9da1-1d1f53509ac1 admin admin] PATH_INFO: `/v3/projects/e48063b71ac84166bfa165f557d6d1f3/users/d1c8bc56c01d495d95619bda71277599/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:43.274624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9b6fd-15ff-43cf-9da1-1d1f53509ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48063b71ac84166bfa165f557d6d1f3, user_id=d1c8bc56c01d495d95619bda71277599, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:43.277681 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9b6fd-15ff-43cf-9da1-1d1f53509ac1 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:43.296193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1140/2293] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:43 2022] PUT /identity/v3/projects/e48063b71ac84166bfa165f557d6d1f3/users/d1c8bc56c01d495d95619bda71277599/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:43.303117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0cfe7-86ad-4be1-afd8-de9d76845903 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:43.324730 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0cfe7-86ad-4be1-afd8-de9d76845903 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:43.433086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc5dbb-fdcf-423d-bd43-b7e69b9e6080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:43.433963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc5dbb-fdcf-423d-bd43-b7e69b9e6080 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:43.434494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc5dbb-fdcf-423d-bd43-b7e69b9e6080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:43.434932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc5dbb-fdcf-423d-bd43-b7e69b9e6080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:43.435996 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc5dbb-fdcf-423d-bd43-b7e69b9e6080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:43.439343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc5dbb-fdcf-423d-bd43-b7e69b9e6080 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:43.457666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1154/2294] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:09:43.465099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9b6fd-15ff-43cf-9da1-1d1f53509ac1 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:43.482646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9b6fd-15ff-43cf-9da1-1d1f53509ac1 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:43.493438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab34905-abae-4cd9-b66e-8a8da121e63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:43.494343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab34905-abae-4cd9-b66e-8a8da121e63a admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:43.494817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab34905-abae-4cd9-b66e-8a8da121e63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:43.495265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab34905-abae-4cd9-b66e-8a8da121e63a admin admin] PATH_INFO: `/v3/projects/e48063b71ac84166bfa165f557d6d1f3/users/d1c8bc56c01d495d95619bda71277599/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:43.497958 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab34905-abae-4cd9-b66e-8a8da121e63a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48063b71ac84166bfa165f557d6d1f3, user_id=d1c8bc56c01d495d95619bda71277599, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:43.502589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab34905-abae-4cd9-b66e-8a8da121e63a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:43.524119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1141/2295] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:09:43 2022] PUT /identity/v3/projects/e48063b71ac84166bfa165f557d6d1f3/users/d1c8bc56c01d495d95619bda71277599/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:09:43.543063 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a49e1-16ea-4979-85d4-8dc32be78dfe None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:43.543516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a49e1-16ea-4979-85d4-8dc32be78dfe None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:43.543998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a49e1-16ea-4979-85d4-8dc32be78dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:43.592326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-6f2a49e1-16ea-4979-85d4-8dc32be78dfe None None] MFA Rules not processed for user `d1c8bc56c01d495d95619bda71277599`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:43.594454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6f2a49e1-16ea-4979-85d4-8dc32be78dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:43.719318 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1155/2296] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:43.736151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab34905-abae-4cd9-b66e-8a8da121e63a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:43.739922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6ab34905-abae-4cd9-b66e-8a8da121e63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:43.824140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab34905-abae-4cd9-b66e-8a8da121e63a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:43.832459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece00c0-a034-479f-96e8-b472041f9548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:43.832846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece00c0-a034-479f-96e8-b472041f9548 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:43.833751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece00c0-a034-479f-96e8-b472041f9548 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:43.834107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece00c0-a034-479f-96e8-b472041f9548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:43.958327 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece00c0-a034-479f-96e8-b472041f9548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:43.959848 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece00c0-a034-479f-96e8-b472041f9548 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:43.971145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1142/2297] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:09:48.881737 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a49e1-16ea-4979-85d4-8dc32be78dfe None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:09:48.891464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a49e1-16ea-4979-85d4-8dc32be78dfe None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:09:48.895553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab046b-93a9-473d-ba66-17d628b034e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:09:48.896763 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab046b-93a9-473d-ba66-17d628b034e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:48.896763 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab046b-93a9-473d-ba66-17d628b034e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:48.897006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab046b-93a9-473d-ba66-17d628b034e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:48.907302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab046b-93a9-473d-ba66-17d628b034e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:09:48.908980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab046b-93a9-473d-ba66-17d628b034e2 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:09:48.921054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1156/2298] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:09:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:09:53.965762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=79,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:54.376944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46367461-5376-42fc-b9a8-3a8656103c2f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:09:54.377410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46367461-5376-42fc-b9a8-3a8656103c2f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:09:54.377888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46367461-5376-42fc-b9a8-3a8656103c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:09:54.404486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-46367461-5376-42fc-b9a8-3a8656103c2f None None] MFA Rules not processed for user `467666e0a8d64f649526e84fdcc1a7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:09:54.405799 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-46367461-5376-42fc-b9a8-3a8656103c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:09:54.498945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1143/2299] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:09:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:09:58.916389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:03.002503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab046b-93a9-473d-ba66-17d628b034e2 service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:03.004205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a7ab046b-93a9-473d-ba66-17d628b034e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:03.118032 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab046b-93a9-473d-ba66-17d628b034e2 service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:03.127124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:03.128040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:03.128464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:03.128884 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] PATH_INFO: `/v3/users/ddc70815fe164287ae7c44e31a414253` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:03.130729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc70815fe164287ae7c44e31a414253)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:03.132734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:03.214406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc70815fe164287ae7c44e31a414253'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:03.224456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc70815fe164287ae7c44e31a414253'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:03.225131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc70815fe164287ae7c44e31a414253'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:03.225856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc70815fe164287ae7c44e31a414253'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:03.257066 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc70815fe164287ae7c44e31a414253'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:03.273820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1157/2300] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:10:03 2022] DELETE /identity/v3/users/ddc70815fe164287ae7c44e31a414253 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:10:03.278660 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d5e80-c5cb-455e-b49e-1b26ef7ebd6b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:03.279436 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d5e80-c5cb-455e-b49e-1b26ef7ebd6b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:03.279436 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d5e80-c5cb-455e-b49e-1b26ef7ebd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:03.304163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1b0d5e80-c5cb-455e-b49e-1b26ef7ebd6b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:03.306317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1b0d5e80-c5cb-455e-b49e-1b26ef7ebd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:03.387892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1144/2301] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:10:03.403220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:03.405318 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:03.484229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88a25c-fb06-4844-8936-519d39f0113b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:03.491510 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ef0e0-7d9b-452a-b379-7212af0df2be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:03.492144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef0e0-7d9b-452a-b379-7212af0df2be service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:03.492424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef0e0-7d9b-452a-b379-7212af0df2be service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:03.492696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef0e0-7d9b-452a-b379-7212af0df2be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:03.503814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ef0e0-7d9b-452a-b379-7212af0df2be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:03.506205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ef0e0-7d9b-452a-b379-7212af0df2be service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:03.517521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d5e80-c5cb-455e-b49e-1b26ef7ebd6b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:03.519965 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1b0d5e80-c5cb-455e-b49e-1b26ef7ebd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:03.520977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1158/2302] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:10:03.540419 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d5e80-c5cb-455e-b49e-1b26ef7ebd6b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:03.546770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:03.546770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:03.547168 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:03.547767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] PATH_INFO: `/v3/users/347fea6db0964ce38773b0ab889cc063` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:03.548979 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=347fea6db0964ce38773b0ab889cc063)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:03.551900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:03.645342 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347fea6db0964ce38773b0ab889cc063'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:03.663738 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347fea6db0964ce38773b0ab889cc063'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:03.673045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347fea6db0964ce38773b0ab889cc063'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:03.674669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347fea6db0964ce38773b0ab889cc063'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:03.675867 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347fea6db0964ce38773b0ab889cc063'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:03.702948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1145/2303] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:10:03 2022] DELETE /identity/v3/users/347fea6db0964ce38773b0ab889cc063 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:10:03.708115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aa7e2-81e4-4382-804f-913b87d48650 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:03.709893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aa7e2-81e4-4382-804f-913b87d48650 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:03.710768 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aa7e2-81e4-4382-804f-913b87d48650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:03.747824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-6a1aa7e2-81e4-4382-804f-913b87d48650 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:03.757358 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6a1aa7e2-81e4-4382-804f-913b87d48650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:03.786635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:03.852259 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1159/2304] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:03.864133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:03.866199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:03.925056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:04.001320 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aa7e2-81e4-4382-804f-913b87d48650 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:04.006076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6a1aa7e2-81e4-4382-804f-913b87d48650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:04.053147 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9af54-27aa-4fc1-ae72-62c7f0459ab7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:04.056914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260f5af-2309-4960-a4d3-607bafd73287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:04.057508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aa7e2-81e4-4382-804f-913b87d48650 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:04.057701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260f5af-2309-4960-a4d3-607bafd73287 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:04.057885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260f5af-2309-4960-a4d3-607bafd73287 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:04.058052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260f5af-2309-4960-a4d3-607bafd73287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:04.069324 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260f5af-2309-4960-a4d3-607bafd73287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:04.070931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260f5af-2309-4960-a4d3-607bafd73287 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:04.072613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:04.074624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:04.075377 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:04.076278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] PATH_INFO: `/v3/projects/87d2d20590574a4a83983f24a6e7a6c2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:04.078958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d2d20590574a4a83983f24a6e7a6c2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:04.083798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:04.085360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1146/2305] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:10:04.164296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d2d20590574a4a83983f24a6e7a6c2', 'request_id': 'req-6e567653-f39c-44b8-8b10-308a3678010d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:04.179190 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d2d20590574a4a83983f24a6e7a6c2', 'request_id': 'req-6e567653-f39c-44b8-8b10-308a3678010d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:04.193607 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d2d20590574a4a83983f24a6e7a6c2', 'request_id': 'req-6e567653-f39c-44b8-8b10-308a3678010d'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:04.212711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] The token cache is being invalidate because project 87d2d20590574a4a83983f24a6e7a6c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:10:04.213031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:04.214048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:04.215834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1160/2306] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:10:03 2022] DELETE /identity/v3/projects/87d2d20590574a4a83983f24a6e7a6c2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:10:04.907332 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260f5af-2309-4960-a4d3-607bafd73287 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:04.909752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1260f5af-2309-4960-a4d3-607bafd73287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:04.934765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260f5af-2309-4960-a4d3-607bafd73287 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:05.012904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:05.013553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:05.013842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:05.014124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] PATH_INFO: `/v3/projects/0002087acef64c80a3dba81c4eddcc08` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:05.015347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0002087acef64c80a3dba81c4eddcc08)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:05.017356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:05.073323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0002087acef64c80a3dba81c4eddcc08', 'request_id': 'req-05aa8542-c90e-4947-925b-b7a6472720e5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:05.079900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0002087acef64c80a3dba81c4eddcc08', 'request_id': 'req-05aa8542-c90e-4947-925b-b7a6472720e5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:05.089315 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0002087acef64c80a3dba81c4eddcc08', 'request_id': 'req-05aa8542-c90e-4947-925b-b7a6472720e5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:05.102237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] The token cache is being invalidate because project 0002087acef64c80a3dba81c4eddcc08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:10:05.102539 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:05.103260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:05.104812 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1147/2307] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:10:04 2022] DELETE /identity/v3/projects/0002087acef64c80a3dba81c4eddcc08 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:10:05.109552 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:05.111442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:05.125734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e567653-f39c-44b8-8b10-308a3678010d admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:05.187599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ccfdf-c587-4c56-b7ff-6d6cae3648a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:05.188185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ccfdf-c587-4c56-b7ff-6d6cae3648a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:05.188472 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ccfdf-c587-4c56-b7ff-6d6cae3648a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:05.188747 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ccfdf-c587-4c56-b7ff-6d6cae3648a5 admin admin] PATH_INFO: `/v3/users/d1c8bc56c01d495d95619bda71277599` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:05.189988 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ccfdf-c587-4c56-b7ff-6d6cae3648a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c8bc56c01d495d95619bda71277599)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:05.192124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ccfdf-c587-4c56-b7ff-6d6cae3648a5 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:05.249396 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-105ccfdf-c587-4c56-b7ff-6d6cae3648a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c8bc56c01d495d95619bda71277599'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:05.251631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:05.259207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-105ccfdf-c587-4c56-b7ff-6d6cae3648a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c8bc56c01d495d95619bda71277599'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:05.259926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-105ccfdf-c587-4c56-b7ff-6d6cae3648a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c8bc56c01d495d95619bda71277599'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:05.260558 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-105ccfdf-c587-4c56-b7ff-6d6cae3648a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c8bc56c01d495d95619bda71277599'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:05.276867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-105ccfdf-c587-4c56-b7ff-6d6cae3648a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c8bc56c01d495d95619bda71277599'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:05.292949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1161/2308] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:10:05 2022] DELETE /identity/v3/users/d1c8bc56c01d495d95619bda71277599 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:10:05.678701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:05.680228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:05.726706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa8542-c90e-4947-925b-b7a6472720e5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:05.881500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:05.905223 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2acf3-3188-4e07-b0c7-18808595e112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:05.908338 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2acf3-3188-4e07-b0c7-18808595e112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:05.909006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2acf3-3188-4e07-b0c7-18808595e112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:05.909006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2acf3-3188-4e07-b0c7-18808595e112 admin admin] PATH_INFO: `/v3/projects/e48063b71ac84166bfa165f557d6d1f3` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:05.914243 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2acf3-3188-4e07-b0c7-18808595e112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48063b71ac84166bfa165f557d6d1f3)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:05.919232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2acf3-3188-4e07-b0c7-18808595e112 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:06.016124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d2e2acf3-3188-4e07-b0c7-18808595e112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48063b71ac84166bfa165f557d6d1f3', 'request_id': 'req-d2e2acf3-3188-4e07-b0c7-18808595e112'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:06.024523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d2e2acf3-3188-4e07-b0c7-18808595e112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48063b71ac84166bfa165f557d6d1f3', 'request_id': 'req-d2e2acf3-3188-4e07-b0c7-18808595e112'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:06.033379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d2e2acf3-3188-4e07-b0c7-18808595e112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48063b71ac84166bfa165f557d6d1f3', 'request_id': 'req-d2e2acf3-3188-4e07-b0c7-18808595e112'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:06.049258 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d2e2acf3-3188-4e07-b0c7-18808595e112 admin admin] The token cache is being invalidate because project e48063b71ac84166bfa165f557d6d1f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:10:06.049529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d2e2acf3-3188-4e07-b0c7-18808595e112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:06.050200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d2e2acf3-3188-4e07-b0c7-18808595e112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:06.054288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1148/2309] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:10:05 2022] DELETE /identity/v3/projects/e48063b71ac84166bfa165f557d6d1f3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:10:06.059985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db15e9-d278-49d2-8de1-f53c2f9ee7a0 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:06.060580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db15e9-d278-49d2-8de1-f53c2f9ee7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:06.066016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db15e9-d278-49d2-8de1-f53c2f9ee7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:06.095580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-15db15e9-d278-49d2-8de1-f53c2f9ee7a0 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:06.097042 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-15db15e9-d278-49d2-8de1-f53c2f9ee7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:06.182065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1162/2310] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:06.192055 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093050a-0496-4a5d-8256-e1dbdf6b2c1f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:06.192393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093050a-0496-4a5d-8256-e1dbdf6b2c1f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:06.192710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093050a-0496-4a5d-8256-e1dbdf6b2c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:06.215359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6093050a-0496-4a5d-8256-e1dbdf6b2c1f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:06.216577 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6093050a-0496-4a5d-8256-e1dbdf6b2c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:06.227438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1149/2311] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:06.231251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db15e9-d278-49d2-8de1-f53c2f9ee7a0 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:06.242479 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db15e9-d278-49d2-8de1-f53c2f9ee7a0 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:06.249643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575803a-0a4b-4674-bf4c-4be238d2331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:06.250407 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575803a-0a4b-4674-bf4c-4be238d2331e admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:06.250913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575803a-0a4b-4674-bf4c-4be238d2331e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:06.251415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575803a-0a4b-4674-bf4c-4be238d2331e admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:06.252423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575803a-0a4b-4674-bf4c-4be238d2331e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:10:06.252748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575803a-0a4b-4674-bf4c-4be238d2331e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:06.254420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575803a-0a4b-4674-bf4c-4be238d2331e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:06.273661 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1163/2312] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 21:10:06.280456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093050a-0496-4a5d-8256-e1dbdf6b2c1f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:06.292227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093050a-0496-4a5d-8256-e1dbdf6b2c1f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:06.302572 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101fb0b-63e0-452e-8dab-914f7d343618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:06.303377 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101fb0b-63e0-452e-8dab-914f7d343618 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:06.304323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101fb0b-63e0-452e-8dab-914f7d343618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:06.304610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101fb0b-63e0-452e-8dab-914f7d343618 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:06.305466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101fb0b-63e0-452e-8dab-914f7d343618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:06.307941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101fb0b-63e0-452e-8dab-914f7d343618 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:06.343620 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1150/2313] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:10:06 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:10:06.350220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575803a-0a4b-4674-bf4c-4be238d2331e admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:06.376513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575803a-0a4b-4674-bf4c-4be238d2331e admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:06.451734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cb2a8-da25-4b5a-a7da-94a549c7207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:06.452133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb2a8-da25-4b5a-a7da-94a549c7207e admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:06.452411 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb2a8-da25-4b5a-a7da-94a549c7207e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:06.452693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb2a8-da25-4b5a-a7da-94a549c7207e admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:06.453426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cb2a8-da25-4b5a-a7da-94a549c7207e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:06.455356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cb2a8-da25-4b5a-a7da-94a549c7207e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:06.495565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1164/2314] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:10:06 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:10:06.501121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101fb0b-63e0-452e-8dab-914f7d343618 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:06.521591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101fb0b-63e0-452e-8dab-914f7d343618 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:06.527439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470b2db-1f53-49c1-b03c-e7bb9aa5cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:06.528081 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470b2db-1f53-49c1-b03c-e7bb9aa5cba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:06.528548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470b2db-1f53-49c1-b03c-e7bb9aa5cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:06.529558 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470b2db-1f53-49c1-b03c-e7bb9aa5cba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:06.530003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470b2db-1f53-49c1-b03c-e7bb9aa5cba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:06.532525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470b2db-1f53-49c1-b03c-e7bb9aa5cba6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:06.558558 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1151/2315] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:10:06.565548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cb2a8-da25-4b5a-a7da-94a549c7207e admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:06.578565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cb2a8-da25-4b5a-a7da-94a549c7207e admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:06.586567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2482e7-e3b7-480d-a09f-469eaf991bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:06.587321 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2482e7-e3b7-480d-a09f-469eaf991bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:06.587656 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2482e7-e3b7-480d-a09f-469eaf991bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:06.587887 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2482e7-e3b7-480d-a09f-469eaf991bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:06.588580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2482e7-e3b7-480d-a09f-469eaf991bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:06.590208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2482e7-e3b7-480d-a09f-469eaf991bf4 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:06.609630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1165/2316] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:10:06.615126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470b2db-1f53-49c1-b03c-e7bb9aa5cba6 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:06.627443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470b2db-1f53-49c1-b03c-e7bb9aa5cba6 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:06.633628 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b3948-6872-49e1-b80c-57ed0aa34014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:06.633628 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b3948-6872-49e1-b80c-57ed0aa34014 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:06.634469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b3948-6872-49e1-b80c-57ed0aa34014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:06.634469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b3948-6872-49e1-b80c-57ed0aa34014 admin admin] PATH_INFO: `/v3/projects/74e4f8f708a74d56b85c2a80108f3486/users/c0e5e65007b54707af2dd678c208c702/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:06.661335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b3948-6872-49e1-b80c-57ed0aa34014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e4f8f708a74d56b85c2a80108f3486, user_id=c0e5e65007b54707af2dd678c208c702, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:06.667082 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b3948-6872-49e1-b80c-57ed0aa34014 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:06.686456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1152/2317] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:10:06 2022] PUT /identity/v3/projects/74e4f8f708a74d56b85c2a80108f3486/users/c0e5e65007b54707af2dd678c208c702/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:10:06.697561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7003231-64fc-4b5b-8dcc-a243480547ab None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:06.697980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7003231-64fc-4b5b-8dcc-a243480547ab None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:06.698311 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7003231-64fc-4b5b-8dcc-a243480547ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:06.734928 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-a7003231-64fc-4b5b-8dcc-a243480547ab None None] MFA Rules not processed for user `c0e5e65007b54707af2dd678c208c702`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:06.736909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a7003231-64fc-4b5b-8dcc-a243480547ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:06.761366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:06.842310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1166/2318] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:10:06.855483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b3948-6872-49e1-b80c-57ed0aa34014 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:06.857504 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-608b3948-6872-49e1-b80c-57ed0aa34014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:06.931403 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b3948-6872-49e1-b80c-57ed0aa34014 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:06.935047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff42b97-8437-44a3-ab5f-54846c216570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:06.935693 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff42b97-8437-44a3-ab5f-54846c216570 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:06.936003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff42b97-8437-44a3-ab5f-54846c216570 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:06.936360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff42b97-8437-44a3-ab5f-54846c216570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:06.950537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff42b97-8437-44a3-ab5f-54846c216570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:06.953816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff42b97-8437-44a3-ab5f-54846c216570 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:06.978973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1153/2319] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:10:07.430670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7003231-64fc-4b5b-8dcc-a243480547ab None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:07.433478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a7003231-64fc-4b5b-8dcc-a243480547ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:07.503535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7003231-64fc-4b5b-8dcc-a243480547ab None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:07.508780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235db959-1003-4a3f-a137-e675ba577db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:07.509801 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235db959-1003-4a3f-a137-e675ba577db4 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:07.510193 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235db959-1003-4a3f-a137-e675ba577db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:07.510539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235db959-1003-4a3f-a137-e675ba577db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:07.512548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-235db959-1003-4a3f-a137-e675ba577db4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:07.581561 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235db959-1003-4a3f-a137-e675ba577db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:07.583404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235db959-1003-4a3f-a137-e675ba577db4 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:07.594465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1167/2320] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:10:07.996923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff42b97-8437-44a3-ab5f-54846c216570 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:08.003594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0ff42b97-8437-44a3-ab5f-54846c216570 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:08.050965 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:08.159043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff42b97-8437-44a3-ab5f-54846c216570 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:08.165764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:08.166438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:08.166779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:08.167037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] PATH_INFO: `/v3/users/bdb7a936e17f43a0960ebdf6d93d3909` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:08.168235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb7a936e17f43a0960ebdf6d93d3909)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:08.170354 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:08.247999 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb7a936e17f43a0960ebdf6d93d3909'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:08.270077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb7a936e17f43a0960ebdf6d93d3909'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:08.282703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb7a936e17f43a0960ebdf6d93d3909'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:08.283532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb7a936e17f43a0960ebdf6d93d3909'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:08.284190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb7a936e17f43a0960ebdf6d93d3909'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:08.307861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1154/2321] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:10:07 2022] DELETE /identity/v3/users/bdb7a936e17f43a0960ebdf6d93d3909 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:10:08.318651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f42151-fef2-431a-9361-8b5b7c58be85 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:08.319276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f42151-fef2-431a-9361-8b5b7c58be85 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:08.319780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f42151-fef2-431a-9361-8b5b7c58be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:08.365361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-79f42151-fef2-431a-9361-8b5b7c58be85 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:08.367932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-79f42151-fef2-431a-9361-8b5b7c58be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:08.491000 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1168/2322] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:08.506279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:08.508034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:08.610067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d8f96-b4be-4a7e-af8e-1d009e401b71 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:08.618848 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674318d-7ac3-4dd2-8659-78a6f0ea5eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:08.619523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674318d-7ac3-4dd2-8659-78a6f0ea5eaf service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:08.619852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674318d-7ac3-4dd2-8659-78a6f0ea5eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:08.620112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674318d-7ac3-4dd2-8659-78a6f0ea5eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:08.632296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674318d-7ac3-4dd2-8659-78a6f0ea5eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:08.634974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674318d-7ac3-4dd2-8659-78a6f0ea5eaf service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:08.653473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1155/2323] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:10:09.023276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f42151-fef2-431a-9361-8b5b7c58be85 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:09.025231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-79f42151-fef2-431a-9361-8b5b7c58be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:09.039002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f42151-fef2-431a-9361-8b5b7c58be85 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:09.044115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d376714-9ea5-4433-968a-8c03ee47d665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:09.045063 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d376714-9ea5-4433-968a-8c03ee47d665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:09.045504 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d376714-9ea5-4433-968a-8c03ee47d665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:09.045968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d376714-9ea5-4433-968a-8c03ee47d665 admin admin] PATH_INFO: `/v3/projects/e648803a23e244b3acd05b5956e7b5ad` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:09.047581 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d376714-9ea5-4433-968a-8c03ee47d665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e648803a23e244b3acd05b5956e7b5ad)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:09.049684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d376714-9ea5-4433-968a-8c03ee47d665 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:09.058185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:09.117674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8d376714-9ea5-4433-968a-8c03ee47d665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e648803a23e244b3acd05b5956e7b5ad', 'request_id': 'req-8d376714-9ea5-4433-968a-8c03ee47d665'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:09.127817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8d376714-9ea5-4433-968a-8c03ee47d665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e648803a23e244b3acd05b5956e7b5ad', 'request_id': 'req-8d376714-9ea5-4433-968a-8c03ee47d665'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:09.139796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8d376714-9ea5-4433-968a-8c03ee47d665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e648803a23e244b3acd05b5956e7b5ad', 'request_id': 'req-8d376714-9ea5-4433-968a-8c03ee47d665'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:09.153215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8d376714-9ea5-4433-968a-8c03ee47d665 admin admin] The token cache is being invalidate because project e648803a23e244b3acd05b5956e7b5ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:10:09.153687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8d376714-9ea5-4433-968a-8c03ee47d665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:09.154484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-8d376714-9ea5-4433-968a-8c03ee47d665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:09.156500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1169/2324] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:10:09 2022] DELETE /identity/v3/projects/e648803a23e244b3acd05b5956e7b5ad => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:10:09.161675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a3fae-17f9-4be1-af00-d31e58674757 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:09.162490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a3fae-17f9-4be1-af00-d31e58674757 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:09.162959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a3fae-17f9-4be1-af00-d31e58674757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:09.188940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e83a3fae-17f9-4be1-af00-d31e58674757 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:09.190384 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e83a3fae-17f9-4be1-af00-d31e58674757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:09.243787 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:09.272385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1156/2325] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:09.280486 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3aaa-54d2-490f-a60e-bca7b14489ea None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:09.280774 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3aaa-54d2-490f-a60e-bca7b14489ea None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:09.281058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3aaa-54d2-490f-a60e-bca7b14489ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:09.303957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-240a3aaa-54d2-490f-a60e-bca7b14489ea None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:09.305345 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-240a3aaa-54d2-490f-a60e-bca7b14489ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:09.315580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1170/2326] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:10:09.320497 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a3fae-17f9-4be1-af00-d31e58674757 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:09.333456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a3fae-17f9-4be1-af00-d31e58674757 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:09.343290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e2b3e-a11c-4791-a598-57016f8d22b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:09.344508 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2b3e-a11c-4791-a598-57016f8d22b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:09.344903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2b3e-a11c-4791-a598-57016f8d22b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:09.345310 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2b3e-a11c-4791-a598-57016f8d22b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:09.346596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e2b3e-a11c-4791-a598-57016f8d22b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:10:09.350762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e2b3e-a11c-4791-a598-57016f8d22b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:09.350762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e2b3e-a11c-4791-a598-57016f8d22b8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:09.365304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1157/2327] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 21:10:09.370109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3aaa-54d2-490f-a60e-bca7b14489ea None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:09.380594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3aaa-54d2-490f-a60e-bca7b14489ea None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:09.385554 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c13632-887c-4761-b7cc-0f457cf81180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:09.386152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c13632-887c-4761-b7cc-0f457cf81180 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:09.386503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c13632-887c-4761-b7cc-0f457cf81180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:09.387435 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c13632-887c-4761-b7cc-0f457cf81180 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:09.388702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c13632-887c-4761-b7cc-0f457cf81180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:09.390686 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c13632-887c-4761-b7cc-0f457cf81180 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:09.424723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1171/2328] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:10:09 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:10:09.431600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e2b3e-a11c-4791-a598-57016f8d22b8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:09.445352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e2b3e-a11c-4791-a598-57016f8d22b8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:09.514691 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d4bb3-39cf-4b17-bd21-822bc9e2d2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:09.515617 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d4bb3-39cf-4b17-bd21-822bc9e2d2ba admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:09.515997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d4bb3-39cf-4b17-bd21-822bc9e2d2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:09.516326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d4bb3-39cf-4b17-bd21-822bc9e2d2ba admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:09.517077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d4bb3-39cf-4b17-bd21-822bc9e2d2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:09.519892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d4bb3-39cf-4b17-bd21-822bc9e2d2ba admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:09.547299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1158/2329] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:10:09 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:10:09.552372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c13632-887c-4761-b7cc-0f457cf81180 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:09.564011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c13632-887c-4761-b7cc-0f457cf81180 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:09.570056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09051-e7ac-44b8-b9e4-dd61e82b4b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:09.570773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09051-e7ac-44b8-b9e4-dd61e82b4b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:09.571192 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09051-e7ac-44b8-b9e4-dd61e82b4b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:09.571539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09051-e7ac-44b8-b9e4-dd61e82b4b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:09.572257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c09051-e7ac-44b8-b9e4-dd61e82b4b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:09.573910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c09051-e7ac-44b8-b9e4-dd61e82b4b47 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:09.589888 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1172/2330] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:10:09.592963 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d4bb3-39cf-4b17-bd21-822bc9e2d2ba admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:09.604688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d4bb3-39cf-4b17-bd21-822bc9e2d2ba admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:09.610077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5d44a-c978-47f6-8489-b3a4fd3af44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:09.610764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d44a-c978-47f6-8489-b3a4fd3af44e admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:09.611059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d44a-c978-47f6-8489-b3a4fd3af44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:09.611443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d44a-c978-47f6-8489-b3a4fd3af44e admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:09.612101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d44a-c978-47f6-8489-b3a4fd3af44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:09.614283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d44a-c978-47f6-8489-b3a4fd3af44e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:09.626819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1159/2331] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:10:09.631571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09051-e7ac-44b8-b9e4-dd61e82b4b47 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:09.642941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09051-e7ac-44b8-b9e4-dd61e82b4b47 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:09.649934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa140306-a96b-43fa-b3b1-8332a1d7a86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:09.650911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa140306-a96b-43fa-b3b1-8332a1d7a86e admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:09.651415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa140306-a96b-43fa-b3b1-8332a1d7a86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:09.651854 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa140306-a96b-43fa-b3b1-8332a1d7a86e admin admin] PATH_INFO: `/v3/projects/26e7af883fc84440be7593d078475767/users/f0e07701617b4552879141d85e0076ed/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:09.672508 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa140306-a96b-43fa-b3b1-8332a1d7a86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e7af883fc84440be7593d078475767, user_id=f0e07701617b4552879141d85e0076ed, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:09.675973 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa140306-a96b-43fa-b3b1-8332a1d7a86e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:09.694781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1173/2332] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:10:09 2022] PUT /identity/v3/projects/26e7af883fc84440be7593d078475767/users/f0e07701617b4552879141d85e0076ed/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:10:09.703756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78f2f3-419f-417f-8e3c-ce25dc81cd43 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:09.704046 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78f2f3-419f-417f-8e3c-ce25dc81cd43 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:09.704328 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78f2f3-419f-417f-8e3c-ce25dc81cd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:09.736825 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5c78f2f3-419f-417f-8e3c-ce25dc81cd43 None None] MFA Rules not processed for user `f0e07701617b4552879141d85e0076ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:09.738216 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5c78f2f3-419f-417f-8e3c-ce25dc81cd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:09.818901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1160/2333] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:09.828197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa140306-a96b-43fa-b3b1-8332a1d7a86e admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:09.830152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-fa140306-a96b-43fa-b3b1-8332a1d7a86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:09.906900 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa140306-a96b-43fa-b3b1-8332a1d7a86e admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:09.911956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c7580-0b71-4a77-a82c-fdf2d8711a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:09.912843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c7580-0b71-4a77-a82c-fdf2d8711a5c service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:09.913133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c7580-0b71-4a77-a82c-fdf2d8711a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:09.913515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c7580-0b71-4a77-a82c-fdf2d8711a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:09.928254 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c7580-0b71-4a77-a82c-fdf2d8711a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:09.929943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c7580-0b71-4a77-a82c-fdf2d8711a5c service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:09.950897 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1174/2334] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:10:10.438629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78f2f3-419f-417f-8e3c-ce25dc81cd43 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:10.438629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5c78f2f3-419f-417f-8e3c-ce25dc81cd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:10.499097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:10.529820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78f2f3-419f-417f-8e3c-ce25dc81cd43 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:10.536516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:10.537447 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:10.537964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:10.538530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] PATH_INFO: `/v3/users/c0e5e65007b54707af2dd678c208c702` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:10.539816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e5e65007b54707af2dd678c208c702)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:10.543228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:10.607784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e5e65007b54707af2dd678c208c702'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:10.626549 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e5e65007b54707af2dd678c208c702'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:10.635423 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e5e65007b54707af2dd678c208c702'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:10.636102 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e5e65007b54707af2dd678c208c702'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:10.636718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e5e65007b54707af2dd678c208c702'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:10.656559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1161/2335] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:10:10 2022] DELETE /identity/v3/users/c0e5e65007b54707af2dd678c208c702 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:10:10.661880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea77cb-a45e-4b6d-b1b6-cf0f2bcfcd95 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:10.662376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea77cb-a45e-4b6d-b1b6-cf0f2bcfcd95 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:10.662892 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea77cb-a45e-4b6d-b1b6-cf0f2bcfcd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:10.684352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-54ea77cb-a45e-4b6d-b1b6-cf0f2bcfcd95 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:10.685560 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-54ea77cb-a45e-4b6d-b1b6-cf0f2bcfcd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:10.718430 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:10.754950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1175/2336] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:10.764611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:10.766155 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:10.824925 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aae67-58cb-4f26-ab44-668948c99fb4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:10.828591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d36ed-989f-43c1-9116-ece3aed7e683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:10.829202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d36ed-989f-43c1-9116-ece3aed7e683 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:10.829483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d36ed-989f-43c1-9116-ece3aed7e683 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:10.829756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d36ed-989f-43c1-9116-ece3aed7e683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:10.840954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d36ed-989f-43c1-9116-ece3aed7e683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:10.841562 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d36ed-989f-43c1-9116-ece3aed7e683 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:10.853740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1162/2337] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:10:11.267905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea77cb-a45e-4b6d-b1b6-cf0f2bcfcd95 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:11.271545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-54ea77cb-a45e-4b6d-b1b6-cf0f2bcfcd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:11.322236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea77cb-a45e-4b6d-b1b6-cf0f2bcfcd95 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:11.333979 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:11.335056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:11.335770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:11.337944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8 admin admin] PATH_INFO: `/v3/projects/74e4f8f708a74d56b85c2a80108f3486` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:11.340154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e4f8f708a74d56b85c2a80108f3486)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:11.342597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:11.401506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6b846-5395-4a28-af2c-64d074f541d9 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:11.401782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6b846-5395-4a28-af2c-64d074f541d9 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:11.402060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6b846-5395-4a28-af2c-64d074f541d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:11.427999 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-07c6b846-5395-4a28-af2c-64d074f541d9 None None] MFA Rules not processed for user `f0e07701617b4552879141d85e0076ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:11.429630 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-07c6b846-5395-4a28-af2c-64d074f541d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:11.449435 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e4f8f708a74d56b85c2a80108f3486', 'request_id': 'req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:11.462336 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e4f8f708a74d56b85c2a80108f3486', 'request_id': 'req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:11.471724 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e4f8f708a74d56b85c2a80108f3486', 'request_id': 'req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:11.485743 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8 admin admin] The token cache is being invalidate because project 74e4f8f708a74d56b85c2a80108f3486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:10:11.486526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:11.487471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5e5734ff-18b7-4f4c-85bc-4e90614b08b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:11.490357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1176/2338] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:10:11 2022] DELETE /identity/v3/projects/74e4f8f708a74d56b85c2a80108f3486 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:10:11.499165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1066a9-8448-414f-8487-a5b893433e34 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:11.499165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1066a9-8448-414f-8487-a5b893433e34 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:11.499165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1066a9-8448-414f-8487-a5b893433e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:11.514289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1163/2339] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:10:11.519229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ad1066a9-8448-414f-8487-a5b893433e34 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:11.521095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ad1066a9-8448-414f-8487-a5b893433e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:11.601991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1177/2340] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:10:11.612132 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bc13c-2659-4b73-a196-bc9ac5928902 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:11.612657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bc13c-2659-4b73-a196-bc9ac5928902 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:11.613161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bc13c-2659-4b73-a196-bc9ac5928902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:11.623381 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:11.638650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c57bc13c-2659-4b73-a196-bc9ac5928902 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:11.640326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c57bc13c-2659-4b73-a196-bc9ac5928902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:11.650275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1164/2341] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:10:11.654619 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1066a9-8448-414f-8487-a5b893433e34 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:11.666505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1066a9-8448-414f-8487-a5b893433e34 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:11.671599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa38914-e490-4c69-b173-0774e82eee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:11.672227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa38914-e490-4c69-b173-0774e82eee1b admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:11.672513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa38914-e490-4c69-b173-0774e82eee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:11.672796 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa38914-e490-4c69-b173-0774e82eee1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:11.673460 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa38914-e490-4c69-b173-0774e82eee1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:10:11.673839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa38914-e490-4c69-b173-0774e82eee1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:11.675651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa38914-e490-4c69-b173-0774e82eee1b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:11.689559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1178/2342] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:10:11.695043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bc13c-2659-4b73-a196-bc9ac5928902 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:11.705372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bc13c-2659-4b73-a196-bc9ac5928902 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:11.710764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b8d78-f03a-4e69-bd7c-708561158e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:11.711379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b8d78-f03a-4e69-bd7c-708561158e0f admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:11.711664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b8d78-f03a-4e69-bd7c-708561158e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:11.711947 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b8d78-f03a-4e69-bd7c-708561158e0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:11.712589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b8d78-f03a-4e69-bd7c-708561158e0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:11.714664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b8d78-f03a-4e69-bd7c-708561158e0f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:11.750791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1165/2343] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:10:11 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:10:11.754271 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa38914-e490-4c69-b173-0774e82eee1b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:11.765768 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa38914-e490-4c69-b173-0774e82eee1b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:11.814285 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:11.832653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773e45c-4381-4377-a4cc-247f0c46929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:11.833275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773e45c-4381-4377-a4cc-247f0c46929a admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:11.833681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773e45c-4381-4377-a4cc-247f0c46929a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:11.833966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773e45c-4381-4377-a4cc-247f0c46929a admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:11.834591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773e45c-4381-4377-a4cc-247f0c46929a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:11.836588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773e45c-4381-4377-a4cc-247f0c46929a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:11.858111 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1179/2344] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:10:11 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:10:11.862267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b8d78-f03a-4e69-bd7c-708561158e0f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:11.873621 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b8d78-f03a-4e69-bd7c-708561158e0f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:11.878565 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39daab9-9957-4158-8e03-c4f1b45d124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:11.879885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39daab9-9957-4158-8e03-c4f1b45d124d admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:11.880231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39daab9-9957-4158-8e03-c4f1b45d124d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:11.880577 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39daab9-9957-4158-8e03-c4f1b45d124d admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:11.881238 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39daab9-9957-4158-8e03-c4f1b45d124d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:11.882869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39daab9-9957-4158-8e03-c4f1b45d124d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:11.893341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1166/2345] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:10:11.898303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773e45c-4381-4377-a4cc-247f0c46929a admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:11.910079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773e45c-4381-4377-a4cc-247f0c46929a admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:11.915247 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4411d4-6bee-460c-b39b-6e282165699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:11.915955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4411d4-6bee-460c-b39b-6e282165699a admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:11.916240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4411d4-6bee-460c-b39b-6e282165699a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:11.916534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4411d4-6bee-460c-b39b-6e282165699a admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:11.917196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4411d4-6bee-460c-b39b-6e282165699a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:11.918869 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4411d4-6bee-460c-b39b-6e282165699a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:11.937025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1180/2346] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:10:11.945271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39daab9-9957-4158-8e03-c4f1b45d124d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:11.958933 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39daab9-9957-4158-8e03-c4f1b45d124d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:11.963948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d799f9a-5d17-4dfe-94a4-75547dbdbc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:11.964894 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d799f9a-5d17-4dfe-94a4-75547dbdbc97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:11.965249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d799f9a-5d17-4dfe-94a4-75547dbdbc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:11.965600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d799f9a-5d17-4dfe-94a4-75547dbdbc97 admin admin] PATH_INFO: `/v3/projects/7794d4fe9dad461fbda83d69a2c164e4/users/c6035ed9ff1b4936aa32e72729798485/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:11.984000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d799f9a-5d17-4dfe-94a4-75547dbdbc97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7794d4fe9dad461fbda83d69a2c164e4, user_id=c6035ed9ff1b4936aa32e72729798485, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:11.986704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d799f9a-5d17-4dfe-94a4-75547dbdbc97 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:12.002873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1167/2347] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:10:11 2022] PUT /identity/v3/projects/7794d4fe9dad461fbda83d69a2c164e4/users/c6035ed9ff1b4936aa32e72729798485/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:10:12.008770 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a216ec-7a55-4898-895f-2e211cecbcff None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:12.009139 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a216ec-7a55-4898-895f-2e211cecbcff None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:12.009489 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a216ec-7a55-4898-895f-2e211cecbcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:12.031574 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-84a216ec-7a55-4898-895f-2e211cecbcff None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:12.032793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-84a216ec-7a55-4898-895f-2e211cecbcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:12.102193 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1181/2348] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:10:12.112545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d799f9a-5d17-4dfe-94a4-75547dbdbc97 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:12.115127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2d799f9a-5d17-4dfe-94a4-75547dbdbc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:12.191254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d799f9a-5d17-4dfe-94a4-75547dbdbc97 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:12.201125 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c742f-2b9c-442a-b514-bbddc75b8ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:12.202175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c742f-2b9c-442a-b514-bbddc75b8ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:12.203195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c742f-2b9c-442a-b514-bbddc75b8ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:12.203801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c742f-2b9c-442a-b514-bbddc75b8ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:12.224034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c742f-2b9c-442a-b514-bbddc75b8ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:12.225895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c742f-2b9c-442a-b514-bbddc75b8ee2 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:12.238321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1168/2349] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:10:13.060996 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df6b0e-7932-48dd-9c89-4e759cf37866 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:13.061566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df6b0e-7932-48dd-9c89-4e759cf37866 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:13.061566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df6b0e-7932-48dd-9c89-4e759cf37866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:13.096251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-f8df6b0e-7932-48dd-9c89-4e759cf37866 None None] MFA Rules not processed for user `c6035ed9ff1b4936aa32e72729798485`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:13.097522 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f8df6b0e-7932-48dd-9c89-4e759cf37866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:13.201052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1182/2350] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:10:13.219911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c742f-2b9c-442a-b514-bbddc75b8ee2 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:13.223055 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b61c742f-2b9c-442a-b514-bbddc75b8ee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:13.291530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c742f-2b9c-442a-b514-bbddc75b8ee2 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:13.296297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da303a6d-90b3-4d17-97aa-1cb372213529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:13.296959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da303a6d-90b3-4d17-97aa-1cb372213529 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:13.297242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da303a6d-90b3-4d17-97aa-1cb372213529 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:13.297522 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da303a6d-90b3-4d17-97aa-1cb372213529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:13.308837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da303a6d-90b3-4d17-97aa-1cb372213529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:13.310294 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da303a6d-90b3-4d17-97aa-1cb372213529 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:13.321636 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1169/2351] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:10:14.890055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89d18b-cfd7-44a2-8802-63e1e493cf75 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:14.890644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89d18b-cfd7-44a2-8802-63e1e493cf75 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:14.890980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89d18b-cfd7-44a2-8802-63e1e493cf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:14.922927 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-aa89d18b-cfd7-44a2-8802-63e1e493cf75 None None] MFA Rules not processed for user `c6035ed9ff1b4936aa32e72729798485`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:14.924536 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-aa89d18b-cfd7-44a2-8802-63e1e493cf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:14.937675 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1183/2352] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:10:23.321840 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=77,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:24.757474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96e91f-aa17-41fa-a841-9f7061b0013a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:24.758145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96e91f-aa17-41fa-a841-9f7061b0013a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:24.758383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96e91f-aa17-41fa-a841-9f7061b0013a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:24.792399 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5a96e91f-aa17-41fa-a841-9f7061b0013a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:24.794412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5a96e91f-aa17-41fa-a841-9f7061b0013a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:24.805537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1170/2353] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Aug 19 21:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:24.825617 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89d18b-cfd7-44a2-8802-63e1e493cf75 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:24.827198 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-aa89d18b-cfd7-44a2-8802-63e1e493cf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:24.880074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:24.911899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89d18b-cfd7-44a2-8802-63e1e493cf75 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:24.920146 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad85129-c07b-41c6-85f7-184fc2577c83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:24.920775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad85129-c07b-41c6-85f7-184fc2577c83 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:24.921203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad85129-c07b-41c6-85f7-184fc2577c83 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:24.921485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad85129-c07b-41c6-85f7-184fc2577c83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:24.932836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad85129-c07b-41c6-85f7-184fc2577c83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:24.935325 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad85129-c07b-41c6-85f7-184fc2577c83 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:24.947465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1184/2354] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:10:28.067171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96e91f-aa17-41fa-a841-9f7061b0013a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:28.069868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5a96e91f-aa17-41fa-a841-9f7061b0013a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:28.156883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96e91f-aa17-41fa-a841-9f7061b0013a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:28.162475 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fa3f6-d601-41c5-8a7f-9f8c18319f1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:28.163120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fa3f6-d601-41c5-8a7f-9f8c18319f1b service placement] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:28.163401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fa3f6-d601-41c5-8a7f-9f8c18319f1b service placement] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:28.163672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fa3f6-d601-41c5-8a7f-9f8c18319f1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:28.166519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-df0fa3f6-d601-41c5-8a7f-9f8c18319f1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:28.182840 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fa3f6-d601-41c5-8a7f-9f8c18319f1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:28.184351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fa3f6-d601-41c5-8a7f-9f8c18319f1b service placement] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:28.196099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1171/2355] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:10:32.993115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3d36-97d9-4922-a891-bdf872f15c62 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:32.993703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3d36-97d9-4922-a891-bdf872f15c62 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:32.994185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3d36-97d9-4922-a891-bdf872f15c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:33.015653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-1adc3d36-97d9-4922-a891-bdf872f15c62 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:33.016912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1adc3d36-97d9-4922-a891-bdf872f15c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:33.025448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1185/2356] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Aug 19 21:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:33.044619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fa3f6-d601-41c5-8a7f-9f8c18319f1b service placement] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:33.046085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-df0fa3f6-d601-41c5-8a7f-9f8c18319f1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:33.062984 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fa3f6-d601-41c5-8a7f-9f8c18319f1b service placement] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:33.068554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447d849-a869-464e-b2a7-bdde30c3cffe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:33.069195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447d849-a869-464e-b2a7-bdde30c3cffe service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:33.069464 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447d849-a869-464e-b2a7-bdde30c3cffe service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:33.069740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447d849-a869-464e-b2a7-bdde30c3cffe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:33.079604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447d849-a869-464e-b2a7-bdde30c3cffe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:33.081548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447d849-a869-464e-b2a7-bdde30c3cffe service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:33.093197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1172/2357] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:10:38.342655 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de82eb-0bb5-474f-9024-0ea320f3d01e None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:38.343466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de82eb-0bb5-474f-9024-0ea320f3d01e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:38.343466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de82eb-0bb5-474f-9024-0ea320f3d01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:38.381823 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-03de82eb-0bb5-474f-9024-0ea320f3d01e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:38.383902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-03de82eb-0bb5-474f-9024-0ea320f3d01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:38.395459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1186/2358] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Aug 19 21:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:38.409975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447d849-a869-464e-b2a7-bdde30c3cffe service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:38.422598 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447d849-a869-464e-b2a7-bdde30c3cffe service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:38.430446 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93771ffa-c753-4f0b-b009-6676902d38e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:38.432160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771ffa-c753-4f0b-b009-6676902d38e5 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:38.432608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771ffa-c753-4f0b-b009-6676902d38e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:38.433155 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771ffa-c753-4f0b-b009-6676902d38e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:38.445523 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93771ffa-c753-4f0b-b009-6676902d38e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:38.447159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93771ffa-c753-4f0b-b009-6676902d38e5 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:38.459302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1173/2359] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:10:40.885191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f75fc1-5686-4dbd-a486-14087a20228e None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:40.885727 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f75fc1-5686-4dbd-a486-14087a20228e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:40.885727 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f75fc1-5686-4dbd-a486-14087a20228e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:40.906928 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-a2f75fc1-5686-4dbd-a486-14087a20228e None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:40.908477 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a2f75fc1-5686-4dbd-a486-14087a20228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:40.968802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1187/2360] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:10:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:41.029441 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93771ffa-c753-4f0b-b009-6676902d38e5 service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:41.031201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-93771ffa-c753-4f0b-b009-6676902d38e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:41.128594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93771ffa-c753-4f0b-b009-6676902d38e5 service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:41.134503 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bf1d9-4ed3-435f-89c0-5dc70c775f8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:41.135232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bf1d9-4ed3-435f-89c0-5dc70c775f8f service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:41.135601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bf1d9-4ed3-435f-89c0-5dc70c775f8f service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:41.135903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bf1d9-4ed3-435f-89c0-5dc70c775f8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:41.149515 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bf1d9-4ed3-435f-89c0-5dc70c775f8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:41.151196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bf1d9-4ed3-435f-89c0-5dc70c775f8f service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:41.161939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1174/2361] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:10:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 21:10:41.805964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491756-c911-47dd-8b2f-611fff49c980 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:41.806255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491756-c911-47dd-8b2f-611fff49c980 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:41.806535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491756-c911-47dd-8b2f-611fff49c980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:41.828918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-a6491756-c911-47dd-8b2f-611fff49c980 None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:41.830150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a6491756-c911-47dd-8b2f-611fff49c980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:41.839047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1188/2362] 10.222.0.17 () {58 vars in 967 bytes} [Fri Aug 19 21:10:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:41.852101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bf1d9-4ed3-435f-89c0-5dc70c775f8f service swift] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:41.864128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bf1d9-4ed3-435f-89c0-5dc70c775f8f service swift] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:41.869641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d78bfa-29ff-48a8-8fda-156e9a79c21f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:41.870356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d78bfa-29ff-48a8-8fda-156e9a79c21f service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:41.870642 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d78bfa-29ff-48a8-8fda-156e9a79c21f service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:41.870956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d78bfa-29ff-48a8-8fda-156e9a79c21f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:41.882393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d78bfa-29ff-48a8-8fda-156e9a79c21f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:41.885648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d78bfa-29ff-48a8-8fda-156e9a79c21f service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:41.900538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1175/2363] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:10:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 21:10:42.185130 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78f715-833b-4909-92d5-9e359e0f5598 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:42.186465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78f715-833b-4909-92d5-9e359e0f5598 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:42.186465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78f715-833b-4909-92d5-9e359e0f5598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:42.208431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ae78f715-833b-4909-92d5-9e359e0f5598 None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:42.209662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ae78f715-833b-4909-92d5-9e359e0f5598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:42.216831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1189/2364] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:42.228756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d78bfa-29ff-48a8-8fda-156e9a79c21f service swift] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:42.239517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d78bfa-29ff-48a8-8fda-156e9a79c21f service swift] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:42.244534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b70249-04db-4ba4-8c86-4aef99505667 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:42.245130 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b70249-04db-4ba4-8c86-4aef99505667 service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:42.245412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b70249-04db-4ba4-8c86-4aef99505667 service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:42.245685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b70249-04db-4ba4-8c86-4aef99505667 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:42.253726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b70249-04db-4ba4-8c86-4aef99505667 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:42.255889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b70249-04db-4ba4-8c86-4aef99505667 service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:42.264137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1176/2365] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:10:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 21:10:42.461068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e2b20-9fa2-4d87-b2cf-0f9a3abee562 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:42.461427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e2b20-9fa2-4d87-b2cf-0f9a3abee562 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:42.461766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e2b20-9fa2-4d87-b2cf-0f9a3abee562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:42.482922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-5b2e2b20-9fa2-4d87-b2cf-0f9a3abee562 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:42.484202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5b2e2b20-9fa2-4d87-b2cf-0f9a3abee562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:42.493331 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1190/2366] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Aug 19 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:42.509893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b70249-04db-4ba4-8c86-4aef99505667 service swift] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:42.522766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b70249-04db-4ba4-8c86-4aef99505667 service swift] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:42.528646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e904e8-5f7c-4a86-b9cc-a32c19168eb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:42.529412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e904e8-5f7c-4a86-b9cc-a32c19168eb2 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:42.529892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e904e8-5f7c-4a86-b9cc-a32c19168eb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:42.530243 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e904e8-5f7c-4a86-b9cc-a32c19168eb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:42.541656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e904e8-5f7c-4a86-b9cc-a32c19168eb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:42.543405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e904e8-5f7c-4a86-b9cc-a32c19168eb2 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:42.558491 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1177/2367] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:10:42.617921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57a16e-b370-442d-a791-ff512c1e5784 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:42.618204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57a16e-b370-442d-a791-ff512c1e5784 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:42.618476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57a16e-b370-442d-a791-ff512c1e5784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:42.638438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-0b57a16e-b370-442d-a791-ff512c1e5784 None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:42.639645 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0b57a16e-b370-442d-a791-ff512c1e5784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:42.647287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1191/2368] 10.222.0.17 () {58 vars in 967 bytes} [Fri Aug 19 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:42.659253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e904e8-5f7c-4a86-b9cc-a32c19168eb2 service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:42.670665 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e904e8-5f7c-4a86-b9cc-a32c19168eb2 service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:42.675601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89bd0d-d33f-4b25-a92c-4d7a15c5cf6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:42.676899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89bd0d-d33f-4b25-a92c-4d7a15c5cf6a service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:42.677184 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89bd0d-d33f-4b25-a92c-4d7a15c5cf6a service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:42.677455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89bd0d-d33f-4b25-a92c-4d7a15c5cf6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:42.682520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:42.686899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89bd0d-d33f-4b25-a92c-4d7a15c5cf6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:42.688492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89bd0d-d33f-4b25-a92c-4d7a15c5cf6a service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:42.697333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1178/2369] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:10:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 21:10:44.889779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57a16e-b370-442d-a791-ff512c1e5784 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:44.891821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0b57a16e-b370-442d-a791-ff512c1e5784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:44.911622 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57a16e-b370-442d-a791-ff512c1e5784 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:44.916301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:44.917006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:44.917355 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:44.918196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] PATH_INFO: `/v3/users/f0e07701617b4552879141d85e0076ed` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:44.918834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e07701617b4552879141d85e0076ed)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:44.920748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:44.970586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e07701617b4552879141d85e0076ed'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:44.980395 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e07701617b4552879141d85e0076ed'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:44.981505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e07701617b4552879141d85e0076ed'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:44.982189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e07701617b4552879141d85e0076ed'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:45.000997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e07701617b4552879141d85e0076ed'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:45.016141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1192/2370] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:10:44 2022] DELETE /identity/v3/users/f0e07701617b4552879141d85e0076ed => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:10:45.021376 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b665cb7-4ea7-4189-b757-e883404c856f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:45.021890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b665cb7-4ea7-4189-b757-e883404c856f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:45.022009 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b665cb7-4ea7-4189-b757-e883404c856f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:45.042257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-2b665cb7-4ea7-4189-b757-e883404c856f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:45.043524 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2b665cb7-4ea7-4189-b757-e883404c856f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:45.104168 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1179/2371] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:45.114537 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:45.116027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:45.127847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:45.183612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318152a8-2716-456c-a7e2-5a613eebfd14 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:45.187408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44120d60-6dbd-4d50-9564-3b82155c5477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:45.188030 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44120d60-6dbd-4d50-9564-3b82155c5477 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:45.188315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44120d60-6dbd-4d50-9564-3b82155c5477 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:45.188593 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44120d60-6dbd-4d50-9564-3b82155c5477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:45.199461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44120d60-6dbd-4d50-9564-3b82155c5477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:45.200907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44120d60-6dbd-4d50-9564-3b82155c5477 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:45.212709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1193/2372] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:10:45.419770 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b665cb7-4ea7-4189-b757-e883404c856f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:45.421243 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2b665cb7-4ea7-4189-b757-e883404c856f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:45.434176 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b665cb7-4ea7-4189-b757-e883404c856f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:45.442594 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:45.443287 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:45.443568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:45.443841 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] PATH_INFO: `/v3/projects/26e7af883fc84440be7593d078475767` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:45.444996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e7af883fc84440be7593d078475767)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:45.446976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:45.536355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e7af883fc84440be7593d078475767', 'request_id': 'req-344ba6ba-79fe-434f-8292-b390961409e4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:45.547281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e7af883fc84440be7593d078475767', 'request_id': 'req-344ba6ba-79fe-434f-8292-b390961409e4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:45.556903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e7af883fc84440be7593d078475767', 'request_id': 'req-344ba6ba-79fe-434f-8292-b390961409e4'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:45.570730 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] The token cache is being invalidate because project 26e7af883fc84440be7593d078475767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:10:45.571199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:45.572022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:10:45.573885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1180/2373] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:10:45 2022] DELETE /identity/v3/projects/26e7af883fc84440be7593d078475767 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:10:47.026213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86532dc5-9c2d-417e-bec3-69f8079eab5e None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:47.026723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86532dc5-9c2d-417e-bec3-69f8079eab5e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:47.026898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86532dc5-9c2d-417e-bec3-69f8079eab5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:47.046955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-86532dc5-9c2d-417e-bec3-69f8079eab5e None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:47.048276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-86532dc5-9c2d-417e-bec3-69f8079eab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:47.102891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1194/2374] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:47.115618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:47.117106 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:47.192977 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ba6ba-79fe-434f-8292-b390961409e4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:47.200248 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbfd35-1507-4c77-baa7-95824d54f21d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:47.201004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbfd35-1507-4c77-baa7-95824d54f21d service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:47.201417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbfd35-1507-4c77-baa7-95824d54f21d service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:47.201899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbfd35-1507-4c77-baa7-95824d54f21d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:47.213233 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbfd35-1507-4c77-baa7-95824d54f21d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:47.214851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbfd35-1507-4c77-baa7-95824d54f21d service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:47.224505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1181/2375] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:10:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 21:10:47.743160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566ef7a-014d-4daa-80c1-cf3294279ca8 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:47.743753 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566ef7a-014d-4daa-80c1-cf3294279ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:47.744244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566ef7a-014d-4daa-80c1-cf3294279ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:47.779944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-5566ef7a-014d-4daa-80c1-cf3294279ca8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:47.782361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5566ef7a-014d-4daa-80c1-cf3294279ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:47.871466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1195/2376] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Aug 19 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:47.892505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbfd35-1507-4c77-baa7-95824d54f21d service swift] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:47.893973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2ccbfd35-1507-4c77-baa7-95824d54f21d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:47.909663 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:48.018241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbfd35-1507-4c77-baa7-95824d54f21d service swift] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:48.024944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855250c-8d74-46b3-b1f5-a383a8b1caf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:48.025808 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855250c-8d74-46b3-b1f5-a383a8b1caf5 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:48.026160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855250c-8d74-46b3-b1f5-a383a8b1caf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:48.026507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855250c-8d74-46b3-b1f5-a383a8b1caf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:48.047766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855250c-8d74-46b3-b1f5-a383a8b1caf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:48.049278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855250c-8d74-46b3-b1f5-a383a8b1caf5 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:48.067472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1182/2377] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:10:48.310973 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed106222-b65d-429f-b66f-aa145138bfd9 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:48.311565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed106222-b65d-429f-b66f-aa145138bfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:48.311565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed106222-b65d-429f-b66f-aa145138bfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:48.334652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ed106222-b65d-429f-b66f-aa145138bfd9 None None] MFA Rules not processed for user `c6035ed9ff1b4936aa32e72729798485`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:48.336134 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ed106222-b65d-429f-b66f-aa145138bfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:48.408799 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1196/2378] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:10:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:10:52.088864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301174e9-00ad-4170-9f08-0c9783baab31 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:52.091581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301174e9-00ad-4170-9f08-0c9783baab31 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:52.092263 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301174e9-00ad-4170-9f08-0c9783baab31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:52.137623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-301174e9-00ad-4170-9f08-0c9783baab31 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:10:52.141563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-301174e9-00ad-4170-9f08-0c9783baab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:10:52.160703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1183/2379] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Aug 19 21:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:10:52.182407 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed106222-b65d-429f-b66f-aa145138bfd9 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:10:52.197912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:52.210783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed106222-b65d-429f-b66f-aa145138bfd9 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:10:52.217688 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44122d6c-bf2d-4d52-9d14-d734788c0b30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:10:52.219427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44122d6c-bf2d-4d52-9d14-d734788c0b30 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:10:52.222584 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44122d6c-bf2d-4d52-9d14-d734788c0b30 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:10:52.223844 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44122d6c-bf2d-4d52-9d14-d734788c0b30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:10:52.235389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44122d6c-bf2d-4d52-9d14-d734788c0b30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:10:52.237347 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44122d6c-bf2d-4d52-9d14-d734788c0b30 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:10:52.254625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1197/2380] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:11:02.123013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=34 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:02.246412 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=5 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:09.563646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5337d2-1649-457e-890c-3d4d992b4596 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:09.564382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5337d2-1649-457e-890c-3d4d992b4596 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:09.564629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5337d2-1649-457e-890c-3d4d992b4596 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:09.567035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1184/2381] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 21:11:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:11:09.575219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb37c1-7276-437f-bcd9-51763fe5c5c2 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:09.576115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb37c1-7276-437f-bcd9-51763fe5c5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:09.576115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb37c1-7276-437f-bcd9-51763fe5c5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:09.605186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e5fb37c1-7276-437f-bcd9-51763fe5c5c2 None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:09.606766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e5fb37c1-7276-437f-bcd9-51763fe5c5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:09.618673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1198/2382] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:09.631671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5337d2-1649-457e-890c-3d4d992b4596 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:09.633546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ce5337d2-1649-457e-890c-3d4d992b4596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:09.732723 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5337d2-1649-457e-890c-3d4d992b4596 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:09.747410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34030e7-2ae4-4fba-938b-86caf500c118 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b105e7094aea9dcc7423d6205c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:09.748240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34030e7-2ae4-4fba-938b-86caf500c118 service glance] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:09.748704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34030e7-2ae4-4fba-938b-86caf500c118 service glance] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:09.748704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34030e7-2ae4-4fba-938b-86caf500c118 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:09.770429 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34030e7-2ae4-4fba-938b-86caf500c118 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:09.774255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34030e7-2ae4-4fba-938b-86caf500c118 service glance] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:09.805791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1185/2383] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:11:09.899287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a96d9f-df9f-4e22-93d4-fd48c59c26e8 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:09.899775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a96d9f-df9f-4e22-93d4-fd48c59c26e8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:09.900282 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a96d9f-df9f-4e22-93d4-fd48c59c26e8 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:09.903140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1199/2384] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 21:11:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:11:09.910990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53abee-fc6d-40d7-9ec2-e7f6650549be None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:09.911431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53abee-fc6d-40d7-9ec2-e7f6650549be None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:09.911803 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53abee-fc6d-40d7-9ec2-e7f6650549be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:09.936752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-7c53abee-fc6d-40d7-9ec2-e7f6650549be None None] MFA Rules not processed for user `95b17424a40b475480403eb9f4f3f88f`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:09.938085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7c53abee-fc6d-40d7-9ec2-e7f6650549be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:10.006297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1186/2385] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:10.021483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a96d9f-df9f-4e22-93d4-fd48c59c26e8 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:10.023797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-18a96d9f-df9f-4e22-93d4-fd48c59c26e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:10.041521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a96d9f-df9f-4e22-93d4-fd48c59c26e8 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:10.047196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece1c1b-5ad0-4774-9456-b2fe0d1aed34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:10.048084 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece1c1b-5ad0-4774-9456-b2fe0d1aed34 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:10.048422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece1c1b-5ad0-4774-9456-b2fe0d1aed34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:10.048769 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece1c1b-5ad0-4774-9456-b2fe0d1aed34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:10.057925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece1c1b-5ad0-4774-9456-b2fe0d1aed34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:10.059446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece1c1b-5ad0-4774-9456-b2fe0d1aed34 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:10.075595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1200/2386] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:11:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:11:10.187060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46378c8d-2e4b-4a32-bb67-fc9a8e46e3cd None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:10.187060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46378c8d-2e4b-4a32-bb67-fc9a8e46e3cd None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:10.187060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46378c8d-2e4b-4a32-bb67-fc9a8e46e3cd None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:10.191245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1187/2387] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 21:11:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:11:10.200234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257e733-1615-4684-a099-c08b81e18010 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:10.200570 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257e733-1615-4684-a099-c08b81e18010 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:10.201209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257e733-1615-4684-a099-c08b81e18010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:10.236961 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-5257e733-1615-4684-a099-c08b81e18010 None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:10.238921 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5257e733-1615-4684-a099-c08b81e18010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:10.249225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1201/2388] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 21:11:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:10.266049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46378c8d-2e4b-4a32-bb67-fc9a8e46e3cd None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:10.279804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46378c8d-2e4b-4a32-bb67-fc9a8e46e3cd None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:10.286127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c46a8-b3f0-4d5b-aa84-296775e4b7ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:10.287169 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c46a8-b3f0-4d5b-aa84-296775e4b7ad service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:10.287648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c46a8-b3f0-4d5b-aa84-296775e4b7ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:10.288103 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c46a8-b3f0-4d5b-aa84-296775e4b7ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:10.302790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c46a8-b3f0-4d5b-aa84-296775e4b7ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:10.304469 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c46a8-b3f0-4d5b-aa84-296775e4b7ad service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:10.321479 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1188/2389] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:11:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:11:14.107498 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6e8a3-7ebe-444a-aedd-a5593199afe1 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:14.108067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6e8a3-7ebe-444a-aedd-a5593199afe1 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:14.108350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6e8a3-7ebe-444a-aedd-a5593199afe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:14.138543 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-01e6e8a3-7ebe-444a-aedd-a5593199afe1 None None] MFA Rules not processed for user `1762e003b6a64d51a42f4f57502712bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:14.140341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-01e6e8a3-7ebe-444a-aedd-a5593199afe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:14.217421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1202/2390] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:11:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:15.406482 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154f20e-be07-4e14-b1ad-4a1b72561d37 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:15.407541 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154f20e-be07-4e14-b1ad-4a1b72561d37 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:15.407541 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154f20e-be07-4e14-b1ad-4a1b72561d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:15.428777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b154f20e-be07-4e14-b1ad-4a1b72561d37 None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:15.430068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b154f20e-be07-4e14-b1ad-4a1b72561d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:15.438123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1189/2391] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:15.453340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6e8a3-7ebe-444a-aedd-a5593199afe1 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:15.475950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6e8a3-7ebe-444a-aedd-a5593199afe1 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:15.481703 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9d03f-a6b2-4594-a9d5-645047309a96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:15.482332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d03f-a6b2-4594-a9d5-645047309a96 service swift] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:15.482611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d03f-a6b2-4594-a9d5-645047309a96 service swift] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:15.482919 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d03f-a6b2-4594-a9d5-645047309a96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:15.493482 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9d03f-a6b2-4594-a9d5-645047309a96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:15.495130 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9d03f-a6b2-4594-a9d5-645047309a96 service swift] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:15.507588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1203/2392] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:11:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 21:11:17.742092 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d40dfe-3213-414c-a756-099c6d6e027a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:17.742656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d40dfe-3213-414c-a756-099c6d6e027a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:17.743137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d40dfe-3213-414c-a756-099c6d6e027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:17.775470 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-11d40dfe-3213-414c-a756-099c6d6e027a None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:17.778076 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-11d40dfe-3213-414c-a756-099c6d6e027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:17.796334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1190/2393] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:11:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:17.811194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9d03f-a6b2-4594-a9d5-645047309a96 service swift] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:17.822822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9d03f-a6b2-4594-a9d5-645047309a96 service swift] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:17.829714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2314a-3901-44ff-b1fd-bfc94100e7ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:17.830635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2314a-3901-44ff-b1fd-bfc94100e7ad service swift] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:17.830964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2314a-3901-44ff-b1fd-bfc94100e7ad service swift] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:17.831237 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2314a-3901-44ff-b1fd-bfc94100e7ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:17.842445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2314a-3901-44ff-b1fd-bfc94100e7ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:17.844421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2314a-3901-44ff-b1fd-bfc94100e7ad service swift] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:17.855736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1204/2394] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:11:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 21:11:27.767849 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=61 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:27.851368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=49 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:35.567230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dcddf-10be-4f96-9a91-3fbd6325c34d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:35.567929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dcddf-10be-4f96-9a91-3fbd6325c34d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:35.568231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dcddf-10be-4f96-9a91-3fbd6325c34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:35.592198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f93dcddf-10be-4f96-9a91-3fbd6325c34d None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:35.593407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f93dcddf-10be-4f96-9a91-3fbd6325c34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:35.601547 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1191/2395] 10.222.0.17 () {58 vars in 967 bytes} [Fri Aug 19 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:35.616990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2314a-3901-44ff-b1fd-bfc94100e7ad service swift] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:35.629031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2314a-3901-44ff-b1fd-bfc94100e7ad service swift] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:35.637278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7922-89f9-4354-8419-a2ba4d80b7a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:35.637910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7922-89f9-4354-8419-a2ba4d80b7a3 service swift] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:35.638203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7922-89f9-4354-8419-a2ba4d80b7a3 service swift] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:35.638478 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7922-89f9-4354-8419-a2ba4d80b7a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:35.650711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d7922-89f9-4354-8419-a2ba4d80b7a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:35.652441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d7922-89f9-4354-8419-a2ba4d80b7a3 service swift] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:35.661845 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1205/2396] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:11:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 21:11:37.889206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dcddf-10be-4f96-9a91-3fbd6325c34d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:37.890690 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f93dcddf-10be-4f96-9a91-3fbd6325c34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:37.906080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dcddf-10be-4f96-9a91-3fbd6325c34d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:37.911167 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c9049-3a8d-4480-9488-d6934836406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:37.911830 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9049-3a8d-4480-9488-d6934836406e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:37.912115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9049-3a8d-4480-9488-d6934836406e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:37.912421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9049-3a8d-4480-9488-d6934836406e admin admin] PATH_INFO: `/v3/users/c6035ed9ff1b4936aa32e72729798485` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:37.914005 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c9049-3a8d-4480-9488-d6934836406e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6035ed9ff1b4936aa32e72729798485)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:37.916074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c9049-3a8d-4480-9488-d6934836406e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:37.977220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-438c9049-3a8d-4480-9488-d6934836406e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6035ed9ff1b4936aa32e72729798485'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:37.989244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-438c9049-3a8d-4480-9488-d6934836406e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6035ed9ff1b4936aa32e72729798485'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:37.996556 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-438c9049-3a8d-4480-9488-d6934836406e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6035ed9ff1b4936aa32e72729798485'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:37.997422 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-438c9049-3a8d-4480-9488-d6934836406e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6035ed9ff1b4936aa32e72729798485'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:37.997950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-438c9049-3a8d-4480-9488-d6934836406e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6035ed9ff1b4936aa32e72729798485'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:38.011490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1192/2397] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:11:37 2022] DELETE /identity/v3/users/c6035ed9ff1b4936aa32e72729798485 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:11:38.205055 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7922-89f9-4354-8419-a2ba4d80b7a3 service swift] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:38.217783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7922-89f9-4354-8419-a2ba4d80b7a3 service swift] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:38.286616 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85326d-1fd8-4a36-9720-bf65dbaccf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:38.287382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85326d-1fd8-4a36-9720-bf65dbaccf11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:38.287738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85326d-1fd8-4a36-9720-bf65dbaccf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:38.288017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85326d-1fd8-4a36-9720-bf65dbaccf11 admin admin] PATH_INFO: `/v3/projects/7794d4fe9dad461fbda83d69a2c164e4` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:38.289312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85326d-1fd8-4a36-9720-bf65dbaccf11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7794d4fe9dad461fbda83d69a2c164e4)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:38.291716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85326d-1fd8-4a36-9720-bf65dbaccf11 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:38.357733 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2d85326d-1fd8-4a36-9720-bf65dbaccf11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7794d4fe9dad461fbda83d69a2c164e4', 'request_id': 'req-2d85326d-1fd8-4a36-9720-bf65dbaccf11'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:38.367096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2d85326d-1fd8-4a36-9720-bf65dbaccf11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7794d4fe9dad461fbda83d69a2c164e4', 'request_id': 'req-2d85326d-1fd8-4a36-9720-bf65dbaccf11'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:38.374481 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2d85326d-1fd8-4a36-9720-bf65dbaccf11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7794d4fe9dad461fbda83d69a2c164e4', 'request_id': 'req-2d85326d-1fd8-4a36-9720-bf65dbaccf11'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:38.386083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2d85326d-1fd8-4a36-9720-bf65dbaccf11 admin admin] The token cache is being invalidate because project 7794d4fe9dad461fbda83d69a2c164e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:11:38.386413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2d85326d-1fd8-4a36-9720-bf65dbaccf11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:38.387102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2d85326d-1fd8-4a36-9720-bf65dbaccf11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:38.388636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1206/2398] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:11:38 2022] DELETE /identity/v3/projects/7794d4fe9dad461fbda83d69a2c164e4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:11:38.393796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e2421-bdde-4d1d-bbd0-a03118a19ff3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:38.394090 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e2421-bdde-4d1d-bbd0-a03118a19ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:38.394376 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e2421-bdde-4d1d-bbd0-a03118a19ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:38.416265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-370e2421-bdde-4d1d-bbd0-a03118a19ff3 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:38.417590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-370e2421-bdde-4d1d-bbd0-a03118a19ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:38.485086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1193/2399] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:38.493431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19cc1c-a455-498b-9e11-478a7c05e06d None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:38.493738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19cc1c-a455-498b-9e11-478a7c05e06d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:38.494010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19cc1c-a455-498b-9e11-478a7c05e06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:38.514496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-1d19cc1c-a455-498b-9e11-478a7c05e06d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:38.515751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-1d19cc1c-a455-498b-9e11-478a7c05e06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:38.530275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1207/2400] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:11:38.535115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e2421-bdde-4d1d-bbd0-a03118a19ff3 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:38.548098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e2421-bdde-4d1d-bbd0-a03118a19ff3 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:38.556382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7999661-dc70-475c-adaa-3bb7e07bf8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:38.557445 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7999661-dc70-475c-adaa-3bb7e07bf8cd admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:38.557944 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7999661-dc70-475c-adaa-3bb7e07bf8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:38.558437 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7999661-dc70-475c-adaa-3bb7e07bf8cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:38.559708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7999661-dc70-475c-adaa-3bb7e07bf8cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:11:38.560256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7999661-dc70-475c-adaa-3bb7e07bf8cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:38.563488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7999661-dc70-475c-adaa-3bb7e07bf8cd admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:38.586682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1194/2401] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:11:38.591273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19cc1c-a455-498b-9e11-478a7c05e06d None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:38.601337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19cc1c-a455-498b-9e11-478a7c05e06d None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:38.606170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee5058-63bd-43af-8427-4bd84d8aee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:38.607025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee5058-63bd-43af-8427-4bd84d8aee87 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:38.607312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee5058-63bd-43af-8427-4bd84d8aee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:38.607594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee5058-63bd-43af-8427-4bd84d8aee87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:38.608239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee5058-63bd-43af-8427-4bd84d8aee87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:38.610148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee5058-63bd-43af-8427-4bd84d8aee87 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:38.639585 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1208/2402] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:11:38 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:11:38.644543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7999661-dc70-475c-adaa-3bb7e07bf8cd admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:38.655170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7999661-dc70-475c-adaa-3bb7e07bf8cd admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:38.716374 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:38.730376 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011522bd-26d6-41b8-b4e5-a71ea69a79f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:38.731398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011522bd-26d6-41b8-b4e5-a71ea69a79f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:38.732013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011522bd-26d6-41b8-b4e5-a71ea69a79f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:38.732548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011522bd-26d6-41b8-b4e5-a71ea69a79f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:38.733558 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011522bd-26d6-41b8-b4e5-a71ea69a79f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:38.735988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011522bd-26d6-41b8-b4e5-a71ea69a79f0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:38.762773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1195/2403] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:11:38 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:11:38.764602 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee5058-63bd-43af-8427-4bd84d8aee87 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:38.776622 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee5058-63bd-43af-8427-4bd84d8aee87 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:38.781453 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90520-0917-46b2-b79e-eb51b6ba8e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:38.782083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90520-0917-46b2-b79e-eb51b6ba8e78 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:38.782352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90520-0917-46b2-b79e-eb51b6ba8e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:38.782629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90520-0917-46b2-b79e-eb51b6ba8e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:38.783321 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f90520-0917-46b2-b79e-eb51b6ba8e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:38.786913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f90520-0917-46b2-b79e-eb51b6ba8e78 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:38.803754 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1209/2404] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:11:38.804919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011522bd-26d6-41b8-b4e5-a71ea69a79f0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:38.819047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011522bd-26d6-41b8-b4e5-a71ea69a79f0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:38.829749 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf39db-4978-43c3-820f-d6d53c12378c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:38.830640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf39db-4978-43c3-820f-d6d53c12378c admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:38.831776 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf39db-4978-43c3-820f-d6d53c12378c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:38.832424 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf39db-4978-43c3-820f-d6d53c12378c admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:38.833744 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf39db-4978-43c3-820f-d6d53c12378c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:38.836845 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf39db-4978-43c3-820f-d6d53c12378c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:38.860610 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1196/2405] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:11:38.862217 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90520-0917-46b2-b79e-eb51b6ba8e78 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:38.874215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90520-0917-46b2-b79e-eb51b6ba8e78 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:38.885958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d8803-ffd4-4737-859c-e2a1450fd1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:38.886705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8803-ffd4-4737-859c-e2a1450fd1de admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:38.887023 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8803-ffd4-4737-859c-e2a1450fd1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:38.887298 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8803-ffd4-4737-859c-e2a1450fd1de admin admin] PATH_INFO: `/v3/projects/a2afe4a941964e6b8742a7fb73bcec6e/users/74b237e2ccf74dc6a404041adf983b05/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:38.911629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d8803-ffd4-4737-859c-e2a1450fd1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2afe4a941964e6b8742a7fb73bcec6e, user_id=74b237e2ccf74dc6a404041adf983b05, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:38.914989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d8803-ffd4-4737-859c-e2a1450fd1de admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:38.936532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1210/2406] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:11:38 2022] PUT /identity/v3/projects/a2afe4a941964e6b8742a7fb73bcec6e/users/74b237e2ccf74dc6a404041adf983b05/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:11:38.951508 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e6eb-bd62-4fe5-a666-b8253c037db4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:38.952401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e6eb-bd62-4fe5-a666-b8253c037db4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:38.952682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e6eb-bd62-4fe5-a666-b8253c037db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:38.987934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5884e6eb-bd62-4fe5-a666-b8253c037db4 None None] MFA Rules not processed for user `74b237e2ccf74dc6a404041adf983b05`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:38.989677 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5884e6eb-bd62-4fe5-a666-b8253c037db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:39.084729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1197/2407] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:39.095916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d8803-ffd4-4737-859c-e2a1450fd1de admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:39.098196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-480d8803-ffd4-4737-859c-e2a1450fd1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:39.120985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:39.161137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d8803-ffd4-4737-859c-e2a1450fd1de admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:39.165047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608a37e-2e23-4582-9715-1ecd92637aeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:39.165667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608a37e-2e23-4582-9715-1ecd92637aeb service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:39.165952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608a37e-2e23-4582-9715-1ecd92637aeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:39.166263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608a37e-2e23-4582-9715-1ecd92637aeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:39.175551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608a37e-2e23-4582-9715-1ecd92637aeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:39.177090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608a37e-2e23-4582-9715-1ecd92637aeb service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:39.185922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1211/2408] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:11:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:11:41.782345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884e6eb-bd62-4fe5-a666-b8253c037db4 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:41.852436 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884e6eb-bd62-4fe5-a666-b8253c037db4 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:41.857220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:41.857872 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:41.858157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:41.858440 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] PATH_INFO: `/v3/users/74b237e2ccf74dc6a404041adf983b05` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:41.859668 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b237e2ccf74dc6a404041adf983b05)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:41.861615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:41.920047 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b237e2ccf74dc6a404041adf983b05'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:41.934498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:41.936820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b237e2ccf74dc6a404041adf983b05'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:41.947795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b237e2ccf74dc6a404041adf983b05'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:41.948798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b237e2ccf74dc6a404041adf983b05'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:41.949679 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b237e2ccf74dc6a404041adf983b05'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:41.963885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1198/2409] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:11:41 2022] DELETE /identity/v3/users/74b237e2ccf74dc6a404041adf983b05 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:11:41.968363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db65403-95f7-491e-ac17-8783626bb69d None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:41.968853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db65403-95f7-491e-ac17-8783626bb69d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:41.968951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db65403-95f7-491e-ac17-8783626bb69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:41.988676 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-8db65403-95f7-491e-ac17-8783626bb69d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:41.990418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8db65403-95f7-491e-ac17-8783626bb69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:42.063413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1212/2410] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:42.074198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:42.075807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:42.138553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206de4c-8cfa-45aa-b1fe-7ece55e5994a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:42.143458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9239d43-0513-4502-ba9e-8decdc418c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:42.144272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9239d43-0513-4502-ba9e-8decdc418c14 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:42.144550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9239d43-0513-4502-ba9e-8decdc418c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:42.144822 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9239d43-0513-4502-ba9e-8decdc418c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:42.155022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9239d43-0513-4502-ba9e-8decdc418c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:42.156480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9239d43-0513-4502-ba9e-8decdc418c14 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:42.168573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1199/2411] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:11:42.253971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ebc43-a54b-4877-b300-aa2f8cdac4c1 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:42.254279 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ebc43-a54b-4877-b300-aa2f8cdac4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:42.254581 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ebc43-a54b-4877-b300-aa2f8cdac4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:42.282966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-514ebc43-a54b-4877-b300-aa2f8cdac4c1 None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:42.284690 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-514ebc43-a54b-4877-b300-aa2f8cdac4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:42.372835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1213/2412] 10.222.0.17 () {58 vars in 967 bytes} [Fri Aug 19 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:11:42.398836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9239d43-0513-4502-ba9e-8decdc418c14 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:42.401258 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a9239d43-0513-4502-ba9e-8decdc418c14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:42.496033 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9239d43-0513-4502-ba9e-8decdc418c14 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:42.504864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4f779-d4f6-44bb-8d0d-69310827e20c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:42.505511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4f779-d4f6-44bb-8d0d-69310827e20c service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:42.505796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4f779-d4f6-44bb-8d0d-69310827e20c service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:42.506074 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4f779-d4f6-44bb-8d0d-69310827e20c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:42.517303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4f779-d4f6-44bb-8d0d-69310827e20c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:42.519297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4f779-d4f6-44bb-8d0d-69310827e20c service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:42.531387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1200/2413] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:11:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 21:11:42.652814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ebc43-a54b-4877-b300-aa2f8cdac4c1 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:42.655271 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-514ebc43-a54b-4877-b300-aa2f8cdac4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:42.697993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ebc43-a54b-4877-b300-aa2f8cdac4c1 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:42.704431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511eada9-a189-4ea7-b4a2-5bb20ec09cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:42.705223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eada9-a189-4ea7-b4a2-5bb20ec09cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:42.705507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eada9-a189-4ea7-b4a2-5bb20ec09cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:42.705815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eada9-a189-4ea7-b4a2-5bb20ec09cce admin admin] PATH_INFO: `/v3/projects/a2afe4a941964e6b8742a7fb73bcec6e` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:42.707168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511eada9-a189-4ea7-b4a2-5bb20ec09cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2afe4a941964e6b8742a7fb73bcec6e)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:42.709228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511eada9-a189-4ea7-b4a2-5bb20ec09cce admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:42.785188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-511eada9-a189-4ea7-b4a2-5bb20ec09cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2afe4a941964e6b8742a7fb73bcec6e', 'request_id': 'req-511eada9-a189-4ea7-b4a2-5bb20ec09cce'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:42.795073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-511eada9-a189-4ea7-b4a2-5bb20ec09cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2afe4a941964e6b8742a7fb73bcec6e', 'request_id': 'req-511eada9-a189-4ea7-b4a2-5bb20ec09cce'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:42.796963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:42.804850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-511eada9-a189-4ea7-b4a2-5bb20ec09cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2afe4a941964e6b8742a7fb73bcec6e', 'request_id': 'req-511eada9-a189-4ea7-b4a2-5bb20ec09cce'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:42.822554 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-511eada9-a189-4ea7-b4a2-5bb20ec09cce admin admin] The token cache is being invalidate because project a2afe4a941964e6b8742a7fb73bcec6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:11:42.822890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-511eada9-a189-4ea7-b4a2-5bb20ec09cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:42.823659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-511eada9-a189-4ea7-b4a2-5bb20ec09cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:42.825821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1214/2414] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:11:42 2022] DELETE /identity/v3/projects/a2afe4a941964e6b8742a7fb73bcec6e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:11:42.830921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b1b30-69a3-4d7e-b8b6-8fafd8558dc7 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:42.831762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b1b30-69a3-4d7e-b8b6-8fafd8558dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:42.831941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b1b30-69a3-4d7e-b8b6-8fafd8558dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:42.855247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9e2b1b30-69a3-4d7e-b8b6-8fafd8558dc7 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:42.856731 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9e2b1b30-69a3-4d7e-b8b6-8fafd8558dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:42.932484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1201/2415] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:42.941196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597522-b261-4716-bfd3-2d6ffbaf09df None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:42.941487 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597522-b261-4716-bfd3-2d6ffbaf09df None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:42.941765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597522-b261-4716-bfd3-2d6ffbaf09df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:42.963687 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-48597522-b261-4716-bfd3-2d6ffbaf09df None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:42.964958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-48597522-b261-4716-bfd3-2d6ffbaf09df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:42.980407 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1215/2416] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:42.984950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b1b30-69a3-4d7e-b8b6-8fafd8558dc7 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:43.007781 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b1b30-69a3-4d7e-b8b6-8fafd8558dc7 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:43.013266 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47727cd-3652-42a3-98b3-5496f9a69d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:43.013499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47727cd-3652-42a3-98b3-5496f9a69d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:43.014044 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47727cd-3652-42a3-98b3-5496f9a69d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:43.022399 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47727cd-3652-42a3-98b3-5496f9a69d4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:43.022399 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47727cd-3652-42a3-98b3-5496f9a69d4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:11:43.022399 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47727cd-3652-42a3-98b3-5496f9a69d4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:43.022399 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47727cd-3652-42a3-98b3-5496f9a69d4b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:43.030024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:43.036316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1202/2417] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:11:43.040221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48597522-b261-4716-bfd3-2d6ffbaf09df None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:43.051727 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48597522-b261-4716-bfd3-2d6ffbaf09df None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:43.071788 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb6a3a-acb2-47c5-ae9d-63273b9eac4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:43.072492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb6a3a-acb2-47c5-ae9d-63273b9eac4a admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:43.072773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb6a3a-acb2-47c5-ae9d-63273b9eac4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:43.073046 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb6a3a-acb2-47c5-ae9d-63273b9eac4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:43.073685 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb6a3a-acb2-47c5-ae9d-63273b9eac4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:43.075659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb6a3a-acb2-47c5-ae9d-63273b9eac4a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:43.107476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1216/2418] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:11:43 2022] POST /identity/v3/projects => generated 391 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:11:43.113448 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47727cd-3652-42a3-98b3-5496f9a69d4b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:43.124050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47727cd-3652-42a3-98b3-5496f9a69d4b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:43.193161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b658142-5448-478b-b77c-3d86320a48f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:43.194134 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b658142-5448-478b-b77c-3d86320a48f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:43.194619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b658142-5448-478b-b77c-3d86320a48f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:43.195070 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b658142-5448-478b-b77c-3d86320a48f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:43.195922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b658142-5448-478b-b77c-3d86320a48f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:43.198817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b658142-5448-478b-b77c-3d86320a48f9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:43.221662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1203/2419] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:11:43 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:11:43.225964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb6a3a-acb2-47c5-ae9d-63273b9eac4a admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:43.238492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb6a3a-acb2-47c5-ae9d-63273b9eac4a admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:43.243646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305716c7-7946-4e63-a9ad-acdef178646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:43.244283 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305716c7-7946-4e63-a9ad-acdef178646c admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:43.244570 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305716c7-7946-4e63-a9ad-acdef178646c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:43.244845 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305716c7-7946-4e63-a9ad-acdef178646c admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:43.245501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305716c7-7946-4e63-a9ad-acdef178646c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:43.247181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305716c7-7946-4e63-a9ad-acdef178646c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:43.261869 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1217/2420] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:11:43.266162 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b658142-5448-478b-b77c-3d86320a48f9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:43.277200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b658142-5448-478b-b77c-3d86320a48f9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:43.282752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f2584-5a8a-4059-9a53-852eeedf4acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:43.283379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f2584-5a8a-4059-9a53-852eeedf4acf admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:43.283658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f2584-5a8a-4059-9a53-852eeedf4acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:43.283941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f2584-5a8a-4059-9a53-852eeedf4acf admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:43.284634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f2584-5a8a-4059-9a53-852eeedf4acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:43.286255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f2584-5a8a-4059-9a53-852eeedf4acf admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:43.297658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1204/2421] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:11:43.302585 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305716c7-7946-4e63-a9ad-acdef178646c admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:43.314278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305716c7-7946-4e63-a9ad-acdef178646c admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:43.321016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf3a93-11a5-41aa-86a8-5bd38be2aa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:43.321720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf3a93-11a5-41aa-86a8-5bd38be2aa14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:43.322151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf3a93-11a5-41aa-86a8-5bd38be2aa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:43.322437 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf3a93-11a5-41aa-86a8-5bd38be2aa14 admin admin] PATH_INFO: `/v3/projects/8f3af90f463745cbb673b40de9ecd355/users/b1413519b35e4582ae05a37c95bd2d64/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:43.341613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf3a93-11a5-41aa-86a8-5bd38be2aa14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3af90f463745cbb673b40de9ecd355, user_id=b1413519b35e4582ae05a37c95bd2d64, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:43.344514 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf3a93-11a5-41aa-86a8-5bd38be2aa14 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:43.359772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1218/2422] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:11:43 2022] PUT /identity/v3/projects/8f3af90f463745cbb673b40de9ecd355/users/b1413519b35e4582ae05a37c95bd2d64/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:11:43.370624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44779c3d-d606-460e-b7dc-bfed764a0eba None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:43.370949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44779c3d-d606-460e-b7dc-bfed764a0eba None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:43.371230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44779c3d-d606-460e-b7dc-bfed764a0eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:43.401257 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-44779c3d-d606-460e-b7dc-bfed764a0eba None None] MFA Rules not processed for user `b1413519b35e4582ae05a37c95bd2d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:43.402491 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-44779c3d-d606-460e-b7dc-bfed764a0eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:43.497372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1205/2423] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:11:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:43.509262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf3a93-11a5-41aa-86a8-5bd38be2aa14 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:43.511007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2cbf3a93-11a5-41aa-86a8-5bd38be2aa14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:43.569015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf3a93-11a5-41aa-86a8-5bd38be2aa14 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:43.572644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f4a55-fb2c-44cd-8b58-744a41b8bbd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:43.573275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f4a55-fb2c-44cd-8b58-744a41b8bbd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:43.573551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f4a55-fb2c-44cd-8b58-744a41b8bbd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:43.573822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f4a55-fb2c-44cd-8b58-744a41b8bbd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:43.582066 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f4a55-fb2c-44cd-8b58-744a41b8bbd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:43.583500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f4a55-fb2c-44cd-8b58-744a41b8bbd7 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:43.592028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1219/2424] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:11:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:11:50.082659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5908ad5-6995-4cb4-acb0-ccc02024068c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:50.083225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5908ad5-6995-4cb4-acb0-ccc02024068c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:50.083351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5908ad5-6995-4cb4-acb0-ccc02024068c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:50.102501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e5908ad5-6995-4cb4-acb0-ccc02024068c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:50.103766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e5908ad5-6995-4cb4-acb0-ccc02024068c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:50.174540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1206/2425] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Aug 19 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:50.192357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f4a55-fb2c-44cd-8b58-744a41b8bbd7 service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:50.194947 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9e4f4a55-fb2c-44cd-8b58-744a41b8bbd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:50.269917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f4a55-fb2c-44cd-8b58-744a41b8bbd7 service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:50.276625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb61bc1-c749-4c02-aa12-b151f8094016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:50.277241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb61bc1-c749-4c02-aa12-b151f8094016 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:50.277521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb61bc1-c749-4c02-aa12-b151f8094016 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:50.277794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb61bc1-c749-4c02-aa12-b151f8094016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:50.286397 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb61bc1-c749-4c02-aa12-b151f8094016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:50.288383 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb61bc1-c749-4c02-aa12-b151f8094016 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:50.298496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1220/2426] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:11:53.788982 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5908ad5-6995-4cb4-acb0-ccc02024068c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:53.799100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5908ad5-6995-4cb4-acb0-ccc02024068c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:53.804953 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:53.805602 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:53.805885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:53.806162 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] PATH_INFO: `/v3/users/b1413519b35e4582ae05a37c95bd2d64` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:53.807339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1413519b35e4582ae05a37c95bd2d64)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:53.809273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:53.812310 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:53.859924 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1413519b35e4582ae05a37c95bd2d64'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:53.872905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1413519b35e4582ae05a37c95bd2d64'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:53.880522 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1413519b35e4582ae05a37c95bd2d64'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:53.882067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1413519b35e4582ae05a37c95bd2d64'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:53.882726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1413519b35e4582ae05a37c95bd2d64'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:53.895789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1207/2427] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:11:53 2022] DELETE /identity/v3/users/b1413519b35e4582ae05a37c95bd2d64 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:11:53.900842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dc932-fbbf-4f03-a941-0e84bb60a43b None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:53.901337 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dc932-fbbf-4f03-a941-0e84bb60a43b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:53.901433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dc932-fbbf-4f03-a941-0e84bb60a43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:53.920261 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-817dc932-fbbf-4f03-a941-0e84bb60a43b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:53.921557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-817dc932-fbbf-4f03-a941-0e84bb60a43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:53.925438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:53.985025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1221/2428] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:53.995530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:53.996938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:54.055661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918a58c-eee2-4210-9c6c-73288cfa2046 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:54.059554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ff06f-b3b5-47e3-af8a-21c069bd18fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:54.060177 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ff06f-b3b5-47e3-af8a-21c069bd18fb service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:54.060462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ff06f-b3b5-47e3-af8a-21c069bd18fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:54.060737 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ff06f-b3b5-47e3-af8a-21c069bd18fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:54.070725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ff06f-b3b5-47e3-af8a-21c069bd18fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:54.072306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ff06f-b3b5-47e3-af8a-21c069bd18fb service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:54.082450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1208/2429] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:11:54.400616 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dc932-fbbf-4f03-a941-0e84bb60a43b None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:54.401875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-817dc932-fbbf-4f03-a941-0e84bb60a43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:54.414908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dc932-fbbf-4f03-a941-0e84bb60a43b None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:54.422117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309284f8-0f12-49b5-8c40-48e5123cd451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:54.422117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309284f8-0f12-49b5-8c40-48e5123cd451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:54.422346 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309284f8-0f12-49b5-8c40-48e5123cd451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:54.422564 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309284f8-0f12-49b5-8c40-48e5123cd451 admin admin] PATH_INFO: `/v3/projects/8f3af90f463745cbb673b40de9ecd355` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:54.423753 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309284f8-0f12-49b5-8c40-48e5123cd451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3af90f463745cbb673b40de9ecd355)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:54.425647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309284f8-0f12-49b5-8c40-48e5123cd451 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:54.431482 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb96ccc-5bbf-4376-9201-41aa5b9d87af None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:54.431781 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb96ccc-5bbf-4376-9201-41aa5b9d87af None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:54.432289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb96ccc-5bbf-4376-9201-41aa5b9d87af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:54.457138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5eb96ccc-5bbf-4376-9201-41aa5b9d87af None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:54.459213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5eb96ccc-5bbf-4376-9201-41aa5b9d87af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:54.467828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1209/2430] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Aug 19 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:54.483655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb96ccc-5bbf-4376-9201-41aa5b9d87af None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:54.484646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-309284f8-0f12-49b5-8c40-48e5123cd451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3af90f463745cbb673b40de9ecd355', 'request_id': 'req-309284f8-0f12-49b5-8c40-48e5123cd451'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:54.485267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5eb96ccc-5bbf-4376-9201-41aa5b9d87af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:54.494534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-309284f8-0f12-49b5-8c40-48e5123cd451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3af90f463745cbb673b40de9ecd355', 'request_id': 'req-309284f8-0f12-49b5-8c40-48e5123cd451'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:54.501787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-309284f8-0f12-49b5-8c40-48e5123cd451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3af90f463745cbb673b40de9ecd355', 'request_id': 'req-309284f8-0f12-49b5-8c40-48e5123cd451'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:54.512745 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-309284f8-0f12-49b5-8c40-48e5123cd451 admin admin] The token cache is being invalidate because project 8f3af90f463745cbb673b40de9ecd355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:11:54.513120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-309284f8-0f12-49b5-8c40-48e5123cd451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:54.513859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-309284f8-0f12-49b5-8c40-48e5123cd451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:11:54.515458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1222/2431] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:11:54 2022] DELETE /identity/v3/projects/8f3af90f463745cbb673b40de9ecd355 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:11:54.520836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e7a77-664d-4c7d-9e7a-4a52b985a7b8 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:54.521031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e7a77-664d-4c7d-9e7a-4a52b985a7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:54.521825 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e7a77-664d-4c7d-9e7a-4a52b985a7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:54.543494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-725e7a77-664d-4c7d-9e7a-4a52b985a7b8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:54.545041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-725e7a77-664d-4c7d-9e7a-4a52b985a7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:54.586453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb96ccc-5bbf-4376-9201-41aa5b9d87af None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:54.598093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:54.612208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1223/2432] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:11:54.663360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6bdbc-87a1-4d75-9b10-021377cbe64b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:54.664032 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6bdbc-87a1-4d75-9b10-021377cbe64b service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:54.664317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6bdbc-87a1-4d75-9b10-021377cbe64b service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:54.664596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6bdbc-87a1-4d75-9b10-021377cbe64b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:54.666533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7fd6bdbc-87a1-4d75-9b10-021377cbe64b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:54.679135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cfd21-0909-4695-ab89-9937c43bd542 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:54.679384 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6bdbc-87a1-4d75-9b10-021377cbe64b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:54.679518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cfd21-0909-4695-ab89-9937c43bd542 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:54.679689 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cfd21-0909-4695-ab89-9937c43bd542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:54.680999 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6bdbc-87a1-4d75-9b10-021377cbe64b service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:54.692098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1210/2433] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:11:54.699753 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-461cfd21-0909-4695-ab89-9937c43bd542 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:54.700961 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-461cfd21-0909-4695-ab89-9937c43bd542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:54.709210 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1224/2434] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:11:54.713568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6bdbc-87a1-4d75-9b10-021377cbe64b service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:54.723835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6bdbc-87a1-4d75-9b10-021377cbe64b service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:54.729333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc5880-81f0-4aec-a349-d70bfec63694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:54.729990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc5880-81f0-4aec-a349-d70bfec63694 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:54.730331 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc5880-81f0-4aec-a349-d70bfec63694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:54.730605 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc5880-81f0-4aec-a349-d70bfec63694 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:54.731389 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc5880-81f0-4aec-a349-d70bfec63694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:11:54.731692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc5880-81f0-4aec-a349-d70bfec63694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:54.733311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc5880-81f0-4aec-a349-d70bfec63694 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:54.751538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1211/2435] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:11:54.752817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cfd21-0909-4695-ab89-9937c43bd542 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:54.768595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cfd21-0909-4695-ab89-9937c43bd542 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:54.774080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4645f7-ce74-4234-ac1d-4e7a67d1548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:54.774895 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4645f7-ce74-4234-ac1d-4e7a67d1548d admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:54.775277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4645f7-ce74-4234-ac1d-4e7a67d1548d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:54.775653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4645f7-ce74-4234-ac1d-4e7a67d1548d admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:54.776413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4645f7-ce74-4234-ac1d-4e7a67d1548d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:54.778389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4645f7-ce74-4234-ac1d-4e7a67d1548d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:54.806966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1225/2436] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:11:54 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:11:54.811303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc5880-81f0-4aec-a349-d70bfec63694 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:54.822242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc5880-81f0-4aec-a349-d70bfec63694 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:54.880432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6bb98-65b2-4fb3-b3aa-620bda87141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:54.881777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6bb98-65b2-4fb3-b3aa-620bda87141c admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:54.882266 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6bb98-65b2-4fb3-b3aa-620bda87141c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:54.882589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6bb98-65b2-4fb3-b3aa-620bda87141c admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:54.883262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6bb98-65b2-4fb3-b3aa-620bda87141c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:54.885200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6bb98-65b2-4fb3-b3aa-620bda87141c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:54.906712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1212/2437] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:11:54 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:11:54.910962 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4645f7-ce74-4234-ac1d-4e7a67d1548d admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:54.919991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:54.924045 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4645f7-ce74-4234-ac1d-4e7a67d1548d admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:54.930589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313a703-071a-4489-b15e-c4e47dadc218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:54.931716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313a703-071a-4489-b15e-c4e47dadc218 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:54.932057 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313a703-071a-4489-b15e-c4e47dadc218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:54.932381 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313a703-071a-4489-b15e-c4e47dadc218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:54.933091 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313a703-071a-4489-b15e-c4e47dadc218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:54.935156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313a703-071a-4489-b15e-c4e47dadc218 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:54.945956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1226/2438] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:11:54.950265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6bb98-65b2-4fb3-b3aa-620bda87141c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:54.961412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6bb98-65b2-4fb3-b3aa-620bda87141c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:54.966457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022389a-9d85-4091-817f-b72b4c25b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:54.967188 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022389a-9d85-4091-817f-b72b4c25b477 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:54.967624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022389a-9d85-4091-817f-b72b4c25b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:54.967908 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022389a-9d85-4091-817f-b72b4c25b477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:54.968915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022389a-9d85-4091-817f-b72b4c25b477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:54.970854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022389a-9d85-4091-817f-b72b4c25b477 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:54.983213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1213/2439] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:11:54.988085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313a703-071a-4489-b15e-c4e47dadc218 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:54.999659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313a703-071a-4489-b15e-c4e47dadc218 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:55.004520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bb1e3-2151-40af-8fe5-5e1de5bd9961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:55.005188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bb1e3-2151-40af-8fe5-5e1de5bd9961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:55.005564 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bb1e3-2151-40af-8fe5-5e1de5bd9961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:55.005866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bb1e3-2151-40af-8fe5-5e1de5bd9961 admin admin] PATH_INFO: `/v3/projects/76142efc6162448cb30a3f646a4c3065/users/063488d3edc442a5b9d76e4fc2e451ec/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:55.020793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bb1e3-2151-40af-8fe5-5e1de5bd9961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76142efc6162448cb30a3f646a4c3065, user_id=063488d3edc442a5b9d76e4fc2e451ec, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:55.023568 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bb1e3-2151-40af-8fe5-5e1de5bd9961 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:55.037372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1227/2440] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:11:54 2022] PUT /identity/v3/projects/76142efc6162448cb30a3f646a4c3065/users/063488d3edc442a5b9d76e4fc2e451ec/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:11:55.042584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bde34c-dab3-4435-bd5a-6337f739a86c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:55.043065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bde34c-dab3-4435-bd5a-6337f739a86c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:55.043535 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bde34c-dab3-4435-bd5a-6337f739a86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:55.063624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b9bde34c-dab3-4435-bd5a-6337f739a86c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:55.064826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b9bde34c-dab3-4435-bd5a-6337f739a86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:55.124645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1214/2441] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:55.134592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bb1e3-2151-40af-8fe5-5e1de5bd9961 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:55.136881 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-187bb1e3-2151-40af-8fe5-5e1de5bd9961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:55.198306 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bb1e3-2151-40af-8fe5-5e1de5bd9961 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:55.202278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfad67-14e8-46b4-bec9-97856d5289f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:55.202931 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfad67-14e8-46b4-bec9-97856d5289f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:55.203225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfad67-14e8-46b4-bec9-97856d5289f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:55.203497 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfad67-14e8-46b4-bec9-97856d5289f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:55.213328 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfad67-14e8-46b4-bec9-97856d5289f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:55.214784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfad67-14e8-46b4-bec9-97856d5289f5 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:55.224181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1228/2442] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:11:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:11:58.592220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d381e-c2ae-4e3e-8d47-ca93f7ea28fc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:58.592966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d381e-c2ae-4e3e-8d47-ca93f7ea28fc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:58.592966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d381e-c2ae-4e3e-8d47-ca93f7ea28fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:58.608306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:58.615476 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-8e6d381e-c2ae-4e3e-8d47-ca93f7ea28fc None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:58.616995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8e6d381e-c2ae-4e3e-8d47-ca93f7ea28fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:58.627177 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1215/2443] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Aug 19 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:58.644556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfad67-14e8-46b4-bec9-97856d5289f5 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:58.647152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-94dfad67-14e8-46b4-bec9-97856d5289f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:58.753253 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfad67-14e8-46b4-bec9-97856d5289f5 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:58.761533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941c9f9-02ce-478c-90e9-ce639b0f8a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:58.762170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941c9f9-02ce-478c-90e9-ce639b0f8a76 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:58.762469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941c9f9-02ce-478c-90e9-ce639b0f8a76 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:58.762753 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941c9f9-02ce-478c-90e9-ce639b0f8a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:58.783341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941c9f9-02ce-478c-90e9-ce639b0f8a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:58.785195 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941c9f9-02ce-478c-90e9-ce639b0f8a76 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:58.798778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1229/2444] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:11:59.813371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aab97d-e4cf-4b25-b9be-3a21ddb97f9b None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:59.813942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aab97d-e4cf-4b25-b9be-3a21ddb97f9b None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:59.814405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aab97d-e4cf-4b25-b9be-3a21ddb97f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:59.850485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a8aab97d-e4cf-4b25-b9be-3a21ddb97f9b None None] MFA Rules not processed for user `063488d3edc442a5b9d76e4fc2e451ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:11:59.851912 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a8aab97d-e4cf-4b25-b9be-3a21ddb97f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:11:59.923673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1216/2445] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:11:59.928275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941c9f9-02ce-478c-90e9-ce639b0f8a76 service nova] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:59.939039 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941c9f9-02ce-478c-90e9-ce639b0f8a76 service nova] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:11:59.944758 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfccd7e-294b-43a6-866d-235e441a6f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:11:59.945495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfccd7e-294b-43a6-866d-235e441a6f98 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:11:59.945864 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfccd7e-294b-43a6-866d-235e441a6f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:11:59.946212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfccd7e-294b-43a6-866d-235e441a6f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:11:59.947162 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfccd7e-294b-43a6-866d-235e441a6f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:11:59.949073 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfccd7e-294b-43a6-866d-235e441a6f98 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:11:59.981005 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1230/2446] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:11:59 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:11:59.986159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aab97d-e4cf-4b25-b9be-3a21ddb97f9b None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:11:59.999175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aab97d-e4cf-4b25-b9be-3a21ddb97f9b None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:00.089729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc3e6d-cbe0-4819-9726-b17510b3f179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:00.090453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc3e6d-cbe0-4819-9726-b17510b3f179 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:00.090836 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc3e6d-cbe0-4819-9726-b17510b3f179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:00.091181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc3e6d-cbe0-4819-9726-b17510b3f179 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:00.091900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc3e6d-cbe0-4819-9726-b17510b3f179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:00.093951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc3e6d-cbe0-4819-9726-b17510b3f179 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:00.120907 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1217/2447] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:11:59 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:12:00.124842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfccd7e-294b-43a6-866d-235e441a6f98 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:00.136597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfccd7e-294b-43a6-866d-235e441a6f98 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:00.141570 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f6694-c3a9-46c5-8902-8db1aa29ed9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:00.142204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6694-c3a9-46c5-8902-8db1aa29ed9b admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:00.142484 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6694-c3a9-46c5-8902-8db1aa29ed9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:00.142973 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6694-c3a9-46c5-8902-8db1aa29ed9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:00.143635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f6694-c3a9-46c5-8902-8db1aa29ed9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:00.145254 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f6694-c3a9-46c5-8902-8db1aa29ed9b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:00.162668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1231/2448] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:12:00.164264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc3e6d-cbe0-4819-9726-b17510b3f179 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:00.183029 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc3e6d-cbe0-4819-9726-b17510b3f179 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:00.195600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82398b1a-52e8-446a-bc9f-67643bc43cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:00.198105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82398b1a-52e8-446a-bc9f-67643bc43cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:00.198457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82398b1a-52e8-446a-bc9f-67643bc43cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:00.198783 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82398b1a-52e8-446a-bc9f-67643bc43cc3 admin admin] PATH_INFO: `/v3/projects/f7ea822f602d4052b58f83805fa22e7a/users/30f8e22dbc3a44cfb67e446284a486bf/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:00.221119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82398b1a-52e8-446a-bc9f-67643bc43cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ea822f602d4052b58f83805fa22e7a, user_id=30f8e22dbc3a44cfb67e446284a486bf, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:00.224018 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82398b1a-52e8-446a-bc9f-67643bc43cc3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:00.242719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1218/2449] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:12:00 2022] PUT /identity/v3/projects/f7ea822f602d4052b58f83805fa22e7a/users/30f8e22dbc3a44cfb67e446284a486bf/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:12:00.247461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f6694-c3a9-46c5-8902-8db1aa29ed9b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:00.286613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f6694-c3a9-46c5-8902-8db1aa29ed9b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:00.331181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:00.387422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2df8f-7c31-470a-b1d0-a070054f3331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:00.388046 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2df8f-7c31-470a-b1d0-a070054f3331 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:00.388329 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2df8f-7c31-470a-b1d0-a070054f3331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:00.388602 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2df8f-7c31-470a-b1d0-a070054f3331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:00.389284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2df8f-7c31-470a-b1d0-a070054f3331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:00.390960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2df8f-7c31-470a-b1d0-a070054f3331 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:00.404528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1232/2450] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:12:00.408595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82398b1a-52e8-446a-bc9f-67643bc43cc3 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:00.421156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82398b1a-52e8-446a-bc9f-67643bc43cc3 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:00.426006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a8b09-411b-40e1-9521-0ce74ae42969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:00.426683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a8b09-411b-40e1-9521-0ce74ae42969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:00.427003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a8b09-411b-40e1-9521-0ce74ae42969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:00.427439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a8b09-411b-40e1-9521-0ce74ae42969 admin admin] PATH_INFO: `/v3/projects/f7ea822f602d4052b58f83805fa22e7a/users/30f8e22dbc3a44cfb67e446284a486bf/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:00.430311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a8b09-411b-40e1-9521-0ce74ae42969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ea822f602d4052b58f83805fa22e7a, user_id=30f8e22dbc3a44cfb67e446284a486bf, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:00.433140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a8b09-411b-40e1-9521-0ce74ae42969 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:00.446910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1219/2451] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:12:00 2022] PUT /identity/v3/projects/f7ea822f602d4052b58f83805fa22e7a/users/30f8e22dbc3a44cfb67e446284a486bf/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:12:02.952731 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdec437-f759-46b0-ac7e-118e8618110b None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:02.953960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdec437-f759-46b0-ac7e-118e8618110b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:02.953960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdec437-f759-46b0-ac7e-118e8618110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:03.023446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7cdec437-f759-46b0-ac7e-118e8618110b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:12:03.026660 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7cdec437-f759-46b0-ac7e-118e8618110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:03.106192 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1233/2452] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Aug 19 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:12:03.123134 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a8b09-411b-40e1-9521-0ce74ae42969 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:03.188626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:03.231033 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a8b09-411b-40e1-9521-0ce74ae42969 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:03.237571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2035b-e0ee-4d72-9870-d1c489960426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:03.238183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2035b-e0ee-4d72-9870-d1c489960426 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:03.238462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2035b-e0ee-4d72-9870-d1c489960426 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:03.238941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2035b-e0ee-4d72-9870-d1c489960426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:03.249989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2035b-e0ee-4d72-9870-d1c489960426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:03.251773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2035b-e0ee-4d72-9870-d1c489960426 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:03.263555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1220/2453] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:12:05.867633 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c7e52-7d12-4884-b418-ac2831a26567 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:05.868485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c7e52-7d12-4884-b418-ac2831a26567 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:05.868485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c7e52-7d12-4884-b418-ac2831a26567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:05.900542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e80c7e52-7d12-4884-b418-ac2831a26567 None None] MFA Rules not processed for user `30f8e22dbc3a44cfb67e446284a486bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:12:05.902072 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e80c7e52-7d12-4884-b418-ac2831a26567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:05.994981 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1234/2454] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:12:06.015426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2035b-e0ee-4d72-9870-d1c489960426 service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:06.017774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9eb2035b-e0ee-4d72-9870-d1c489960426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:06.163751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2035b-e0ee-4d72-9870-d1c489960426 service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:06.167843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d57dc-f5ec-4836-9bb6-a7595b6146c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b105e7094aea9dcc7423d6205c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:06.168631 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d57dc-f5ec-4836-9bb6-a7595b6146c7 service glance] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:06.169017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d57dc-f5ec-4836-9bb6-a7595b6146c7 service glance] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:06.169499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d57dc-f5ec-4836-9bb6-a7595b6146c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:06.266085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d57dc-f5ec-4836-9bb6-a7595b6146c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:06.268028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d57dc-f5ec-4836-9bb6-a7595b6146c7 service glance] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:06.281893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1221/2455] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:12:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:12:06.452699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4ca7a-d659-421b-b78d-5287220d9beb None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:06.453005 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4ca7a-d659-421b-b78d-5287220d9beb None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:06.453449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4ca7a-d659-421b-b78d-5287220d9beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:06.477963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-f8c4ca7a-d659-421b-b78d-5287220d9beb None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:12:06.479253 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f8c4ca7a-d659-421b-b78d-5287220d9beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:06.569604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:06.603748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1235/2456] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:12:06.611505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d57dc-f5ec-4836-9bb6-a7595b6146c7 service glance] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:06.612613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-867d57dc-f5ec-4836-9bb6-a7595b6146c7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:06.780957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d57dc-f5ec-4836-9bb6-a7595b6146c7 service glance] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:06.789844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389b803-d7e1-412f-85ea-703713c3064e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:06.791156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389b803-d7e1-412f-85ea-703713c3064e service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:06.791654 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389b803-d7e1-412f-85ea-703713c3064e service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:06.792473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389b803-d7e1-412f-85ea-703713c3064e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:06.811012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389b803-d7e1-412f-85ea-703713c3064e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:06.815181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389b803-d7e1-412f-85ea-703713c3064e service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:06.827724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1222/2457] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:12:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 21:12:08.403228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef05cf8-2213-4c98-9f02-b5c8ad159d45 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:08.403951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef05cf8-2213-4c98-9f02-b5c8ad159d45 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:08.403951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef05cf8-2213-4c98-9f02-b5c8ad159d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:08.441597 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-8ef05cf8-2213-4c98-9f02-b5c8ad159d45 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:12:08.443877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8ef05cf8-2213-4c98-9f02-b5c8ad159d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:08.454016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1236/2458] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Aug 19 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:12:08.470984 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389b803-d7e1-412f-85ea-703713c3064e service swift] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:08.473364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1389b803-d7e1-412f-85ea-703713c3064e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:08.501258 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389b803-d7e1-412f-85ea-703713c3064e service swift] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:08.514250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68aa6aa-66c9-484a-971c-8d622a999794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:08.514250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aa6aa-66c9-484a-971c-8d622a999794 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:08.514250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aa6aa-66c9-484a-971c-8d622a999794 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:08.514250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aa6aa-66c9-484a-971c-8d622a999794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:08.526960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68aa6aa-66c9-484a-971c-8d622a999794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:08.529292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68aa6aa-66c9-484a-971c-8d622a999794 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:08.537698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:08.548327 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1223/2459] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:12:17.088400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2706-c819-403e-b0cf-c2d818aed122 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:17.088960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2706-c819-403e-b0cf-c2d818aed122 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:17.088960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2706-c819-403e-b0cf-c2d818aed122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:17.112405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-5cfd2706-c819-403e-b0cf-c2d818aed122 None None] MFA Rules not processed for user `063488d3edc442a5b9d76e4fc2e451ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:12:17.113639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5cfd2706-c819-403e-b0cf-c2d818aed122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:17.122076 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1237/2460] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:12:18.546514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:19.743226 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e41923-3c43-42f1-9269-9ffadaf92f30 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:19.744420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e41923-3c43-42f1-9269-9ffadaf92f30 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:19.745001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e41923-3c43-42f1-9269-9ffadaf92f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:19.780645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b6e41923-3c43-42f1-9269-9ffadaf92f30 None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:12:19.782915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b6e41923-3c43-42f1-9269-9ffadaf92f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:19.798931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1224/2461] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:12:19.817248 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2706-c819-403e-b0cf-c2d818aed122 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:19.834608 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2706-c819-403e-b0cf-c2d818aed122 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:19.841416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe0089-59aa-4450-9498-9e3ba84acf14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:19.842524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe0089-59aa-4450-9498-9e3ba84acf14 service swift] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:19.843083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe0089-59aa-4450-9498-9e3ba84acf14 service swift] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:19.843622 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe0089-59aa-4450-9498-9e3ba84acf14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:19.854888 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe0089-59aa-4450-9498-9e3ba84acf14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:19.857169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe0089-59aa-4450-9498-9e3ba84acf14 service swift] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:19.867704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1238/2462] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:12:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 21:12:23.209842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e41923-3c43-42f1-9269-9ffadaf92f30 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:23.211842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b6e41923-3c43-42f1-9269-9ffadaf92f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:23.299142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe0089-59aa-4450-9498-9e3ba84acf14 service swift] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:23.314579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe0089-59aa-4450-9498-9e3ba84acf14 service swift] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:23.319264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425b5cc-02d9-4071-b7f6-e53de0d3c779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:23.319894 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425b5cc-02d9-4071-b7f6-e53de0d3c779 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:23.320273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425b5cc-02d9-4071-b7f6-e53de0d3c779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:23.320444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425b5cc-02d9-4071-b7f6-e53de0d3c779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:23.322435 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2425b5cc-02d9-4071-b7f6-e53de0d3c779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:23.337673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e41923-3c43-42f1-9269-9ffadaf92f30 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:23.339977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425b5cc-02d9-4071-b7f6-e53de0d3c779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:23.341911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425b5cc-02d9-4071-b7f6-e53de0d3c779 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:23.355367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1239/2463] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:12:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:12:23.365985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac54396-b2b5-48a3-a958-f7067916de59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:23.367088 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac54396-b2b5-48a3-a958-f7067916de59 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:23.367831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac54396-b2b5-48a3-a958-f7067916de59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:23.368303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac54396-b2b5-48a3-a958-f7067916de59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:23.370489 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3ac54396-b2b5-48a3-a958-f7067916de59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:23.388412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac54396-b2b5-48a3-a958-f7067916de59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:23.390147 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac54396-b2b5-48a3-a958-f7067916de59 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:23.409906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1225/2464] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:12:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:12:33.350781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=22 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:33.398722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=29 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:34.942501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425b5cc-02d9-4071-b7f6-e53de0d3c779 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:34.960705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425b5cc-02d9-4071-b7f6-e53de0d3c779 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:34.968139 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771c07c-19b1-4823-b43c-22e16c3fae06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:34.969053 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771c07c-19b1-4823-b43c-22e16c3fae06 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:34.969529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771c07c-19b1-4823-b43c-22e16c3fae06 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:34.969958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771c07c-19b1-4823-b43c-22e16c3fae06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:34.972299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4771c07c-19b1-4823-b43c-22e16c3fae06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:35.064723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771c07c-19b1-4823-b43c-22e16c3fae06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:35.066670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771c07c-19b1-4823-b43c-22e16c3fae06 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:35.083968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1240/2465] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:12:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:12:38.084671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c14d1-b0c5-4ae8-92a8-fb8d430b8d4d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:38.085520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c14d1-b0c5-4ae8-92a8-fb8d430b8d4d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:38.085520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c14d1-b0c5-4ae8-92a8-fb8d430b8d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:38.106423 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-619c14d1-b0c5-4ae8-92a8-fb8d430b8d4d None None] MFA Rules not processed for user `467666e0a8d64f649526e84fdcc1a7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:12:38.107762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-619c14d1-b0c5-4ae8-92a8-fb8d430b8d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:38.194854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1226/2466] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:12:44.708627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771c07c-19b1-4823-b43c-22e16c3fae06 service nova] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:44.720158 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771c07c-19b1-4823-b43c-22e16c3fae06 service nova] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:44.727065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff19b09-71db-4980-9d2c-a25176449829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:44.727696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff19b09-71db-4980-9d2c-a25176449829 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:44.727971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff19b09-71db-4980-9d2c-a25176449829 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:44.728242 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff19b09-71db-4980-9d2c-a25176449829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:44.730153 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cff19b09-71db-4980-9d2c-a25176449829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:44.742575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff19b09-71db-4980-9d2c-a25176449829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:44.745159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff19b09-71db-4980-9d2c-a25176449829 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:44.756713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1241/2467] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:12:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:12:48.177392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=25 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:51.028063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c14d1-b0c5-4ae8-92a8-fb8d430b8d4d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:51.048646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c14d1-b0c5-4ae8-92a8-fb8d430b8d4d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:51.056734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e80ae-1dad-4377-bf06-1bf6902797fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:51.057791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e80ae-1dad-4377-bf06-1bf6902797fd service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:51.058301 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e80ae-1dad-4377-bf06-1bf6902797fd service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:51.058707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e80ae-1dad-4377-bf06-1bf6902797fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:51.061791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-658e80ae-1dad-4377-bf06-1bf6902797fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:51.140825 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e80ae-1dad-4377-bf06-1bf6902797fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:51.142489 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e80ae-1dad-4377-bf06-1bf6902797fd service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:51.154461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1227/2468] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:12:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:12:53.520213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff19b09-71db-4980-9d2c-a25176449829 service nova] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:53.532137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff19b09-71db-4980-9d2c-a25176449829 service nova] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:53.537364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfae07-70b1-46dd-b1cb-81c8371ce2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:53.538171 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfae07-70b1-46dd-b1cb-81c8371ce2fb service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:53.538515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfae07-70b1-46dd-b1cb-81c8371ce2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:53.538931 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfae07-70b1-46dd-b1cb-81c8371ce2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:53.549777 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfae07-70b1-46dd-b1cb-81c8371ce2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:53.551291 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfae07-70b1-46dd-b1cb-81c8371ce2fb service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:53.562198 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1242/2469] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:12:55.972097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e80ae-1dad-4377-bf06-1bf6902797fd service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:55.975538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-658e80ae-1dad-4377-bf06-1bf6902797fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:56.011833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e80ae-1dad-4377-bf06-1bf6902797fd service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:56.021083 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:56.022516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:56.023089 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:56.023607 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] PATH_INFO: `/v3/users/1762e003b6a64d51a42f4f57502712bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:56.027672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1762e003b6a64d51a42f4f57502712bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:56.030098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:56.111497 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1762e003b6a64d51a42f4f57502712bc'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:12:56.132311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1762e003b6a64d51a42f4f57502712bc'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:12:56.144362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1762e003b6a64d51a42f4f57502712bc'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:12:56.147119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1762e003b6a64d51a42f4f57502712bc'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:12:56.148298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1762e003b6a64d51a42f4f57502712bc'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:12:56.173241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1228/2470] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:12:55 2022] DELETE /identity/v3/users/1762e003b6a64d51a42f4f57502712bc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:12:56.256384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfae07-70b1-46dd-b1cb-81c8371ce2fb service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:56.285401 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfae07-70b1-46dd-b1cb-81c8371ce2fb service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:56.401440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f86e45-4638-449b-bd50-a643230de991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:56.402829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f86e45-4638-449b-bd50-a643230de991 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:56.403364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f86e45-4638-449b-bd50-a643230de991 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:56.403876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f86e45-4638-449b-bd50-a643230de991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:56.406550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-30f86e45-4638-449b-bd50-a643230de991 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:56.421901 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f86e45-4638-449b-bd50-a643230de991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:56.426352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f86e45-4638-449b-bd50-a643230de991 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:56.444443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1243/2471] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:12:56.831763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:12:56.833646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:12:57.028494 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf67a90-6f22-4be5-b902-b9e73c66d08f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:12:57.034183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:12:57.036714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:12:57.037329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:12:57.037914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] PATH_INFO: `/v3/projects/b0f4a4fbd9cc4c3bb96c816b200b4d7e` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:12:57.039890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f4a4fbd9cc4c3bb96c816b200b4d7e)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:12:57.043954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:12:57.065764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:57.146458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f4a4fbd9cc4c3bb96c816b200b4d7e', 'request_id': 'req-b2675b25-2129-40ba-a8be-241cb38127cf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:12:57.160241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f4a4fbd9cc4c3bb96c816b200b4d7e', 'request_id': 'req-b2675b25-2129-40ba-a8be-241cb38127cf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:12:57.183166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f4a4fbd9cc4c3bb96c816b200b4d7e', 'request_id': 'req-b2675b25-2129-40ba-a8be-241cb38127cf'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:12:57.233707 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] The token cache is being invalidate because project b0f4a4fbd9cc4c3bb96c816b200b4d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:12:57.235365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:12:57.235562 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:12:57.251427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1229/2472] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:12:56 2022] DELETE /identity/v3/projects/b0f4a4fbd9cc4c3bb96c816b200b4d7e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:13:02.289425 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc5d07-ea7f-4318-8a1b-a508b4ea9579 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:13:02.290567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc5d07-ea7f-4318-8a1b-a508b4ea9579 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:13:02.290567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc5d07-ea7f-4318-8a1b-a508b4ea9579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:13:02.311100 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-85fc5d07-ea7f-4318-8a1b-a508b4ea9579 None None] MFA Rules not processed for user `32bc4cb848c446ab8d4d330f9e2f0022`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:13:02.312351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-85fc5d07-ea7f-4318-8a1b-a508b4ea9579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:13:02.384755 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1244/2473] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:13:02.725654 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:13:02.727143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:13:02.790373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2675b25-2129-40ba-a8be-241cb38127cf admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:13:02.794037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae96a8f-d129-4144-ac0e-96c071652efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:13:02.794644 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae96a8f-d129-4144-ac0e-96c071652efc service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:13:02.794952 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae96a8f-d129-4144-ac0e-96c071652efc service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:13:02.795231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae96a8f-d129-4144-ac0e-96c071652efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:13:02.796980 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1ae96a8f-d129-4144-ac0e-96c071652efc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:13:02.807264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae96a8f-d129-4144-ac0e-96c071652efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:13:02.808680 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae96a8f-d129-4144-ac0e-96c071652efc service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:13:02.816634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1230/2474] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:13:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:13:03.143711 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc5d07-ea7f-4318-8a1b-a508b4ea9579 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:13:03.145183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-85fc5d07-ea7f-4318-8a1b-a508b4ea9579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:13:03.170331 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:03.230269 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc5d07-ea7f-4318-8a1b-a508b4ea9579 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:13:03.235382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab843800-0623-4579-8857-e3484475eccb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:13:03.236003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab843800-0623-4579-8857-e3484475eccb service placement] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:13:03.236292 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab843800-0623-4579-8857-e3484475eccb service placement] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:13:03.236668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab843800-0623-4579-8857-e3484475eccb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:13:03.238422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ab843800-0623-4579-8857-e3484475eccb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:13:03.251554 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab843800-0623-4579-8857-e3484475eccb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:13:03.253155 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab843800-0623-4579-8857-e3484475eccb service placement] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:13:03.264407 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1245/2475] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:13:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:13:12.813068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:13.260138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=23 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:17.155094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae96a8f-d129-4144-ac0e-96c071652efc service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:13:17.156712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1ae96a8f-d129-4144-ac0e-96c071652efc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:13:17.167688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae96a8f-d129-4144-ac0e-96c071652efc service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:13:17.171380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babffdc-3044-43e5-9242-d91b5cba8127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:13:17.171996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babffdc-3044-43e5-9242-d91b5cba8127 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:13:17.172312 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babffdc-3044-43e5-9242-d91b5cba8127 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:13:17.172589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babffdc-3044-43e5-9242-d91b5cba8127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:13:17.174550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0babffdc-3044-43e5-9242-d91b5cba8127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:13:17.188090 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babffdc-3044-43e5-9242-d91b5cba8127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:13:17.189550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babffdc-3044-43e5-9242-d91b5cba8127 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:13:17.199206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1231/2476] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:13:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:13:17.765792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab843800-0623-4579-8857-e3484475eccb service placement] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:13:17.777987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ab843800-0623-4579-8857-e3484475eccb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:13:17.899129 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab843800-0623-4579-8857-e3484475eccb service placement] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:13:17.909135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eff023-d238-4201-9d7f-e4b6a1cf9d2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:13:17.910264 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eff023-d238-4201-9d7f-e4b6a1cf9d2c service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:13:17.910615 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eff023-d238-4201-9d7f-e4b6a1cf9d2c service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:13:17.913046 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eff023-d238-4201-9d7f-e4b6a1cf9d2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:13:17.916336 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-14eff023-d238-4201-9d7f-e4b6a1cf9d2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:13:17.932075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eff023-d238-4201-9d7f-e4b6a1cf9d2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:13:17.933853 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eff023-d238-4201-9d7f-e4b6a1cf9d2c service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:13:17.955072 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1246/2477] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:13:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:13:19.317621 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babffdc-3044-43e5-9242-d91b5cba8127 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:13:19.333590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babffdc-3044-43e5-9242-d91b5cba8127 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:13:19.340637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fd980-a9b6-4ede-8fe9-3aa17a09c2c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:13:19.341477 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fd980-a9b6-4ede-8fe9-3aa17a09c2c8 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:13:19.341861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fd980-a9b6-4ede-8fe9-3aa17a09c2c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:13:19.342242 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fd980-a9b6-4ede-8fe9-3aa17a09c2c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:13:19.344663 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-536fd980-a9b6-4ede-8fe9-3aa17a09c2c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:13:19.358389 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fd980-a9b6-4ede-8fe9-3aa17a09c2c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:13:19.360190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fd980-a9b6-4ede-8fe9-3aa17a09c2c8 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:13:19.372993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1232/2478] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:13:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:13:27.942215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=34 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:29.368530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=12 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:51.142950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eff023-d238-4201-9d7f-e4b6a1cf9d2c service nova] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:13:51.144520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-14eff023-d238-4201-9d7f-e4b6a1cf9d2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:13:51.161143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eff023-d238-4201-9d7f-e4b6a1cf9d2c service nova] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:13:51.168204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381090f-c4a1-4a85-bd8a-db7e27abb3b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:13:51.168957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381090f-c4a1-4a85-bd8a-db7e27abb3b0 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:13:51.169252 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381090f-c4a1-4a85-bd8a-db7e27abb3b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:13:51.169529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381090f-c4a1-4a85-bd8a-db7e27abb3b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:13:51.171335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8381090f-c4a1-4a85-bd8a-db7e27abb3b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:13:51.191680 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381090f-c4a1-4a85-bd8a-db7e27abb3b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:13:51.195483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381090f-c4a1-4a85-bd8a-db7e27abb3b0 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:13:51.217131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1247/2479] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:13:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:13:54.358392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3064-3d91-4b8e-bf33-ee294ccc9709 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:13:54.359030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3064-3d91-4b8e-bf33-ee294ccc9709 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:13:54.359170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3064-3d91-4b8e-bf33-ee294ccc9709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:13:54.382012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-721e3064-3d91-4b8e-bf33-ee294ccc9709 None None] MFA Rules not processed for user `8b4a6b0dc41d446f8c46bd5097f6b254`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:13:54.384222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-721e3064-3d91-4b8e-bf33-ee294ccc9709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:13:54.450785 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1233/2480] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:14:01.208955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=6 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:04.442978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=25 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:13.518473 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381090f-c4a1-4a85-bd8a-db7e27abb3b0 service nova] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:14:13.541901 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381090f-c4a1-4a85-bd8a-db7e27abb3b0 service nova] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:14:13.550072 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3d2ab-a64d-406d-8253-9f9fe1ced6d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:14:13.550695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3d2ab-a64d-406d-8253-9f9fe1ced6d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:13.551061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3d2ab-a64d-406d-8253-9f9fe1ced6d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:13.551345 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3d2ab-a64d-406d-8253-9f9fe1ced6d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:13.553446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-93f3d2ab-a64d-406d-8253-9f9fe1ced6d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:14:13.631707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3d2ab-a64d-406d-8253-9f9fe1ced6d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:14:13.633139 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3d2ab-a64d-406d-8253-9f9fe1ced6d1 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:14:13.644059 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1248/2481] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:14:17.229880 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e3064-3d91-4b8e-bf33-ee294ccc9709 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:14:17.242322 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e3064-3d91-4b8e-bf33-ee294ccc9709 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:14:17.248159 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8867f63-b7a8-43ea-8f88-85b371e477dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:14:17.248774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8867f63-b7a8-43ea-8f88-85b371e477dd service placement] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:17.249059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8867f63-b7a8-43ea-8f88-85b371e477dd service placement] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:17.249337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8867f63-b7a8-43ea-8f88-85b371e477dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:17.251248 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c8867f63-b7a8-43ea-8f88-85b371e477dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:14:17.264293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8867f63-b7a8-43ea-8f88-85b371e477dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:14:17.265899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8867f63-b7a8-43ea-8f88-85b371e477dd service placement] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:14:17.277872 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1234/2482] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:14:17.574554 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3d2ab-a64d-406d-8253-9f9fe1ced6d1 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:14:17.579812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-93f3d2ab-a64d-406d-8253-9f9fe1ced6d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:14:17.592844 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3d2ab-a64d-406d-8253-9f9fe1ced6d1 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:14:17.598726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3835a0-a8da-4791-9ec0-d769fbbb2db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:14:17.599505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3835a0-a8da-4791-9ec0-d769fbbb2db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:17.599859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3835a0-a8da-4791-9ec0-d769fbbb2db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:17.600200 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3835a0-a8da-4791-9ec0-d769fbbb2db6 admin admin] PATH_INFO: `/v3/users/467666e0a8d64f649526e84fdcc1a7ef` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:17.601417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3835a0-a8da-4791-9ec0-d769fbbb2db6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=467666e0a8d64f649526e84fdcc1a7ef)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:14:17.604058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3835a0-a8da-4791-9ec0-d769fbbb2db6 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:14:17.668146 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-fc3835a0-a8da-4791-9ec0-d769fbbb2db6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467666e0a8d64f649526e84fdcc1a7ef'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:14:17.675672 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-fc3835a0-a8da-4791-9ec0-d769fbbb2db6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467666e0a8d64f649526e84fdcc1a7ef'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:14:17.676301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-fc3835a0-a8da-4791-9ec0-d769fbbb2db6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467666e0a8d64f649526e84fdcc1a7ef'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:14:17.676913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-fc3835a0-a8da-4791-9ec0-d769fbbb2db6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467666e0a8d64f649526e84fdcc1a7ef'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:14:17.689607 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-fc3835a0-a8da-4791-9ec0-d769fbbb2db6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467666e0a8d64f649526e84fdcc1a7ef'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:14:17.703810 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1249/2483] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:14:17 2022] DELETE /identity/v3/users/467666e0a8d64f649526e84fdcc1a7ef => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:14:17.889110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8867f63-b7a8-43ea-8f88-85b371e477dd service placement] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:14:17.901800 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8867f63-b7a8-43ea-8f88-85b371e477dd service placement] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:14:17.964632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1db50-316d-434d-ada2-dfa06d2080a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:14:17.965277 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1db50-316d-434d-ada2-dfa06d2080a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:17.965564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1db50-316d-434d-ada2-dfa06d2080a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:17.965844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1db50-316d-434d-ada2-dfa06d2080a8 admin admin] PATH_INFO: `/v3/projects/a2a8b69a2eaa427e8d300ea67d2f7d6e` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:17.967026 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1db50-316d-434d-ada2-dfa06d2080a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a8b69a2eaa427e8d300ea67d2f7d6e)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:14:17.968937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1db50-316d-434d-ada2-dfa06d2080a8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:14:18.018709 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-82c1db50-316d-434d-ada2-dfa06d2080a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a8b69a2eaa427e8d300ea67d2f7d6e', 'request_id': 'req-82c1db50-316d-434d-ada2-dfa06d2080a8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:14:18.024909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-82c1db50-316d-434d-ada2-dfa06d2080a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a8b69a2eaa427e8d300ea67d2f7d6e', 'request_id': 'req-82c1db50-316d-434d-ada2-dfa06d2080a8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:14:18.033349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-82c1db50-316d-434d-ada2-dfa06d2080a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a8b69a2eaa427e8d300ea67d2f7d6e', 'request_id': 'req-82c1db50-316d-434d-ada2-dfa06d2080a8'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:14:18.047971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-82c1db50-316d-434d-ada2-dfa06d2080a8 admin admin] The token cache is being invalidate because project a2a8b69a2eaa427e8d300ea67d2f7d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:14:18.048414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-82c1db50-316d-434d-ada2-dfa06d2080a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:14:18.049230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-82c1db50-316d-434d-ada2-dfa06d2080a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:14:18.051409 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1235/2484] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:14:17 2022] DELETE /identity/v3/projects/a2a8b69a2eaa427e8d300ea67d2f7d6e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:14:18.057527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0b633-b64c-4ea3-953a-27867bd4876b None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:18.057738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0b633-b64c-4ea3-953a-27867bd4876b None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:18.058021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0b633-b64c-4ea3-953a-27867bd4876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:18.077734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7dd0b633-b64c-4ea3-953a-27867bd4876b None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:14:18.079012 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7dd0b633-b64c-4ea3-953a-27867bd4876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:14:18.140582 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1250/2485] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:14:18.148716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679b534-4720-43a9-8810-060caec3fac3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:18.149007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679b534-4720-43a9-8810-060caec3fac3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:18.149432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679b534-4720-43a9-8810-060caec3fac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:18.170156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e679b534-4720-43a9-8810-060caec3fac3 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:14:18.171421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e679b534-4720-43a9-8810-060caec3fac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:14:18.179893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1236/2486] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:14:18.184915 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0b633-b64c-4ea3-953a-27867bd4876b None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:14:18.194646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0b633-b64c-4ea3-953a-27867bd4876b None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:14:18.199276 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f428f4-47fe-45ea-bcef-6a9f272e2291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:14:18.199882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f428f4-47fe-45ea-bcef-6a9f272e2291 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:18.200156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f428f4-47fe-45ea-bcef-6a9f272e2291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:18.200423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f428f4-47fe-45ea-bcef-6a9f272e2291 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:18.201066 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f428f4-47fe-45ea-bcef-6a9f272e2291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:14:18.201366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f428f4-47fe-45ea-bcef-6a9f272e2291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:14:18.202971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f428f4-47fe-45ea-bcef-6a9f272e2291 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:14:18.204605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:18.217428 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1251/2487] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 21:14:18.221828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679b534-4720-43a9-8810-060caec3fac3 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:14:18.232588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679b534-4720-43a9-8810-060caec3fac3 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:14:18.237284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffa92a-11d2-4a3b-bf4c-41a2ae700c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:14:18.237886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffa92a-11d2-4a3b-bf4c-41a2ae700c2a admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:18.238171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffa92a-11d2-4a3b-bf4c-41a2ae700c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:18.238445 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffa92a-11d2-4a3b-bf4c-41a2ae700c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:18.239126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffa92a-11d2-4a3b-bf4c-41a2ae700c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:14:18.241012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffa92a-11d2-4a3b-bf4c-41a2ae700c2a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:14:18.272180 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1237/2488] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:14:18 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:14:18.273457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f428f4-47fe-45ea-bcef-6a9f272e2291 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:14:18.284314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f428f4-47fe-45ea-bcef-6a9f272e2291 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:14:18.341876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0432cd0-d36d-4792-b703-a2b0409e6992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:14:18.342408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0432cd0-d36d-4792-b703-a2b0409e6992 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:18.342693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0432cd0-d36d-4792-b703-a2b0409e6992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:18.343005 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0432cd0-d36d-4792-b703-a2b0409e6992 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:18.343641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0432cd0-d36d-4792-b703-a2b0409e6992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:14:18.345553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0432cd0-d36d-4792-b703-a2b0409e6992 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:14:18.370604 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1252/2489] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:14:18 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:14:18.374786 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffa92a-11d2-4a3b-bf4c-41a2ae700c2a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:14:18.386057 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffa92a-11d2-4a3b-bf4c-41a2ae700c2a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:14:18.390833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b125fa-f684-4349-9c7e-65d763ca41ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:14:18.391442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b125fa-f684-4349-9c7e-65d763ca41ea admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:18.391728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b125fa-f684-4349-9c7e-65d763ca41ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:18.392034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b125fa-f684-4349-9c7e-65d763ca41ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:18.392684 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b125fa-f684-4349-9c7e-65d763ca41ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:14:18.394305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b125fa-f684-4349-9c7e-65d763ca41ea admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:14:18.405371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1238/2490] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:14:18.409674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0432cd0-d36d-4792-b703-a2b0409e6992 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:14:18.420068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0432cd0-d36d-4792-b703-a2b0409e6992 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:14:18.424936 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56eab2-992f-498a-8ffe-29386a53f8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:14:18.425678 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56eab2-992f-498a-8ffe-29386a53f8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:18.425833 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56eab2-992f-498a-8ffe-29386a53f8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:18.426108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56eab2-992f-498a-8ffe-29386a53f8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:18.426799 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56eab2-992f-498a-8ffe-29386a53f8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:14:18.428418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56eab2-992f-498a-8ffe-29386a53f8f1 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:14:18.441368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1253/2491] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:14:18.445646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b125fa-f684-4349-9c7e-65d763ca41ea admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:14:18.463462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b125fa-f684-4349-9c7e-65d763ca41ea admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:14:18.469375 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197be2c-9798-4cab-9c90-f0044212ab5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:14:18.470056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197be2c-9798-4cab-9c90-f0044212ab5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:18.470338 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197be2c-9798-4cab-9c90-f0044212ab5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:18.470622 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197be2c-9798-4cab-9c90-f0044212ab5c admin admin] PATH_INFO: `/v3/projects/f611baf8f2274fe6a3444eb8aad41b47/users/a6e838dfd7a64de5b1e95f8276bcdca0/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:18.488458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197be2c-9798-4cab-9c90-f0044212ab5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f611baf8f2274fe6a3444eb8aad41b47, user_id=a6e838dfd7a64de5b1e95f8276bcdca0, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:14:18.491215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197be2c-9798-4cab-9c90-f0044212ab5c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:14:18.507189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1239/2492] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:14:18 2022] PUT /identity/v3/projects/f611baf8f2274fe6a3444eb8aad41b47/users/a6e838dfd7a64de5b1e95f8276bcdca0/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:14:18.512907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14758c2-c84e-4843-9bf8-cbc38baf7b31 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:18.513187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14758c2-c84e-4843-9bf8-cbc38baf7b31 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:18.513459 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14758c2-c84e-4843-9bf8-cbc38baf7b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:18.534617 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-b14758c2-c84e-4843-9bf8-cbc38baf7b31 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:14:18.536088 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b14758c2-c84e-4843-9bf8-cbc38baf7b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:14:18.599398 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1254/2493] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:14:18.610751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197be2c-9798-4cab-9c90-f0044212ab5c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:14:18.612651 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5197be2c-9798-4cab-9c90-f0044212ab5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:14:18.628739 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:18.675606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197be2c-9798-4cab-9c90-f0044212ab5c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:14:18.679230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b18bc-5a37-4405-af72-ddc9a78529a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:14:18.679852 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b18bc-5a37-4405-af72-ddc9a78529a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:18.680137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b18bc-5a37-4405-af72-ddc9a78529a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:18.680412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b18bc-5a37-4405-af72-ddc9a78529a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:18.690946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b18bc-5a37-4405-af72-ddc9a78529a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:14:18.692385 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b18bc-5a37-4405-af72-ddc9a78529a2 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:14:18.702347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1240/2494] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:14:23.045592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781b39-2544-4c92-8282-a95a9182b5e6 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:23.046162 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781b39-2544-4c92-8282-a95a9182b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:23.046162 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781b39-2544-4c92-8282-a95a9182b5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:23.078118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e8781b39-2544-4c92-8282-a95a9182b5e6 None None] MFA Rules not processed for user `a6e838dfd7a64de5b1e95f8276bcdca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:14:23.079391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e8781b39-2544-4c92-8282-a95a9182b5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:14:23.150760 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1255/2495] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:14:23.166887 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b18bc-5a37-4405-af72-ddc9a78529a2 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:14:23.168326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7e7b18bc-5a37-4405-af72-ddc9a78529a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:14:23.272108 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b18bc-5a37-4405-af72-ddc9a78529a2 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:14:23.281856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89063a45-d17b-468c-a389-b194fe682101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:14:23.282417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063a45-d17b-468c-a389-b194fe682101 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:23.282702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063a45-d17b-468c-a389-b194fe682101 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:23.283015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063a45-d17b-468c-a389-b194fe682101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:23.293456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89063a45-d17b-468c-a389-b194fe682101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:14:23.295123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89063a45-d17b-468c-a389-b194fe682101 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:14:23.305259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1241/2496] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:14:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:14:24.630636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d6418-2b05-469e-ac4b-ff7dab88d426 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:14:24.631634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d6418-2b05-469e-ac4b-ff7dab88d426 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:14:24.631924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d6418-2b05-469e-ac4b-ff7dab88d426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:14:24.639885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:24.656583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-7b6d6418-2b05-469e-ac4b-ff7dab88d426 None None] MFA Rules not processed for user `a6e838dfd7a64de5b1e95f8276bcdca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:14:24.658180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7b6d6418-2b05-469e-ac4b-ff7dab88d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:14:24.666163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1256/2497] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:14:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:14:33.300916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=54 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:34.655341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:03.339860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ef869-0495-4d53-89f1-a5ac57684f67 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:03.340575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ef869-0495-4d53-89f1-a5ac57684f67 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:03.340575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ef869-0495-4d53-89f1-a5ac57684f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:03.363036 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9c4ef869-0495-4d53-89f1-a5ac57684f67 None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:15:03.364379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9c4ef869-0495-4d53-89f1-a5ac57684f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:03.429089 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1242/2498] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:15:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:15:03.472999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d6418-2b05-469e-ac4b-ff7dab88d426 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:03.474461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7b6d6418-2b05-469e-ac4b-ff7dab88d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:03.566090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d6418-2b05-469e-ac4b-ff7dab88d426 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:03.571967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d349c8-3cf8-4314-8e44-0104da22fd96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:03.573391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d349c8-3cf8-4314-8e44-0104da22fd96 service swift] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:03.573815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d349c8-3cf8-4314-8e44-0104da22fd96 service swift] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:03.573989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d349c8-3cf8-4314-8e44-0104da22fd96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:03.583364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d349c8-3cf8-4314-8e44-0104da22fd96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:03.584930 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d349c8-3cf8-4314-8e44-0104da22fd96 service swift] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:03.594882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1257/2499] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 21:15:11.751561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ef869-0495-4d53-89f1-a5ac57684f67 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:11.773103 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ef869-0495-4d53-89f1-a5ac57684f67 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:11.779609 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5c345-b8c7-4f4b-8e56-dd35bbfc93c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:11.781030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c345-b8c7-4f4b-8e56-dd35bbfc93c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:11.781517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c345-b8c7-4f4b-8e56-dd35bbfc93c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:11.781975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c345-b8c7-4f4b-8e56-dd35bbfc93c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:11.785232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d1c5c345-b8c7-4f4b-8e56-dd35bbfc93c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:11.907954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5c345-b8c7-4f4b-8e56-dd35bbfc93c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:11.909421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5c345-b8c7-4f4b-8e56-dd35bbfc93c3 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:11.926329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1243/2500] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:15:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:15:13.591647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=32 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:19.967502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467156c-5b45-4bf8-b2cc-8be344cf6392 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:19.968112 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467156c-5b45-4bf8-b2cc-8be344cf6392 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:19.969820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467156c-5b45-4bf8-b2cc-8be344cf6392 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:19.974317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1258/2501] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 21:15:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:15:19.993485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414e21-c708-4f42-afc1-0e80ab734b61 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:19.994768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414e21-c708-4f42-afc1-0e80ab734b61 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:19.995714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414e21-c708-4f42-afc1-0e80ab734b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:20.029134 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467156c-5b45-4bf8-b2cc-8be344cf6392 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:20.067658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467156c-5b45-4bf8-b2cc-8be344cf6392 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:20.072027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532f2a7-13ff-4180-abbe-f5c15f55dcaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:20.072914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f2a7-13ff-4180-abbe-f5c15f55dcaa service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:20.073198 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f2a7-13ff-4180-abbe-f5c15f55dcaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:20.073477 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f2a7-13ff-4180-abbe-f5c15f55dcaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:20.075357 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6532f2a7-13ff-4180-abbe-f5c15f55dcaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:20.111408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d5414e21-c708-4f42-afc1-0e80ab734b61 None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:15:20.112865 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d5414e21-c708-4f42-afc1-0e80ab734b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:20.152413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532f2a7-13ff-4180-abbe-f5c15f55dcaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:20.154547 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532f2a7-13ff-4180-abbe-f5c15f55dcaa service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:20.166589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1244/2502] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 21:15:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:15:20.179673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5414e21-c708-4f42-afc1-0e80ab734b61 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:20.181309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d5414e21-c708-4f42-afc1-0e80ab734b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:20.183783 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1259/2503] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:15:20.224164 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:20.247563 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5414e21-c708-4f42-afc1-0e80ab734b61 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:20.253359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb5a10-477e-47bf-9ea7-ed37a8903f7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b105e7094aea9dcc7423d6205c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:20.253991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb5a10-477e-47bf-9ea7-ed37a8903f7a service glance] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:20.254276 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb5a10-477e-47bf-9ea7-ed37a8903f7a service glance] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:20.254554 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb5a10-477e-47bf-9ea7-ed37a8903f7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:20.266662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb5a10-477e-47bf-9ea7-ed37a8903f7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:20.270314 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb5a10-477e-47bf-9ea7-ed37a8903f7a service glance] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:20.282656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1245/2504] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:15:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:15:20.358627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725577d-2f3e-478a-a3df-40aebdb36cb5 None None] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:20.358951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725577d-2f3e-478a-a3df-40aebdb36cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:20.359233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725577d-2f3e-478a-a3df-40aebdb36cb5 None None] PATH_INFO: `/` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:20.360577 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1260/2505] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 21:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:15:20.365198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2d22d-8bab-4ad1-b4a9-4121e7da7442 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:20.365601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2d22d-8bab-4ad1-b4a9-4121e7da7442 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:20.365950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2d22d-8bab-4ad1-b4a9-4121e7da7442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:20.386953 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1fd2d22d-8bab-4ad1-b4a9-4121e7da7442 None None] MFA Rules not processed for user `95b17424a40b475480403eb9f4f3f88f`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:15:20.388210 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1fd2d22d-8bab-4ad1-b4a9-4121e7da7442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:20.395132 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1246/2506] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:15:20.407671 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725577d-2f3e-478a-a3df-40aebdb36cb5 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:20.409371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9725577d-2f3e-478a-a3df-40aebdb36cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:20.423657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725577d-2f3e-478a-a3df-40aebdb36cb5 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:20.427759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c370a-8b82-4887-b659-45586477402d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:20.428365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c370a-8b82-4887-b659-45586477402d service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:20.428651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c370a-8b82-4887-b659-45586477402d service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:20.428925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c370a-8b82-4887-b659-45586477402d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:20.436903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c370a-8b82-4887-b659-45586477402d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:20.438327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c370a-8b82-4887-b659-45586477402d service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:20.448406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1261/2507] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:15:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:15:20.536151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226d204-1fe3-4731-a536-8e03ce4ef653 None None] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:20.536446 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226d204-1fe3-4731-a536-8e03ce4ef653 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:20.536784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226d204-1fe3-4731-a536-8e03ce4ef653 None None] PATH_INFO: `/` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:20.538239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1247/2508] 10.222.0.17 () {54 vars in 921 bytes} [Fri Aug 19 21:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 21:15:20.544808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba92e-9e4c-435e-b526-b3bfbfe70fe3 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:20.545102 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba92e-9e4c-435e-b526-b3bfbfe70fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:20.545381 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba92e-9e4c-435e-b526-b3bfbfe70fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:20.565058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-edfba92e-9e4c-435e-b526-b3bfbfe70fe3 None None] MFA Rules not processed for user `83e51beb8d0e4219af906860ce906500`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:15:20.566258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-edfba92e-9e4c-435e-b526-b3bfbfe70fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:20.575873 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1262/2509] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Aug 19 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:15:20.586434 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226d204-1fe3-4731-a536-8e03ce4ef653 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:20.598185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226d204-1fe3-4731-a536-8e03ce4ef653 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:20.601789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d82b78-eb3e-492d-8c9d-6805b5679ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:20.602391 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d82b78-eb3e-492d-8c9d-6805b5679ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:20.602677 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d82b78-eb3e-492d-8c9d-6805b5679ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:20.603691 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d82b78-eb3e-492d-8c9d-6805b5679ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:20.614797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d82b78-eb3e-492d-8c9d-6805b5679ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:20.616304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d82b78-eb3e-492d-8c9d-6805b5679ba4 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:20.629048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1248/2510] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:15:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:15:22.827002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbd2a2-b5c9-463d-970e-281a32f69afe None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:22.827869 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbd2a2-b5c9-463d-970e-281a32f69afe None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:22.828341 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbd2a2-b5c9-463d-970e-281a32f69afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:22.849093 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-5cdbd2a2-b5c9-463d-970e-281a32f69afe None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:15:22.850330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5cdbd2a2-b5c9-463d-970e-281a32f69afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:22.860510 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1263/2511] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Aug 19 21:15:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:15:22.876230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d82b78-eb3e-492d-8c9d-6805b5679ba4 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:22.890840 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d82b78-eb3e-492d-8c9d-6805b5679ba4 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:22.897573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fe16c-ecc6-409e-99a1-ab72574e205a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:22.898205 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe16c-ecc6-409e-99a1-ab72574e205a service swift] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:22.898470 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe16c-ecc6-409e-99a1-ab72574e205a service swift] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:22.898931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe16c-ecc6-409e-99a1-ab72574e205a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:22.915224 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fe16c-ecc6-409e-99a1-ab72574e205a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:22.918169 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fe16c-ecc6-409e-99a1-ab72574e205a service swift] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:22.933654 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1249/2512] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:15:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 21:15:28.694572 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbd2a2-b5c9-463d-970e-281a32f69afe None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:28.696574 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5cdbd2a2-b5c9-463d-970e-281a32f69afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:28.727335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbd2a2-b5c9-463d-970e-281a32f69afe None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:28.767220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:28.767892 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:28.768371 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:28.768818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] PATH_INFO: `/v3/users/9a2db0e2828a430f88c7a0484445a2c5` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:28.770301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2db0e2828a430f88c7a0484445a2c5)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:28.772761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:28.833710 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2db0e2828a430f88c7a0484445a2c5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:28.843250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2db0e2828a430f88c7a0484445a2c5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:28.844149 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2db0e2828a430f88c7a0484445a2c5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:28.844857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2db0e2828a430f88c7a0484445a2c5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:28.859657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2db0e2828a430f88c7a0484445a2c5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:28.873831 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1264/2513] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:15:28 2022] DELETE /identity/v3/users/9a2db0e2828a430f88c7a0484445a2c5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:15:29.079865 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fe16c-ecc6-409e-99a1-ab72574e205a service swift] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:29.091913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fe16c-ecc6-409e-99a1-ab72574e205a service swift] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:29.165833 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:29.167002 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:29.167002 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:29.167196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] PATH_INFO: `/v3/projects/e18489ff54444af58371036af6593900` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:29.168206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18489ff54444af58371036af6593900)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:29.170326 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:29.234325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18489ff54444af58371036af6593900', 'request_id': 'req-7004a932-e194-4a6d-90f6-c4a43f38893d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:29.246270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18489ff54444af58371036af6593900', 'request_id': 'req-7004a932-e194-4a6d-90f6-c4a43f38893d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:29.257762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18489ff54444af58371036af6593900', 'request_id': 'req-7004a932-e194-4a6d-90f6-c4a43f38893d'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:29.270595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] The token cache is being invalidate because project e18489ff54444af58371036af6593900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:15:29.270937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:29.271585 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:29.273104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1250/2514] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:15:29 2022] DELETE /identity/v3/projects/e18489ff54444af58371036af6593900 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:15:29.277653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:29.283633 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:29.301999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0826b3-c0d4-4699-bb32-4766d532c438 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:29.343071 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:29.396203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:29.396872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:29.397137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:29.397416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] PATH_INFO: `/v3/users/645dd2f8967f499d9c25c6da248df0a2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:29.398905 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=645dd2f8967f499d9c25c6da248df0a2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:29.402263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:29.481465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645dd2f8967f499d9c25c6da248df0a2'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:29.492765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645dd2f8967f499d9c25c6da248df0a2'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:29.493586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645dd2f8967f499d9c25c6da248df0a2'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:29.494438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645dd2f8967f499d9c25c6da248df0a2'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:29.511760 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645dd2f8967f499d9c25c6da248df0a2'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:29.532682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1265/2515] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:15:29 2022] DELETE /identity/v3/users/645dd2f8967f499d9c25c6da248df0a2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:15:29.786670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:29.789419 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:29.815608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004a932-e194-4a6d-90f6-c4a43f38893d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:29.862972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:29.895987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d151058-03ca-4c49-b63a-d9746ff325f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:29.896706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d151058-03ca-4c49-b63a-d9746ff325f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:29.897090 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d151058-03ca-4c49-b63a-d9746ff325f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:29.897355 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d151058-03ca-4c49-b63a-d9746ff325f5 admin admin] PATH_INFO: `/v3/projects/0007731c013e4c2387397fad7d900894` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:29.898721 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d151058-03ca-4c49-b63a-d9746ff325f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0007731c013e4c2387397fad7d900894)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:29.901710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d151058-03ca-4c49-b63a-d9746ff325f5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:29.978557 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7d151058-03ca-4c49-b63a-d9746ff325f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0007731c013e4c2387397fad7d900894', 'request_id': 'req-7d151058-03ca-4c49-b63a-d9746ff325f5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:29.986389 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7d151058-03ca-4c49-b63a-d9746ff325f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0007731c013e4c2387397fad7d900894', 'request_id': 'req-7d151058-03ca-4c49-b63a-d9746ff325f5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:29.995929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7d151058-03ca-4c49-b63a-d9746ff325f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0007731c013e4c2387397fad7d900894', 'request_id': 'req-7d151058-03ca-4c49-b63a-d9746ff325f5'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:30.011165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7d151058-03ca-4c49-b63a-d9746ff325f5 admin admin] The token cache is being invalidate because project 0007731c013e4c2387397fad7d900894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:15:30.011616 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7d151058-03ca-4c49-b63a-d9746ff325f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:30.012156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-7d151058-03ca-4c49-b63a-d9746ff325f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:15:30.013996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1251/2516] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:15:29 2022] DELETE /identity/v3/projects/0007731c013e4c2387397fad7d900894 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:15:39.523137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:40.006241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:40.175236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:40.179599 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:40.388021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8363e7-b9e7-4739-a847-4e6a562c2262 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:40.542873 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23fd7f-1a61-4dfc-9eca-2829dcd8f697 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:40.544280 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23fd7f-1a61-4dfc-9eca-2829dcd8f697 service placement] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:40.544904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23fd7f-1a61-4dfc-9eca-2829dcd8f697 service placement] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:40.545502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23fd7f-1a61-4dfc-9eca-2829dcd8f697 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:40.554389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3d23fd7f-1a61-4dfc-9eca-2829dcd8f697 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:40.604602 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23fd7f-1a61-4dfc-9eca-2829dcd8f697 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:40.612639 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23fd7f-1a61-4dfc-9eca-2829dcd8f697 service placement] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:40.669705 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1266/2517] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:15:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:15:46.233744 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb95dfe-ef23-46c4-bd7b-51c99052fd94 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:46.235318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb95dfe-ef23-46c4-bd7b-51c99052fd94 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:46.236465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb95dfe-ef23-46c4-bd7b-51c99052fd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:46.272053 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5bb95dfe-ef23-46c4-bd7b-51c99052fd94 None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:15:46.273719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5bb95dfe-ef23-46c4-bd7b-51c99052fd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:46.353630 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1252/2518] 10.222.0.17 () {58 vars in 967 bytes} [Fri Aug 19 21:15:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:15:46.362753 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23fd7f-1a61-4dfc-9eca-2829dcd8f697 service placement] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:46.364207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3d23fd7f-1a61-4dfc-9eca-2829dcd8f697 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:46.463505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23fd7f-1a61-4dfc-9eca-2829dcd8f697 service placement] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:46.471394 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc0063-d433-4183-b0fd-dedd44ebc217 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:46.472201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc0063-d433-4183-b0fd-dedd44ebc217 service swift] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:46.473384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc0063-d433-4183-b0fd-dedd44ebc217 service swift] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:46.473384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc0063-d433-4183-b0fd-dedd44ebc217 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:46.487637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc0063-d433-4183-b0fd-dedd44ebc217 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:46.490475 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc0063-d433-4183-b0fd-dedd44ebc217 service swift] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:46.506207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1267/2519] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:15:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 21:15:52.389097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694cdf3-351b-46c1-b6ee-a55abaf6cf15 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:52.389854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694cdf3-351b-46c1-b6ee-a55abaf6cf15 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:52.389854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694cdf3-351b-46c1-b6ee-a55abaf6cf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:52.410493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6694cdf3-351b-46c1-b6ee-a55abaf6cf15 None None] MFA Rules not processed for user `b9f8b86c01084a09bb8eac50eddfa0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:15:52.411763 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6694cdf3-351b-46c1-b6ee-a55abaf6cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:15:52.419848 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1253/2520] 10.222.0.17 () {58 vars in 967 bytes} [Fri Aug 19 21:15:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:15:52.435327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc0063-d433-4183-b0fd-dedd44ebc217 service swift] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:15:52.442933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:52.454610 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc0063-d433-4183-b0fd-dedd44ebc217 service swift] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:15:52.464636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161658e-41d6-4d1e-80d0-04f52975c7e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbfc93e45704b3ba2e5a4bcf7568a14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:15:52.465790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161658e-41d6-4d1e-80d0-04f52975c7e9 service swift] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:15:52.466352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161658e-41d6-4d1e-80d0-04f52975c7e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:15:52.466993 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161658e-41d6-4d1e-80d0-04f52975c7e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:15:52.484327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161658e-41d6-4d1e-80d0-04f52975c7e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:15:52.486142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161658e-41d6-4d1e-80d0-04f52975c7e9 service swift] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:15:52.496450 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1268/2521] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Aug 19 21:15:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 21:16:01.176260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694cdf3-351b-46c1-b6ee-a55abaf6cf15 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:01.178080 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6694cdf3-351b-46c1-b6ee-a55abaf6cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:01.201503 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694cdf3-351b-46c1-b6ee-a55abaf6cf15 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:01.207135 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570196c3-1d5f-4e2d-a7fb-2e4dd56d233d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:01.208050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570196c3-1d5f-4e2d-a7fb-2e4dd56d233d service placement] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:01.208500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570196c3-1d5f-4e2d-a7fb-2e4dd56d233d service placement] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:01.209264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570196c3-1d5f-4e2d-a7fb-2e4dd56d233d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:01.212789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-570196c3-1d5f-4e2d-a7fb-2e4dd56d233d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:01.230595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570196c3-1d5f-4e2d-a7fb-2e4dd56d233d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:01.247592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570196c3-1d5f-4e2d-a7fb-2e4dd56d233d service placement] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:01.259774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1254/2522] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:16:01.291879 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161658e-41d6-4d1e-80d0-04f52975c7e9 service swift] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:01.294279 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5161658e-41d6-4d1e-80d0-04f52975c7e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:01.396441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161658e-41d6-4d1e-80d0-04f52975c7e9 service swift] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:01.401320 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:01.401963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:01.402249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:01.402528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] PATH_INFO: `/v3/users/063488d3edc442a5b9d76e4fc2e451ec` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:01.403937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] RBAC: Authorizing `identity:delete_user(user_id=063488d3edc442a5b9d76e4fc2e451ec)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:01.405883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:01.472049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063488d3edc442a5b9d76e4fc2e451ec'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:01.481314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063488d3edc442a5b9d76e4fc2e451ec'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:01.481998 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063488d3edc442a5b9d76e4fc2e451ec'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:01.482954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063488d3edc442a5b9d76e4fc2e451ec'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:01.502317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063488d3edc442a5b9d76e4fc2e451ec'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:01.519855 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1269/2523] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:16:01 2022] DELETE /identity/v3/users/063488d3edc442a5b9d76e4fc2e451ec => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:01.744029 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570196c3-1d5f-4e2d-a7fb-2e4dd56d233d service placement] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:01.759700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570196c3-1d5f-4e2d-a7fb-2e4dd56d233d service placement] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:01.833103 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:01.833815 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:01.834102 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:01.834383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] PATH_INFO: `/v3/projects/76142efc6162448cb30a3f646a4c3065` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:01.835630 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76142efc6162448cb30a3f646a4c3065)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:01.838237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:01.894163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76142efc6162448cb30a3f646a4c3065', 'request_id': 'req-33792d31-cb2c-4c5e-8853-3df96e72b905'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:01.900724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76142efc6162448cb30a3f646a4c3065', 'request_id': 'req-33792d31-cb2c-4c5e-8853-3df96e72b905'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:01.909939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76142efc6162448cb30a3f646a4c3065', 'request_id': 'req-33792d31-cb2c-4c5e-8853-3df96e72b905'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:01.923369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] The token cache is being invalidate because project 76142efc6162448cb30a3f646a4c3065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:16:01.923643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:01.924321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:01.925914 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1255/2524] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:16:01 2022] DELETE /identity/v3/projects/76142efc6162448cb30a3f646a4c3065 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:01.930096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:01.933483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:01.947278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca7a43-887f-41c4-b789-08e4c3d3242f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:02.013080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:02.013750 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:02.014030 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:02.014302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] PATH_INFO: `/v3/users/30f8e22dbc3a44cfb67e446284a486bf` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:02.015642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f8e22dbc3a44cfb67e446284a486bf)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:02.017630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:02.033027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:02.071802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f8e22dbc3a44cfb67e446284a486bf'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:02.079968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f8e22dbc3a44cfb67e446284a486bf'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:02.080903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f8e22dbc3a44cfb67e446284a486bf'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:02.081625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f8e22dbc3a44cfb67e446284a486bf'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:02.096894 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f8e22dbc3a44cfb67e446284a486bf'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:02.111221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1270/2525] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:16:01 2022] DELETE /identity/v3/users/30f8e22dbc3a44cfb67e446284a486bf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:02.315579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:02.317251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:02.335876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792d31-cb2c-4c5e-8853-3df96e72b905 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:02.351295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:02.412652 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:02.413228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:02.413514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:02.413798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] PATH_INFO: `/v3/projects/f7ea822f602d4052b58f83805fa22e7a` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:02.415706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ea822f602d4052b58f83805fa22e7a)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:02.417759 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:02.472358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ea822f602d4052b58f83805fa22e7a', 'request_id': 'req-13b97e73-f81a-4491-99e2-ec7f5c37e783'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:02.479024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ea822f602d4052b58f83805fa22e7a', 'request_id': 'req-13b97e73-f81a-4491-99e2-ec7f5c37e783'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:02.488807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ea822f602d4052b58f83805fa22e7a', 'request_id': 'req-13b97e73-f81a-4491-99e2-ec7f5c37e783'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:02.516231 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] The token cache is being invalidate because project f7ea822f602d4052b58f83805fa22e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:16:02.516514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:02.517285 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:02.519192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1256/2526] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:16:02 2022] DELETE /identity/v3/projects/f7ea822f602d4052b58f83805fa22e7a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:05.143361 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:05.144871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:05.228354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22424af3-2eb5-42cf-b17e-8501d040ab89 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:05.279214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d68b3c-bfa4-47e9-9537-560527610732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:05.279838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68b3c-bfa4-47e9-9537-560527610732 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:05.280119 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68b3c-bfa4-47e9-9537-560527610732 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:05.280394 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68b3c-bfa4-47e9-9537-560527610732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:05.282402 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-14d68b3c-bfa4-47e9-9537-560527610732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:05.322976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:05.349566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d68b3c-bfa4-47e9-9537-560527610732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:05.351038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d68b3c-bfa4-47e9-9537-560527610732 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:05.361196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1271/2527] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:16:08.505643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:08.507636 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:08.523344 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b97e73-f81a-4491-99e2-ec7f5c37e783 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:08.528583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c57da2-80db-4426-b708-5e47fe43bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:08.529222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c57da2-80db-4426-b708-5e47fe43bd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:08.529501 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c57da2-80db-4426-b708-5e47fe43bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:08.529772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c57da2-80db-4426-b708-5e47fe43bd66 admin admin] PATH_INFO: `/v3/users/8b4a6b0dc41d446f8c46bd5097f6b254` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:08.530943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c57da2-80db-4426-b708-5e47fe43bd66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b4a6b0dc41d446f8c46bd5097f6b254)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:08.533162 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c57da2-80db-4426-b708-5e47fe43bd66 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:08.585395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-05c57da2-80db-4426-b708-5e47fe43bd66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b4a6b0dc41d446f8c46bd5097f6b254'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:08.604317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-05c57da2-80db-4426-b708-5e47fe43bd66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b4a6b0dc41d446f8c46bd5097f6b254'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:08.613079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-05c57da2-80db-4426-b708-5e47fe43bd66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b4a6b0dc41d446f8c46bd5097f6b254'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:08.613788 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-05c57da2-80db-4426-b708-5e47fe43bd66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b4a6b0dc41d446f8c46bd5097f6b254'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:08.614546 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-05c57da2-80db-4426-b708-5e47fe43bd66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b4a6b0dc41d446f8c46bd5097f6b254'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:08.628397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1257/2528] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:16:08 2022] DELETE /identity/v3/users/8b4a6b0dc41d446f8c46bd5097f6b254 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:08.815312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d68b3c-bfa4-47e9-9537-560527610732 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:08.826300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d68b3c-bfa4-47e9-9537-560527610732 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:08.892249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5921188-7ee8-48d3-b4fc-36c425413d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:08.892890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5921188-7ee8-48d3-b4fc-36c425413d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:08.893250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5921188-7ee8-48d3-b4fc-36c425413d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:08.893455 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5921188-7ee8-48d3-b4fc-36c425413d16 admin admin] PATH_INFO: `/v3/projects/df4003b6d7db450ca87311cbf6598fac` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:08.894601 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5921188-7ee8-48d3-b4fc-36c425413d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4003b6d7db450ca87311cbf6598fac)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:08.896541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5921188-7ee8-48d3-b4fc-36c425413d16 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:08.949625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c5921188-7ee8-48d3-b4fc-36c425413d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4003b6d7db450ca87311cbf6598fac', 'request_id': 'req-c5921188-7ee8-48d3-b4fc-36c425413d16'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:08.957931 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c5921188-7ee8-48d3-b4fc-36c425413d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4003b6d7db450ca87311cbf6598fac', 'request_id': 'req-c5921188-7ee8-48d3-b4fc-36c425413d16'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:08.965860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c5921188-7ee8-48d3-b4fc-36c425413d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4003b6d7db450ca87311cbf6598fac', 'request_id': 'req-c5921188-7ee8-48d3-b4fc-36c425413d16'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:08.976175 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c5921188-7ee8-48d3-b4fc-36c425413d16 admin admin] The token cache is being invalidate because project df4003b6d7db450ca87311cbf6598fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:16:08.976436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c5921188-7ee8-48d3-b4fc-36c425413d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:08.977079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c5921188-7ee8-48d3-b4fc-36c425413d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:08.978780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1272/2529] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:16:08 2022] DELETE /identity/v3/projects/df4003b6d7db450ca87311cbf6598fac => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:08.983696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0ce6e-4d8b-432e-8712-49663d9db514 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:08.983984 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0ce6e-4d8b-432e-8712-49663d9db514 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:08.984260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0ce6e-4d8b-432e-8712-49663d9db514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.014030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:09.035991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-0be0ce6e-4d8b-432e-8712-49663d9db514 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:09.037248 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0be0ce6e-4d8b-432e-8712-49663d9db514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:09.096329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1258/2530] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:09.104457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d702eff-a6b3-40fb-8a26-50efaee9d06f None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.104752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d702eff-a6b3-40fb-8a26-50efaee9d06f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.105042 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d702eff-a6b3-40fb-8a26-50efaee9d06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.125835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-2d702eff-a6b3-40fb-8a26-50efaee9d06f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:09.127095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2d702eff-a6b3-40fb-8a26-50efaee9d06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:09.136613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1273/2531] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:16:09.141031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0ce6e-4d8b-432e-8712-49663d9db514 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:09.151874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0ce6e-4d8b-432e-8712-49663d9db514 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:09.157850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec2667-bfe3-4b2e-a43c-eafbd6e68480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:09.158462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec2667-bfe3-4b2e-a43c-eafbd6e68480 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.158758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec2667-bfe3-4b2e-a43c-eafbd6e68480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.159060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec2667-bfe3-4b2e-a43c-eafbd6e68480 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.159718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec2667-bfe3-4b2e-a43c-eafbd6e68480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:16:09.160026 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec2667-bfe3-4b2e-a43c-eafbd6e68480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:09.161634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec2667-bfe3-4b2e-a43c-eafbd6e68480 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:09.173488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1259/2532] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:16:09.177846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d702eff-a6b3-40fb-8a26-50efaee9d06f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:09.187795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d702eff-a6b3-40fb-8a26-50efaee9d06f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:09.192443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b6fff-c2ef-4d73-9975-d9e4f44c112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:09.193043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b6fff-c2ef-4d73-9975-d9e4f44c112b admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.193328 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b6fff-c2ef-4d73-9975-d9e4f44c112b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.193605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b6fff-c2ef-4d73-9975-d9e4f44c112b admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.194245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b6fff-c2ef-4d73-9975-d9e4f44c112b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:09.196869 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b6fff-c2ef-4d73-9975-d9e4f44c112b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:09.223659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1274/2533] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:16:09 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:16:09.228216 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec2667-bfe3-4b2e-a43c-eafbd6e68480 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:09.238590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec2667-bfe3-4b2e-a43c-eafbd6e68480 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:09.308286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72102e7-d375-4142-80f5-9f9db89e83a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:09.308905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72102e7-d375-4142-80f5-9f9db89e83a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.309190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72102e7-d375-4142-80f5-9f9db89e83a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.309468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72102e7-d375-4142-80f5-9f9db89e83a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.310101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72102e7-d375-4142-80f5-9f9db89e83a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:09.312041 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72102e7-d375-4142-80f5-9f9db89e83a5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:09.333403 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1260/2534] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:16:09 2022] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:16:09.337891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b6fff-c2ef-4d73-9975-d9e4f44c112b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:09.348164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b6fff-c2ef-4d73-9975-d9e4f44c112b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:09.352779 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45818682-b79e-4d44-9358-1f099553e0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:09.353379 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45818682-b79e-4d44-9358-1f099553e0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.353657 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45818682-b79e-4d44-9358-1f099553e0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.353933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45818682-b79e-4d44-9358-1f099553e0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.355231 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45818682-b79e-4d44-9358-1f099553e0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:09.356952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45818682-b79e-4d44-9358-1f099553e0e5 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:09.367077 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1275/2535] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:09.371870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72102e7-d375-4142-80f5-9f9db89e83a5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:09.382251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72102e7-d375-4142-80f5-9f9db89e83a5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:09.387323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e663e7f-ddc8-4535-84f1-b8006edc4c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:09.387950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e663e7f-ddc8-4535-84f1-b8006edc4c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.388237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e663e7f-ddc8-4535-84f1-b8006edc4c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.388519 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e663e7f-ddc8-4535-84f1-b8006edc4c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.389167 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e663e7f-ddc8-4535-84f1-b8006edc4c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:09.390929 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e663e7f-ddc8-4535-84f1-b8006edc4c1e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:09.401811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1261/2536] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:09.406723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45818682-b79e-4d44-9358-1f099553e0e5 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:09.417449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45818682-b79e-4d44-9358-1f099553e0e5 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:09.422631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806d84d-e1ac-483c-b212-87277225c34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:09.423385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806d84d-e1ac-483c-b212-87277225c34b admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.423661 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806d84d-e1ac-483c-b212-87277225c34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.423909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806d84d-e1ac-483c-b212-87277225c34b admin admin] PATH_INFO: `/v3/projects/7cbaae231b074db6837a3b7e5814238b/users/942fe26b995141bf9188d33b70f8ffa6/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.440839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806d84d-e1ac-483c-b212-87277225c34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cbaae231b074db6837a3b7e5814238b, user_id=942fe26b995141bf9188d33b70f8ffa6, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:09.443564 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806d84d-e1ac-483c-b212-87277225c34b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:09.452250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:09.457693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1276/2537] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:09 2022] PUT /identity/v3/projects/7cbaae231b074db6837a3b7e5814238b/users/942fe26b995141bf9188d33b70f8ffa6/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:09.469392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274f198-4a3e-4216-a211-a180d5d8e392 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.469675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274f198-4a3e-4216-a211-a180d5d8e392 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.469949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274f198-4a3e-4216-a211-a180d5d8e392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.500145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5274f198-4a3e-4216-a211-a180d5d8e392 None None] MFA Rules not processed for user `942fe26b995141bf9188d33b70f8ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:09.501599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5274f198-4a3e-4216-a211-a180d5d8e392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:09.554977 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:09.575646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1262/2538] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:09.580949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806d84d-e1ac-483c-b212-87277225c34b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:09.647257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806d84d-e1ac-483c-b212-87277225c34b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:09.652895 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe3f88-9869-44c8-9221-60ca235dafba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:09.653503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe3f88-9869-44c8-9221-60ca235dafba admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.653818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe3f88-9869-44c8-9221-60ca235dafba admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.654095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe3f88-9869-44c8-9221-60ca235dafba admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.654850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe3f88-9869-44c8-9221-60ca235dafba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:09.657551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe3f88-9869-44c8-9221-60ca235dafba admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:09.685246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1277/2539] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:16:09 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:09.689380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274f198-4a3e-4216-a211-a180d5d8e392 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:09.701140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274f198-4a3e-4216-a211-a180d5d8e392 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:09.757338 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20e6d3-788b-4f62-9fc3-edd54da8febc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:09.757947 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20e6d3-788b-4f62-9fc3-edd54da8febc admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.758230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20e6d3-788b-4f62-9fc3-edd54da8febc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.758505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20e6d3-788b-4f62-9fc3-edd54da8febc admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.759165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20e6d3-788b-4f62-9fc3-edd54da8febc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:09.761690 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20e6d3-788b-4f62-9fc3-edd54da8febc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:09.783343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1263/2540] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:16:09 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:09.787408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe3f88-9869-44c8-9221-60ca235dafba admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:09.797908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe3f88-9869-44c8-9221-60ca235dafba admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:09.802513 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2a74f-75d5-49f2-91f5-73409c53e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:09.803155 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2a74f-75d5-49f2-91f5-73409c53e8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.803437 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2a74f-75d5-49f2-91f5-73409c53e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.803714 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2a74f-75d5-49f2-91f5-73409c53e8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.804360 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2a74f-75d5-49f2-91f5-73409c53e8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:09.805945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2a74f-75d5-49f2-91f5-73409c53e8f2 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:09.816985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1278/2541] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:09.821265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20e6d3-788b-4f62-9fc3-edd54da8febc admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:09.832145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20e6d3-788b-4f62-9fc3-edd54da8febc admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:09.836745 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f848b1c-ed10-4339-a1c4-26be7c887231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:09.837352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f848b1c-ed10-4339-a1c4-26be7c887231 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.837634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f848b1c-ed10-4339-a1c4-26be7c887231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.837911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f848b1c-ed10-4339-a1c4-26be7c887231 admin admin] PATH_INFO: `/v3/projects/32f5c8ace9504cd08e6bca2253f4d05b/users/13fdd6f30ba94a2ea872b6aa8b317518/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.853694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f848b1c-ed10-4339-a1c4-26be7c887231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f5c8ace9504cd08e6bca2253f4d05b, user_id=13fdd6f30ba94a2ea872b6aa8b317518, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:09.857402 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f848b1c-ed10-4339-a1c4-26be7c887231 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:09.871108 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1264/2542] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:09 2022] PUT /identity/v3/projects/32f5c8ace9504cd08e6bca2253f4d05b/users/13fdd6f30ba94a2ea872b6aa8b317518/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:09.875088 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2a74f-75d5-49f2-91f5-73409c53e8f2 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:09.885074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2a74f-75d5-49f2-91f5-73409c53e8f2 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:09.941843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dd7a5-b9f1-4821-9dd9-3d1408919b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:09.942365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd7a5-b9f1-4821-9dd9-3d1408919b81 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.942652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd7a5-b9f1-4821-9dd9-3d1408919b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.942969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd7a5-b9f1-4821-9dd9-3d1408919b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.943641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dd7a5-b9f1-4821-9dd9-3d1408919b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:09.945233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dd7a5-b9f1-4821-9dd9-3d1408919b81 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:09.955170 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1279/2543] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:09.959431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f848b1c-ed10-4339-a1c4-26be7c887231 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:09.970550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f848b1c-ed10-4339-a1c4-26be7c887231 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:09.975474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0569f9e-d7c1-459c-8dde-58aeb83ac79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:09.976313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0569f9e-d7c1-459c-8dde-58aeb83ac79d admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:09.976600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0569f9e-d7c1-459c-8dde-58aeb83ac79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:09.976874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0569f9e-d7c1-459c-8dde-58aeb83ac79d admin admin] PATH_INFO: `/v3/projects/32f5c8ace9504cd08e6bca2253f4d05b/users/13fdd6f30ba94a2ea872b6aa8b317518/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:09.978806 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0569f9e-d7c1-459c-8dde-58aeb83ac79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f5c8ace9504cd08e6bca2253f4d05b, user_id=13fdd6f30ba94a2ea872b6aa8b317518, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:09.982276 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0569f9e-d7c1-459c-8dde-58aeb83ac79d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:09.993205 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1265/2544] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:09 2022] PUT /identity/v3/projects/32f5c8ace9504cd08e6bca2253f4d05b/users/13fdd6f30ba94a2ea872b6aa8b317518/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:10.004289 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f362b-51fc-48cf-afcf-7bac6ae2701c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:10.004580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f362b-51fc-48cf-afcf-7bac6ae2701c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:10.004862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f362b-51fc-48cf-afcf-7bac6ae2701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:10.032481 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e44f362b-51fc-48cf-afcf-7bac6ae2701c None None] MFA Rules not processed for user `13fdd6f30ba94a2ea872b6aa8b317518`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:10.033713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e44f362b-51fc-48cf-afcf-7bac6ae2701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:10.093239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:10.103007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1280/2545] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:10 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:16:10.114571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0569f9e-d7c1-459c-8dde-58aeb83ac79d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:10.116379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a0569f9e-d7c1-459c-8dde-58aeb83ac79d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:10.206403 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0569f9e-d7c1-459c-8dde-58aeb83ac79d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:10.211919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbb66a-b360-44d8-a05d-ec6badbbe596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:10.212632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbb66a-b360-44d8-a05d-ec6badbbe596 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:10.212989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbb66a-b360-44d8-a05d-ec6badbbe596 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:10.213343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbb66a-b360-44d8-a05d-ec6badbbe596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:10.225709 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbb66a-b360-44d8-a05d-ec6badbbe596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:10.227961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbb66a-b360-44d8-a05d-ec6badbbe596 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:10.243340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1266/2546] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:10 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:16:10.405221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f362b-51fc-48cf-afcf-7bac6ae2701c None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:10.482037 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f362b-51fc-48cf-afcf-7bac6ae2701c None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:10.497036 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:10.497722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:10.498009 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:10.498291 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] PATH_INFO: `/v3/users/942fe26b995141bf9188d33b70f8ffa6` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:10.499910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=942fe26b995141bf9188d33b70f8ffa6)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:10.502456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:10.570961 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942fe26b995141bf9188d33b70f8ffa6'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:10.583563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942fe26b995141bf9188d33b70f8ffa6'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:10.584330 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942fe26b995141bf9188d33b70f8ffa6'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:10.585067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942fe26b995141bf9188d33b70f8ffa6'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:10.599700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942fe26b995141bf9188d33b70f8ffa6'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:10.613045 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1281/2547] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:16:10 2022] DELETE /identity/v3/users/942fe26b995141bf9188d33b70f8ffa6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:10.617313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3cdf4-ad16-4997-a081-a691fc132d55 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:10.617827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3cdf4-ad16-4997-a081-a691fc132d55 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:10.617937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3cdf4-ad16-4997-a081-a691fc132d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:10.638439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-66b3cdf4-ad16-4997-a081-a691fc132d55 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:10.639704 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-66b3cdf4-ad16-4997-a081-a691fc132d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:10.662406 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:10.711653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1267/2548] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:16:10.722872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:10.724024 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:10.788476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc59c5-ae13-4542-bbbd-aea46cd85ab2 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:10.792643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd834d-39a7-4dd2-873c-f45ae51a05b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:10.793266 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd834d-39a7-4dd2-873c-f45ae51a05b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:10.793548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd834d-39a7-4dd2-873c-f45ae51a05b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:10.793826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd834d-39a7-4dd2-873c-f45ae51a05b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:10.803660 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd834d-39a7-4dd2-873c-f45ae51a05b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:10.805089 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd834d-39a7-4dd2-873c-f45ae51a05b6 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:10.816373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1282/2549] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:16:11.128710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3cdf4-ad16-4997-a081-a691fc132d55 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:11.130154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-66b3cdf4-ad16-4997-a081-a691fc132d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:11.148856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3cdf4-ad16-4997-a081-a691fc132d55 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:11.153764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:11.154430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:11.154778 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:11.155020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] PATH_INFO: `/v3/projects/7cbaae231b074db6837a3b7e5814238b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:11.156659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cbaae231b074db6837a3b7e5814238b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:11.158468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:11.211405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cbaae231b074db6837a3b7e5814238b', 'request_id': 'req-d008c629-5f33-41f3-a453-0766ead8fa0e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.217388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cbaae231b074db6837a3b7e5814238b', 'request_id': 'req-d008c629-5f33-41f3-a453-0766ead8fa0e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.225732 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cbaae231b074db6837a3b7e5814238b', 'request_id': 'req-d008c629-5f33-41f3-a453-0766ead8fa0e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.238479 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] The token cache is being invalidate because project 7cbaae231b074db6837a3b7e5814238b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:16:11.238800 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.239478 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.241017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1268/2550] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:16:11 2022] DELETE /identity/v3/projects/7cbaae231b074db6837a3b7e5814238b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:11.245655 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd834d-39a7-4dd2-873c-f45ae51a05b6 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:11.256317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd834d-39a7-4dd2-873c-f45ae51a05b6 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:11.270701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:11.319307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5142bb-fd3b-4f32-ac0d-9fcd87f4d331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:11.319959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5142bb-fd3b-4f32-ac0d-9fcd87f4d331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:11.320248 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5142bb-fd3b-4f32-ac0d-9fcd87f4d331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:11.320528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5142bb-fd3b-4f32-ac0d-9fcd87f4d331 admin admin] PATH_INFO: `/v3/users/13fdd6f30ba94a2ea872b6aa8b317518` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:11.321692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5142bb-fd3b-4f32-ac0d-9fcd87f4d331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13fdd6f30ba94a2ea872b6aa8b317518)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:11.324842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5142bb-fd3b-4f32-ac0d-9fcd87f4d331 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:11.374050 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ca5142bb-fd3b-4f32-ac0d-9fcd87f4d331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13fdd6f30ba94a2ea872b6aa8b317518'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.381483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ca5142bb-fd3b-4f32-ac0d-9fcd87f4d331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13fdd6f30ba94a2ea872b6aa8b317518'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.382100 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ca5142bb-fd3b-4f32-ac0d-9fcd87f4d331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13fdd6f30ba94a2ea872b6aa8b317518'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.382726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ca5142bb-fd3b-4f32-ac0d-9fcd87f4d331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13fdd6f30ba94a2ea872b6aa8b317518'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.396227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ca5142bb-fd3b-4f32-ac0d-9fcd87f4d331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13fdd6f30ba94a2ea872b6aa8b317518'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.409558 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1283/2551] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:16:11 2022] DELETE /identity/v3/users/13fdd6f30ba94a2ea872b6aa8b317518 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:11.709066 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:11.710628 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:11.725916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008c629-5f33-41f3-a453-0766ead8fa0e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:11.801054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041a828-5157-44db-aea0-a1701c8271e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:11.801709 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041a828-5157-44db-aea0-a1701c8271e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:11.801988 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041a828-5157-44db-aea0-a1701c8271e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:11.802260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041a828-5157-44db-aea0-a1701c8271e7 admin admin] PATH_INFO: `/v3/projects/32f5c8ace9504cd08e6bca2253f4d05b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:11.804752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041a828-5157-44db-aea0-a1701c8271e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f5c8ace9504cd08e6bca2253f4d05b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:11.809285 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041a828-5157-44db-aea0-a1701c8271e7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:11.865918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4041a828-5157-44db-aea0-a1701c8271e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f5c8ace9504cd08e6bca2253f4d05b', 'request_id': 'req-4041a828-5157-44db-aea0-a1701c8271e7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.867942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:11.872671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4041a828-5157-44db-aea0-a1701c8271e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f5c8ace9504cd08e6bca2253f4d05b', 'request_id': 'req-4041a828-5157-44db-aea0-a1701c8271e7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.881574 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4041a828-5157-44db-aea0-a1701c8271e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f5c8ace9504cd08e6bca2253f4d05b', 'request_id': 'req-4041a828-5157-44db-aea0-a1701c8271e7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.895632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4041a828-5157-44db-aea0-a1701c8271e7 admin admin] The token cache is being invalidate because project 32f5c8ace9504cd08e6bca2253f4d05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:16:11.895924 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4041a828-5157-44db-aea0-a1701c8271e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.896602 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4041a828-5157-44db-aea0-a1701c8271e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:11.898100 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1269/2552] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:16:11 2022] DELETE /identity/v3/projects/32f5c8ace9504cd08e6bca2253f4d05b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:11.903722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626bd3e-8971-4c4a-bc98-91c74b47affd None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:11.904171 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626bd3e-8971-4c4a-bc98-91c74b47affd None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:11.904537 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626bd3e-8971-4c4a-bc98-91c74b47affd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:11.927202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-6626bd3e-8971-4c4a-bc98-91c74b47affd None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:11.928503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6626bd3e-8971-4c4a-bc98-91c74b47affd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:12.029279 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1284/2553] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:16:12.035131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dc8a3-2baa-4777-a4d4-ec6399b6c7ac None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:12.035622 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dc8a3-2baa-4777-a4d4-ec6399b6c7ac None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:12.036115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dc8a3-2baa-4777-a4d4-ec6399b6c7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:12.063656 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-335dc8a3-2baa-4777-a4d4-ec6399b6c7ac None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:12.065119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-335dc8a3-2baa-4777-a4d4-ec6399b6c7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:12.075760 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1270/2554] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:12.080156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626bd3e-8971-4c4a-bc98-91c74b47affd None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:12.091889 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626bd3e-8971-4c4a-bc98-91c74b47affd None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:12.097632 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee3de9-54d9-4b67-af4d-6054f8358927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:12.098876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3de9-54d9-4b67-af4d-6054f8358927 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:12.099161 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3de9-54d9-4b67-af4d-6054f8358927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:12.099559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3de9-54d9-4b67-af4d-6054f8358927 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:12.100364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee3de9-54d9-4b67-af4d-6054f8358927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:16:12.100722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee3de9-54d9-4b67-af4d-6054f8358927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:12.103613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee3de9-54d9-4b67-af4d-6054f8358927 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:12.117871 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1285/2555] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:16:12.123391 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dc8a3-2baa-4777-a4d4-ec6399b6c7ac None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:12.132856 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dc8a3-2baa-4777-a4d4-ec6399b6c7ac None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:12.138595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54c298-5e8b-45f0-9866-f1b1b392d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:12.139244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54c298-5e8b-45f0-9866-f1b1b392d265 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:12.139528 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54c298-5e8b-45f0-9866-f1b1b392d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:12.139810 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54c298-5e8b-45f0-9866-f1b1b392d265 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:12.140453 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54c298-5e8b-45f0-9866-f1b1b392d265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:12.142374 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54c298-5e8b-45f0-9866-f1b1b392d265 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:12.173696 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1271/2556] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:16:12 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:12.177925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee3de9-54d9-4b67-af4d-6054f8358927 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:12.191654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee3de9-54d9-4b67-af4d-6054f8358927 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:12.215675 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:12.257847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b58fe-3cbc-4e7f-8ab5-8eadff11ddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:12.258529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b58fe-3cbc-4e7f-8ab5-8eadff11ddb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:12.258742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b58fe-3cbc-4e7f-8ab5-8eadff11ddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:12.259047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b58fe-3cbc-4e7f-8ab5-8eadff11ddb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:12.259702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b58fe-3cbc-4e7f-8ab5-8eadff11ddb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:12.262816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b58fe-3cbc-4e7f-8ab5-8eadff11ddb1 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:12.286634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1286/2557] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:16:12 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:12.290962 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54c298-5e8b-45f0-9866-f1b1b392d265 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:12.301715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54c298-5e8b-45f0-9866-f1b1b392d265 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:12.306968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f3bd9-a2ca-4c88-9c26-60ca9585821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:12.307648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3bd9-a2ca-4c88-9c26-60ca9585821c admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:12.307933 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3bd9-a2ca-4c88-9c26-60ca9585821c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:12.308214 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3bd9-a2ca-4c88-9c26-60ca9585821c admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:12.308877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f3bd9-a2ca-4c88-9c26-60ca9585821c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:12.310502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f3bd9-a2ca-4c88-9c26-60ca9585821c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:12.321619 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1272/2558] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:12.326375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b58fe-3cbc-4e7f-8ab5-8eadff11ddb1 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:12.337114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b58fe-3cbc-4e7f-8ab5-8eadff11ddb1 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:12.342944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccaff4e-3e78-444c-ad0a-2d513b8b4f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:12.343565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaff4e-3e78-444c-ad0a-2d513b8b4f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:12.343852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaff4e-3e78-444c-ad0a-2d513b8b4f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:12.344177 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaff4e-3e78-444c-ad0a-2d513b8b4f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:12.344830 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccaff4e-3e78-444c-ad0a-2d513b8b4f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:12.347140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccaff4e-3e78-444c-ad0a-2d513b8b4f54 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:12.358373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1287/2559] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:16:12.362421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f3bd9-a2ca-4c88-9c26-60ca9585821c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:12.372846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f3bd9-a2ca-4c88-9c26-60ca9585821c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:12.377956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5481-a789-4350-a9d5-0db1be84f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:12.379520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5481-a789-4350-a9d5-0db1be84f842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:12.379520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5481-a789-4350-a9d5-0db1be84f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:12.379520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5481-a789-4350-a9d5-0db1be84f842 admin admin] PATH_INFO: `/v3/projects/7fb1724d9b754bf88afe007e6a7c1a8a/users/7cf8912619694134addaae46e9f92d09/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:12.396360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5481-a789-4350-a9d5-0db1be84f842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb1724d9b754bf88afe007e6a7c1a8a, user_id=7cf8912619694134addaae46e9f92d09, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:12.406870 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5481-a789-4350-a9d5-0db1be84f842 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:12.421388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1273/2560] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:12 2022] PUT /identity/v3/projects/7fb1724d9b754bf88afe007e6a7c1a8a/users/7cf8912619694134addaae46e9f92d09/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:12.433743 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95343bed-f030-46ce-bf47-8caa255edbe5 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:12.434019 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95343bed-f030-46ce-bf47-8caa255edbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:12.434309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95343bed-f030-46ce-bf47-8caa255edbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:12.465655 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-95343bed-f030-46ce-bf47-8caa255edbe5 None None] MFA Rules not processed for user `7cf8912619694134addaae46e9f92d09`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:12.466946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-95343bed-f030-46ce-bf47-8caa255edbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:12.541019 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1288/2561] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:12.545941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5481-a789-4350-a9d5-0db1be84f842 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:12.611317 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5481-a789-4350-a9d5-0db1be84f842 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:12.616044 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8e6e7-c094-48a8-a74b-8c4e48202e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:12.616654 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8e6e7-c094-48a8-a74b-8c4e48202e83 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:12.616941 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8e6e7-c094-48a8-a74b-8c4e48202e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:12.617219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8e6e7-c094-48a8-a74b-8c4e48202e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:12.617891 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8e6e7-c094-48a8-a74b-8c4e48202e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:12.620489 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8e6e7-c094-48a8-a74b-8c4e48202e83 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:12.650098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1274/2562] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:16:12 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:12.654640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95343bed-f030-46ce-bf47-8caa255edbe5 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:12.665910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95343bed-f030-46ce-bf47-8caa255edbe5 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:12.749647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc881e1-ffb4-4081-b6dd-ac062ef79a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:12.750704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc881e1-ffb4-4081-b6dd-ac062ef79a5b admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:12.751245 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc881e1-ffb4-4081-b6dd-ac062ef79a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:12.751743 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc881e1-ffb4-4081-b6dd-ac062ef79a5b admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:12.752953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc881e1-ffb4-4081-b6dd-ac062ef79a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:12.756534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc881e1-ffb4-4081-b6dd-ac062ef79a5b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:12.785806 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1289/2563] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:16:12 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:16:12.790050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8e6e7-c094-48a8-a74b-8c4e48202e83 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:12.802308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8e6e7-c094-48a8-a74b-8c4e48202e83 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:12.807124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869aff5-4c1b-428e-a41d-12f7a04514b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:12.808404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869aff5-4c1b-428e-a41d-12f7a04514b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:12.808703 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869aff5-4c1b-428e-a41d-12f7a04514b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:12.808951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869aff5-4c1b-428e-a41d-12f7a04514b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:12.809657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869aff5-4c1b-428e-a41d-12f7a04514b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:12.811262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869aff5-4c1b-428e-a41d-12f7a04514b8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:12.823905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1275/2564] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:12.828530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc881e1-ffb4-4081-b6dd-ac062ef79a5b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:12.838892 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc881e1-ffb4-4081-b6dd-ac062ef79a5b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:12.844048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46742d-7379-444c-9d55-e491f992d2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:12.844823 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46742d-7379-444c-9d55-e491f992d2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:12.845108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46742d-7379-444c-9d55-e491f992d2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:12.845384 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46742d-7379-444c-9d55-e491f992d2ee admin admin] PATH_INFO: `/v3/projects/01e1dbf365c7428795110f9bb9de2ad8/users/8edcd223bfb14d128ad35a186081949a/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:12.861538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46742d-7379-444c-9d55-e491f992d2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e1dbf365c7428795110f9bb9de2ad8, user_id=8edcd223bfb14d128ad35a186081949a, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:12.864340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46742d-7379-444c-9d55-e491f992d2ee admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:12.873318 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:12.880482 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1290/2565] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:12 2022] PUT /identity/v3/projects/01e1dbf365c7428795110f9bb9de2ad8/users/8edcd223bfb14d128ad35a186081949a/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:12.886506 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869aff5-4c1b-428e-a41d-12f7a04514b8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:12.897458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869aff5-4c1b-428e-a41d-12f7a04514b8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:12.951994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:12.968578 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f41ce5-dbe0-4539-807d-a4fe22987db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:12.969208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f41ce5-dbe0-4539-807d-a4fe22987db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:12.969493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f41ce5-dbe0-4539-807d-a4fe22987db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:12.969771 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f41ce5-dbe0-4539-807d-a4fe22987db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:12.970433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f41ce5-dbe0-4539-807d-a4fe22987db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:12.972108 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f41ce5-dbe0-4539-807d-a4fe22987db2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:12.983522 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1276/2566] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:12.987896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46742d-7379-444c-9d55-e491f992d2ee admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:12.998899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46742d-7379-444c-9d55-e491f992d2ee admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:13.003609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652704-d3e3-470d-87a3-aff1af0a7565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:13.004286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652704-d3e3-470d-87a3-aff1af0a7565 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:13.004571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652704-d3e3-470d-87a3-aff1af0a7565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:13.004852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652704-d3e3-470d-87a3-aff1af0a7565 admin admin] PATH_INFO: `/v3/projects/01e1dbf365c7428795110f9bb9de2ad8/users/8edcd223bfb14d128ad35a186081949a/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:13.006835 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3652704-d3e3-470d-87a3-aff1af0a7565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e1dbf365c7428795110f9bb9de2ad8, user_id=8edcd223bfb14d128ad35a186081949a, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:13.009474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3652704-d3e3-470d-87a3-aff1af0a7565 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:13.020797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1291/2567] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:12 2022] PUT /identity/v3/projects/01e1dbf365c7428795110f9bb9de2ad8/users/8edcd223bfb14d128ad35a186081949a/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:13.032599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2a35-4efb-412e-8120-2c34be12306a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:13.032890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2a35-4efb-412e-8120-2c34be12306a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:13.033169 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2a35-4efb-412e-8120-2c34be12306a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:13.066648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e3de2a35-4efb-412e-8120-2c34be12306a None None] MFA Rules not processed for user `8edcd223bfb14d128ad35a186081949a`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:13.067916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e3de2a35-4efb-412e-8120-2c34be12306a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:13.154256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1277/2568] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:13.167400 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652704-d3e3-470d-87a3-aff1af0a7565 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:13.169295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b3652704-d3e3-470d-87a3-aff1af0a7565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:13.241139 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652704-d3e3-470d-87a3-aff1af0a7565 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:13.246175 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0d48d-da48-404b-a490-b2cd02fa9ec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:13.246933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d48d-da48-404b-a490-b2cd02fa9ec9 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:13.247218 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d48d-da48-404b-a490-b2cd02fa9ec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:13.247587 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d48d-da48-404b-a490-b2cd02fa9ec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:13.259563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0d48d-da48-404b-a490-b2cd02fa9ec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:13.261695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0d48d-da48-404b-a490-b2cd02fa9ec9 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:13.272225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1292/2569] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:16:13.366808 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de2a35-4efb-412e-8120-2c34be12306a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:13.377579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de2a35-4efb-412e-8120-2c34be12306a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:13.381163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bc000-54a2-40b2-aea5-7c97f59a7f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:13.381769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bc000-54a2-40b2-aea5-7c97f59a7f14 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:13.382050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bc000-54a2-40b2-aea5-7c97f59a7f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:13.382323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bc000-54a2-40b2-aea5-7c97f59a7f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:13.447290 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bc000-54a2-40b2-aea5-7c97f59a7f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:13.449289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bc000-54a2-40b2-aea5-7c97f59a7f14 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:13.465299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1278/2570] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:16:15.880973 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde17f6-9558-484c-8e12-e7ea76711699 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:15.881460 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde17f6-9558-484c-8e12-e7ea76711699 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:15.881581 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde17f6-9558-484c-8e12-e7ea76711699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:15.900852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-8dde17f6-9558-484c-8e12-e7ea76711699 None None] MFA Rules not processed for user `a6e838dfd7a64de5b1e95f8276bcdca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:15.902183 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8dde17f6-9558-484c-8e12-e7ea76711699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:15.957836 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1293/2571] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:23.454378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=68 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:25.951291 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=57,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:43.599597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bc000-54a2-40b2-aea5-7c97f59a7f14 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:43.664817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bc000-54a2-40b2-aea5-7c97f59a7f14 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:43.670208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:43.670873 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:43.671160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:43.671438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] PATH_INFO: `/v3/users/7cf8912619694134addaae46e9f92d09` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:43.672573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf8912619694134addaae46e9f92d09)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:43.674488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:43.720349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf8912619694134addaae46e9f92d09'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:43.733117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf8912619694134addaae46e9f92d09'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:43.740680 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf8912619694134addaae46e9f92d09'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:43.741320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf8912619694134addaae46e9f92d09'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:43.741950 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf8912619694134addaae46e9f92d09'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:43.754976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1279/2572] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:16:43 2022] DELETE /identity/v3/users/7cf8912619694134addaae46e9f92d09 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:43.759443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff6423-7f5c-47dc-9c2f-5c8b52710ab3 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:43.759915 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff6423-7f5c-47dc-9c2f-5c8b52710ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:43.760032 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff6423-7f5c-47dc-9c2f-5c8b52710ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:43.779293 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-c7ff6423-7f5c-47dc-9c2f-5c8b52710ab3 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:43.780520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c7ff6423-7f5c-47dc-9c2f-5c8b52710ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:43.846303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1294/2573] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:43.856804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:43.858271 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:43.916275 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f981e02-e158-440a-9713-6ffa6a250d18 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:43.920536 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f00e63-c189-4554-9d09-dd98529f5e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:43.921154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f00e63-c189-4554-9d09-dd98529f5e90 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:43.921438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f00e63-c189-4554-9d09-dd98529f5e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:43.921717 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f00e63-c189-4554-9d09-dd98529f5e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:43.931449 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f00e63-c189-4554-9d09-dd98529f5e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:43.932895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f00e63-c189-4554-9d09-dd98529f5e90 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:43.943602 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1280/2574] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:16:44.242226 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff6423-7f5c-47dc-9c2f-5c8b52710ab3 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:44.244136 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c7ff6423-7f5c-47dc-9c2f-5c8b52710ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:44.259354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff6423-7f5c-47dc-9c2f-5c8b52710ab3 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:44.264551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:44.265209 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:44.265495 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:44.265887 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] PATH_INFO: `/v3/projects/7fb1724d9b754bf88afe007e6a7c1a8a` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:44.267028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb1724d9b754bf88afe007e6a7c1a8a)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:44.269045 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:44.321232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb1724d9b754bf88afe007e6a7c1a8a', 'request_id': 'req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:44.329288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb1724d9b754bf88afe007e6a7c1a8a', 'request_id': 'req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:44.337452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb1724d9b754bf88afe007e6a7c1a8a', 'request_id': 'req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:44.348966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] The token cache is being invalidate because project 7fb1724d9b754bf88afe007e6a7c1a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:16:44.349185 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:44.349844 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:44.351373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1295/2575] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:16:44 2022] DELETE /identity/v3/projects/7fb1724d9b754bf88afe007e6a7c1a8a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:44.355559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f00e63-c189-4554-9d09-dd98529f5e90 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:44.366057 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f00e63-c189-4554-9d09-dd98529f5e90 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:44.385105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:44.432006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47d0b7-eba1-4e9c-8bf6-6afdf2940880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:44.432572 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47d0b7-eba1-4e9c-8bf6-6afdf2940880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:44.432855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47d0b7-eba1-4e9c-8bf6-6afdf2940880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:44.433143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47d0b7-eba1-4e9c-8bf6-6afdf2940880 admin admin] PATH_INFO: `/v3/users/8edcd223bfb14d128ad35a186081949a` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:44.434413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47d0b7-eba1-4e9c-8bf6-6afdf2940880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8edcd223bfb14d128ad35a186081949a)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:44.436525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47d0b7-eba1-4e9c-8bf6-6afdf2940880 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:44.487713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1e47d0b7-eba1-4e9c-8bf6-6afdf2940880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edcd223bfb14d128ad35a186081949a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:44.503866 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1e47d0b7-eba1-4e9c-8bf6-6afdf2940880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edcd223bfb14d128ad35a186081949a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:44.514966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1e47d0b7-eba1-4e9c-8bf6-6afdf2940880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edcd223bfb14d128ad35a186081949a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:44.515789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1e47d0b7-eba1-4e9c-8bf6-6afdf2940880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edcd223bfb14d128ad35a186081949a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:44.516597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-1e47d0b7-eba1-4e9c-8bf6-6afdf2940880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edcd223bfb14d128ad35a186081949a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:44.539272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1281/2576] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:16:44 2022] DELETE /identity/v3/users/8edcd223bfb14d128ad35a186081949a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:44.836793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:44.839693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:44.853006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635e5a1-9fe4-4daa-b606-3bbb52a3f27e admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:44.918535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf05951-de21-482f-86ec-d54fe28dbea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:44.918668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf05951-de21-482f-86ec-d54fe28dbea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:44.918869 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf05951-de21-482f-86ec-d54fe28dbea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:44.919144 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf05951-de21-482f-86ec-d54fe28dbea2 admin admin] PATH_INFO: `/v3/projects/01e1dbf365c7428795110f9bb9de2ad8` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:44.920298 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf05951-de21-482f-86ec-d54fe28dbea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e1dbf365c7428795110f9bb9de2ad8)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:44.922201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf05951-de21-482f-86ec-d54fe28dbea2 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:44.955429 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:44.973963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1cf05951-de21-482f-86ec-d54fe28dbea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e1dbf365c7428795110f9bb9de2ad8', 'request_id': 'req-1cf05951-de21-482f-86ec-d54fe28dbea2'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:44.981904 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1cf05951-de21-482f-86ec-d54fe28dbea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e1dbf365c7428795110f9bb9de2ad8', 'request_id': 'req-1cf05951-de21-482f-86ec-d54fe28dbea2'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:44.988427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1cf05951-de21-482f-86ec-d54fe28dbea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e1dbf365c7428795110f9bb9de2ad8', 'request_id': 'req-1cf05951-de21-482f-86ec-d54fe28dbea2'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:44.999868 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1cf05951-de21-482f-86ec-d54fe28dbea2 admin admin] The token cache is being invalidate because project 01e1dbf365c7428795110f9bb9de2ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:16:45.000156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1cf05951-de21-482f-86ec-d54fe28dbea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:45.000818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1cf05951-de21-482f-86ec-d54fe28dbea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:45.002581 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1296/2577] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:16:44 2022] DELETE /identity/v3/projects/01e1dbf365c7428795110f9bb9de2ad8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:45.007201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996de1f-0054-403c-8815-5de0d1cb3c7f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:45.007719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996de1f-0054-403c-8815-5de0d1cb3c7f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:45.007823 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996de1f-0054-403c-8815-5de0d1cb3c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:45.027721 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a996de1f-0054-403c-8815-5de0d1cb3c7f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:45.028960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a996de1f-0054-403c-8815-5de0d1cb3c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:45.092234 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1282/2578] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:45.100214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde12c9-771f-4d9a-8690-fd1848b08f3a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:45.100505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde12c9-771f-4d9a-8690-fd1848b08f3a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:45.100778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde12c9-771f-4d9a-8690-fd1848b08f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:45.120437 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-0bde12c9-771f-4d9a-8690-fd1848b08f3a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:45.121576 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0bde12c9-771f-4d9a-8690-fd1848b08f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:45.130573 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1297/2579] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:16:45.134700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996de1f-0054-403c-8815-5de0d1cb3c7f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:45.145761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996de1f-0054-403c-8815-5de0d1cb3c7f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:45.150906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a8898-9d44-4181-aaff-56d886865a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:45.151516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a8898-9d44-4181-aaff-56d886865a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:45.151800 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a8898-9d44-4181-aaff-56d886865a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:45.152099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a8898-9d44-4181-aaff-56d886865a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:45.152762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a8898-9d44-4181-aaff-56d886865a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:16:45.153162 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a8898-9d44-4181-aaff-56d886865a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:45.154754 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a8898-9d44-4181-aaff-56d886865a8d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:45.167301 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1283/2580] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:16:45.172310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde12c9-771f-4d9a-8690-fd1848b08f3a None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:45.181698 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde12c9-771f-4d9a-8690-fd1848b08f3a None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:45.187206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc8ac4-1767-47da-93e2-2510265192ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:45.187922 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc8ac4-1767-47da-93e2-2510265192ea admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:45.188278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc8ac4-1767-47da-93e2-2510265192ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:45.188625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc8ac4-1767-47da-93e2-2510265192ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:45.189351 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc8ac4-1767-47da-93e2-2510265192ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:45.191424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc8ac4-1767-47da-93e2-2510265192ea admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:45.221950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1298/2581] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:16:45 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:45.226884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a8898-9d44-4181-aaff-56d886865a8d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:45.242653 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a8898-9d44-4181-aaff-56d886865a8d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:45.284915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:45.321726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf0791-7cfd-4e78-8df4-d716762deb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:45.322351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf0791-7cfd-4e78-8df4-d716762deb7d admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:45.322638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf0791-7cfd-4e78-8df4-d716762deb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:45.322939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf0791-7cfd-4e78-8df4-d716762deb7d admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:45.323573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf0791-7cfd-4e78-8df4-d716762deb7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:45.326606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf0791-7cfd-4e78-8df4-d716762deb7d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:45.353218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1284/2582] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:16:45 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:45.354556 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc8ac4-1767-47da-93e2-2510265192ea admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:45.366530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc8ac4-1767-47da-93e2-2510265192ea admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:45.371816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26922ef-8ae8-424c-bcc6-7b17f1df8ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:45.372640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26922ef-8ae8-424c-bcc6-7b17f1df8ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:45.373043 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26922ef-8ae8-424c-bcc6-7b17f1df8ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:45.373401 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26922ef-8ae8-424c-bcc6-7b17f1df8ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:45.374444 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26922ef-8ae8-424c-bcc6-7b17f1df8ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:45.376011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26922ef-8ae8-424c-bcc6-7b17f1df8ed1 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:45.390910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1299/2583] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:45.392044 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf0791-7cfd-4e78-8df4-d716762deb7d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:45.403922 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf0791-7cfd-4e78-8df4-d716762deb7d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:45.409156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e75b48-fd95-4241-97c0-9090989ce654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:45.419782 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e75b48-fd95-4241-97c0-9090989ce654 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:45.420077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e75b48-fd95-4241-97c0-9090989ce654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:45.420361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e75b48-fd95-4241-97c0-9090989ce654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:45.421042 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e75b48-fd95-4241-97c0-9090989ce654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:45.422702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e75b48-fd95-4241-97c0-9090989ce654 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:45.434255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1285/2584] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:45.438989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26922ef-8ae8-424c-bcc6-7b17f1df8ed1 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:45.450987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26922ef-8ae8-424c-bcc6-7b17f1df8ed1 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:45.455664 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adf13a-f9e7-4c6d-a83d-ccdeb6e26371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:45.456345 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf13a-f9e7-4c6d-a83d-ccdeb6e26371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:45.456695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf13a-f9e7-4c6d-a83d-ccdeb6e26371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:45.456903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf13a-f9e7-4c6d-a83d-ccdeb6e26371 admin admin] PATH_INFO: `/v3/projects/981e5528cfa14250bd97e8b622b66f27/users/688d1f6a0c6246279659c23357a29ba9/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:45.472933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adf13a-f9e7-4c6d-a83d-ccdeb6e26371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=981e5528cfa14250bd97e8b622b66f27, user_id=688d1f6a0c6246279659c23357a29ba9, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:45.475635 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adf13a-f9e7-4c6d-a83d-ccdeb6e26371 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:45.488824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1300/2585] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:45 2022] PUT /identity/v3/projects/981e5528cfa14250bd97e8b622b66f27/users/688d1f6a0c6246279659c23357a29ba9/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:45.499350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dcb7d-0456-4cd2-bea7-17b98710bfd8 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:45.499666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dcb7d-0456-4cd2-bea7-17b98710bfd8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:45.499958 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dcb7d-0456-4cd2-bea7-17b98710bfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:45.534101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f41dcb7d-0456-4cd2-bea7-17b98710bfd8 None None] MFA Rules not processed for user `688d1f6a0c6246279659c23357a29ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:45.535512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f41dcb7d-0456-4cd2-bea7-17b98710bfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:45.635392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1286/2586] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:16:45.641094 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adf13a-f9e7-4c6d-a83d-ccdeb6e26371 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:45.731618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adf13a-f9e7-4c6d-a83d-ccdeb6e26371 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:45.737254 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e3c97-b4c5-4802-84f4-355776f5f92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:45.743952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e3c97-b4c5-4802-84f4-355776f5f92f admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:45.743952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e3c97-b4c5-4802-84f4-355776f5f92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:45.743952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e3c97-b4c5-4802-84f4-355776f5f92f admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:45.743952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e3c97-b4c5-4802-84f4-355776f5f92f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:45.743952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e3c97-b4c5-4802-84f4-355776f5f92f admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:45.801952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1301/2587] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:16:45 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:45.807086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41dcb7d-0456-4cd2-bea7-17b98710bfd8 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:45.819336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41dcb7d-0456-4cd2-bea7-17b98710bfd8 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:45.883943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15027d-3c00-433f-81d5-f83acf6bd4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:45.884487 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15027d-3c00-433f-81d5-f83acf6bd4ea admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:45.884905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15027d-3c00-433f-81d5-f83acf6bd4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:45.885185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15027d-3c00-433f-81d5-f83acf6bd4ea admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:45.885819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15027d-3c00-433f-81d5-f83acf6bd4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:45.888495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15027d-3c00-433f-81d5-f83acf6bd4ea admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:45.913917 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1287/2588] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:16:45 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:16:45.915188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e3c97-b4c5-4802-84f4-355776f5f92f admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:45.926949 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e3c97-b4c5-4802-84f4-355776f5f92f admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:45.933272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42f5a3-cc6a-49f6-b7f7-0818dd4c3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:45.933893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42f5a3-cc6a-49f6-b7f7-0818dd4c3d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:45.934843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42f5a3-cc6a-49f6-b7f7-0818dd4c3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:45.935128 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42f5a3-cc6a-49f6-b7f7-0818dd4c3d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:45.935981 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42f5a3-cc6a-49f6-b7f7-0818dd4c3d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:45.937616 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42f5a3-cc6a-49f6-b7f7-0818dd4c3d39 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:45.949453 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1302/2589] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:45.954095 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15027d-3c00-433f-81d5-f83acf6bd4ea admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:45.964683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15027d-3c00-433f-81d5-f83acf6bd4ea admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:45.970152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3da5f2-0168-4f08-870c-39edb46b5d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:45.970994 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3da5f2-0168-4f08-870c-39edb46b5d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:45.971281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3da5f2-0168-4f08-870c-39edb46b5d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:45.971561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3da5f2-0168-4f08-870c-39edb46b5d23 admin admin] PATH_INFO: `/v3/projects/657db613c4014a57b7820fa926f05428/users/4dc152db1901484998383f6fac7c91ad/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:45.988413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3da5f2-0168-4f08-870c-39edb46b5d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=657db613c4014a57b7820fa926f05428, user_id=4dc152db1901484998383f6fac7c91ad, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:45.991305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3da5f2-0168-4f08-870c-39edb46b5d23 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:46.006804 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1288/2590] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:45 2022] PUT /identity/v3/projects/657db613c4014a57b7820fa926f05428/users/4dc152db1901484998383f6fac7c91ad/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:46.010798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42f5a3-cc6a-49f6-b7f7-0818dd4c3d39 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:46.021782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42f5a3-cc6a-49f6-b7f7-0818dd4c3d39 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:46.045060 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:46.095734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a92ae-0986-48d6-8703-28d25fa6a8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:46.096464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a92ae-0986-48d6-8703-28d25fa6a8ee admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:46.096751 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a92ae-0986-48d6-8703-28d25fa6a8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:46.097242 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a92ae-0986-48d6-8703-28d25fa6a8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:46.097973 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a92ae-0986-48d6-8703-28d25fa6a8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:46.099671 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a92ae-0986-48d6-8703-28d25fa6a8ee admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:46.111483 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1303/2591] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:16:46.115685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3da5f2-0168-4f08-870c-39edb46b5d23 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:46.121170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:46.128306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3da5f2-0168-4f08-870c-39edb46b5d23 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:46.133589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637a6f2-135e-427a-ba56-c4eef69614b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:46.134307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637a6f2-135e-427a-ba56-c4eef69614b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:46.134524 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637a6f2-135e-427a-ba56-c4eef69614b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:46.134829 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637a6f2-135e-427a-ba56-c4eef69614b9 admin admin] PATH_INFO: `/v3/projects/657db613c4014a57b7820fa926f05428/users/4dc152db1901484998383f6fac7c91ad/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:46.136767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637a6f2-135e-427a-ba56-c4eef69614b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=657db613c4014a57b7820fa926f05428, user_id=4dc152db1901484998383f6fac7c91ad, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:46.139524 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637a6f2-135e-427a-ba56-c4eef69614b9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:46.150535 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1289/2592] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:46 2022] PUT /identity/v3/projects/657db613c4014a57b7820fa926f05428/users/4dc152db1901484998383f6fac7c91ad/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:46.162232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8885d-e97e-426e-8c66-47bf74a0a596 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:46.162516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8885d-e97e-426e-8c66-47bf74a0a596 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:46.162845 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8885d-e97e-426e-8c66-47bf74a0a596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:46.192761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-cba8885d-e97e-426e-8c66-47bf74a0a596 None None] MFA Rules not processed for user `4dc152db1901484998383f6fac7c91ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:46.193970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cba8885d-e97e-426e-8c66-47bf74a0a596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:46.273269 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1304/2593] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:46.281466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637a6f2-135e-427a-ba56-c4eef69614b9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:46.283253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-2637a6f2-135e-427a-ba56-c4eef69614b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:46.346989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637a6f2-135e-427a-ba56-c4eef69614b9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:46.350689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87db31-ceb7-442b-ad55-8384cbef0210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:46.351343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87db31-ceb7-442b-ad55-8384cbef0210 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:46.351626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87db31-ceb7-442b-ad55-8384cbef0210 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:46.352016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87db31-ceb7-442b-ad55-8384cbef0210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:46.362241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87db31-ceb7-442b-ad55-8384cbef0210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:46.363754 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87db31-ceb7-442b-ad55-8384cbef0210 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:46.373819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1290/2594] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:16:46.484244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8885d-e97e-426e-8c66-47bf74a0a596 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:46.494222 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8885d-e97e-426e-8c66-47bf74a0a596 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:46.498469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f2d6b-1604-4e63-8026-b5c34c35c26f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:46.498912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f2d6b-1604-4e63-8026-b5c34c35c26f service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:46.499201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f2d6b-1604-4e63-8026-b5c34c35c26f service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:46.499477 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f2d6b-1604-4e63-8026-b5c34c35c26f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:46.572929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f2d6b-1604-4e63-8026-b5c34c35c26f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:46.574388 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f2d6b-1604-4e63-8026-b5c34c35c26f service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:46.584601 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1305/2595] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:16:49.236324 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87db31-ceb7-442b-ad55-8384cbef0210 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:49.301012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87db31-ceb7-442b-ad55-8384cbef0210 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:49.305534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:49.306158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:49.306444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:49.306722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] PATH_INFO: `/v3/users/688d1f6a0c6246279659c23357a29ba9` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:49.307869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=688d1f6a0c6246279659c23357a29ba9)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:49.310545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:49.363470 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688d1f6a0c6246279659c23357a29ba9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:49.376387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688d1f6a0c6246279659c23357a29ba9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:49.382882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688d1f6a0c6246279659c23357a29ba9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:49.383503 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688d1f6a0c6246279659c23357a29ba9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:49.384110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688d1f6a0c6246279659c23357a29ba9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:49.396911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1291/2596] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:16:49 2022] DELETE /identity/v3/users/688d1f6a0c6246279659c23357a29ba9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:49.401442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33fc7d-341d-41f1-ac33-f51873684b89 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:49.401940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33fc7d-341d-41f1-ac33-f51873684b89 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:49.402047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33fc7d-341d-41f1-ac33-f51873684b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:49.422912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-6e33fc7d-341d-41f1-ac33-f51873684b89 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:49.424127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6e33fc7d-341d-41f1-ac33-f51873684b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:49.464022 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:49.486430 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1306/2597] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:49.496116 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:49.497775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:49.511267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:49.559511 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546bb6d-09f3-4aea-8d52-f490b762cf31 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:49.563099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff61fb6-fef6-4989-be98-ca4239ca9213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:49.563765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff61fb6-fef6-4989-be98-ca4239ca9213 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:49.564046 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff61fb6-fef6-4989-be98-ca4239ca9213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:49.564318 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff61fb6-fef6-4989-be98-ca4239ca9213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:49.573507 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff61fb6-fef6-4989-be98-ca4239ca9213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:49.574967 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff61fb6-fef6-4989-be98-ca4239ca9213 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:49.584827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1292/2598] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:16:49.859646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33fc7d-341d-41f1-ac33-f51873684b89 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:49.861140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6e33fc7d-341d-41f1-ac33-f51873684b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:49.876122 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33fc7d-341d-41f1-ac33-f51873684b89 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:49.882879 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:49.882879 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:49.882879 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:49.882879 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] PATH_INFO: `/v3/projects/981e5528cfa14250bd97e8b622b66f27` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:49.886695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=981e5528cfa14250bd97e8b622b66f27)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:49.886695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:49.931603 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff61fb6-fef6-4989-be98-ca4239ca9213 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:49.940962 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff61fb6-fef6-4989-be98-ca4239ca9213 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:49.952830 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '981e5528cfa14250bd97e8b622b66f27', 'request_id': 'req-33f7fa32-f36b-4657-bf44-0976fca849e9'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:49.961077 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '981e5528cfa14250bd97e8b622b66f27', 'request_id': 'req-33f7fa32-f36b-4657-bf44-0976fca849e9'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:49.969285 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '981e5528cfa14250bd97e8b622b66f27', 'request_id': 'req-33f7fa32-f36b-4657-bf44-0976fca849e9'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:49.980229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] The token cache is being invalidate because project 981e5528cfa14250bd97e8b622b66f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:16:49.980595 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:49.981399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:49.983147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1307/2599] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:16:49 2022] DELETE /identity/v3/projects/981e5528cfa14250bd97e8b622b66f27 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:49.987150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:49.988500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:49.993556 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebbe57-4842-43ad-88d6-e52356b1a22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:49.994117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebbe57-4842-43ad-88d6-e52356b1a22e service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:49.994398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebbe57-4842-43ad-88d6-e52356b1a22e service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:49.994680 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebbe57-4842-43ad-88d6-e52356b1a22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:49.996474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-afebbe57-4842-43ad-88d6-e52356b1a22e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:50.058528 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7fa32-f36b-4657-bf44-0976fca849e9 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:50.064393 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a80a3-72b7-4864-bbd6-175d6a89aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:50.065131 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a80a3-72b7-4864-bbd6-175d6a89aab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:50.065423 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a80a3-72b7-4864-bbd6-175d6a89aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:50.065700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a80a3-72b7-4864-bbd6-175d6a89aab4 admin admin] PATH_INFO: `/v3/users/4dc152db1901484998383f6fac7c91ad` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:50.066917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a80a3-72b7-4864-bbd6-175d6a89aab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc152db1901484998383f6fac7c91ad)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:50.068089 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebbe57-4842-43ad-88d6-e52356b1a22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:50.068860 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a80a3-72b7-4864-bbd6-175d6a89aab4 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:50.069516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebbe57-4842-43ad-88d6-e52356b1a22e service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:50.080787 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1293/2600] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:16:50.124918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cd5a80a3-72b7-4864-bbd6-175d6a89aab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc152db1901484998383f6fac7c91ad'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:50.133303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cd5a80a3-72b7-4864-bbd6-175d6a89aab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc152db1901484998383f6fac7c91ad'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:50.134233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cd5a80a3-72b7-4864-bbd6-175d6a89aab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc152db1901484998383f6fac7c91ad'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:50.135557 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cd5a80a3-72b7-4864-bbd6-175d6a89aab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc152db1901484998383f6fac7c91ad'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:50.151078 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:50.152399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-cd5a80a3-72b7-4864-bbd6-175d6a89aab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc152db1901484998383f6fac7c91ad'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:50.170070 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1308/2601] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:16:49 2022] DELETE /identity/v3/users/4dc152db1901484998383f6fac7c91ad => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:50.460987 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebbe57-4842-43ad-88d6-e52356b1a22e service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:50.473695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebbe57-4842-43ad-88d6-e52356b1a22e service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:50.557584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:50.558146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:50.558431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:50.558713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f admin admin] PATH_INFO: `/v3/projects/657db613c4014a57b7820fa926f05428` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:50.560166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=657db613c4014a57b7820fa926f05428)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:50.562372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:50.570576 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=100 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:50.617534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657db613c4014a57b7820fa926f05428', 'request_id': 'req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:50.623764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657db613c4014a57b7820fa926f05428', 'request_id': 'req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:50.632203 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657db613c4014a57b7820fa926f05428', 'request_id': 'req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:50.644867 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f admin admin] The token cache is being invalidate because project 657db613c4014a57b7820fa926f05428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:16:50.645160 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:50.645827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b2b68177-7ced-4a7a-a53f-0e2dda57ad1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:50.647543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1294/2602] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:16:50 2022] DELETE /identity/v3/projects/657db613c4014a57b7820fa926f05428 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:50.652527 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d033f-fd1f-4377-baf3-6b5f4ec3c07e None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:50.654075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d033f-fd1f-4377-baf3-6b5f4ec3c07e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:50.654376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d033f-fd1f-4377-baf3-6b5f4ec3c07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:50.675893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ff8d033f-fd1f-4377-baf3-6b5f4ec3c07e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:50.677125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ff8d033f-fd1f-4377-baf3-6b5f4ec3c07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:50.744161 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1309/2603] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:16:50.753748 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13302844-ab52-48d0-8ce5-508d36039493 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:50.754133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13302844-ab52-48d0-8ce5-508d36039493 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:50.754439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13302844-ab52-48d0-8ce5-508d36039493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:50.776624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-13302844-ab52-48d0-8ce5-508d36039493 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:50.777900 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-13302844-ab52-48d0-8ce5-508d36039493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:50.787175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1295/2604] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:16:50.791509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d033f-fd1f-4377-baf3-6b5f4ec3c07e None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:50.801685 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d033f-fd1f-4377-baf3-6b5f4ec3c07e None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:50.806307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d3c09-4142-4d82-8a7d-3d37a396b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:50.806963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3c09-4142-4d82-8a7d-3d37a396b6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:50.807241 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3c09-4142-4d82-8a7d-3d37a396b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:50.807515 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3c09-4142-4d82-8a7d-3d37a396b6aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:50.808215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d3c09-4142-4d82-8a7d-3d37a396b6aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:16:50.808469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d3c09-4142-4d82-8a7d-3d37a396b6aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:50.810763 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d3c09-4142-4d82-8a7d-3d37a396b6aa admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:50.823398 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1310/2605] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:16:50.828206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13302844-ab52-48d0-8ce5-508d36039493 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:50.837705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13302844-ab52-48d0-8ce5-508d36039493 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:50.842557 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d0f7a-d8d8-4fdb-b54e-9409cc5aabf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:50.843188 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0f7a-d8d8-4fdb-b54e-9409cc5aabf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:50.843560 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0f7a-d8d8-4fdb-b54e-9409cc5aabf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:50.843829 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0f7a-d8d8-4fdb-b54e-9409cc5aabf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:50.844496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d0f7a-d8d8-4fdb-b54e-9409cc5aabf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:50.846382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d0f7a-d8d8-4fdb-b54e-9409cc5aabf3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:50.876229 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1296/2606] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:16:50 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:50.880482 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d3c09-4142-4d82-8a7d-3d37a396b6aa admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:50.891152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d3c09-4142-4d82-8a7d-3d37a396b6aa admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:50.951067 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d6a5e-5f81-4b61-810a-5fb0c42cf614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:50.951696 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d6a5e-5f81-4b61-810a-5fb0c42cf614 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:50.952380 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d6a5e-5f81-4b61-810a-5fb0c42cf614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:50.952380 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d6a5e-5f81-4b61-810a-5fb0c42cf614 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:50.952910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d6a5e-5f81-4b61-810a-5fb0c42cf614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:50.954875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d6a5e-5f81-4b61-810a-5fb0c42cf614 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:50.982316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1311/2607] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:16:50 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:50.983613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d0f7a-d8d8-4fdb-b54e-9409cc5aabf3 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:50.994437 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d0f7a-d8d8-4fdb-b54e-9409cc5aabf3 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:51.000498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca94329-8b1d-4d39-a8fa-635248a32d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:51.001485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94329-8b1d-4d39-a8fa-635248a32d7e admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:51.001803 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94329-8b1d-4d39-a8fa-635248a32d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:51.002087 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94329-8b1d-4d39-a8fa-635248a32d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:51.002764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca94329-8b1d-4d39-a8fa-635248a32d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:51.004633 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca94329-8b1d-4d39-a8fa-635248a32d7e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:51.015828 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1297/2608] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:51.020127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d6a5e-5f81-4b61-810a-5fb0c42cf614 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:51.036663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d6a5e-5f81-4b61-810a-5fb0c42cf614 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:51.042584 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442cf79-ed2f-4412-afed-490532dd71b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:51.043313 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442cf79-ed2f-4412-afed-490532dd71b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:51.043548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442cf79-ed2f-4412-afed-490532dd71b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:51.043845 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442cf79-ed2f-4412-afed-490532dd71b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:51.044617 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442cf79-ed2f-4412-afed-490532dd71b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:51.048364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442cf79-ed2f-4412-afed-490532dd71b4 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:51.061287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1312/2609] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:51.065923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca94329-8b1d-4d39-a8fa-635248a32d7e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:51.077359 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca94329-8b1d-4d39-a8fa-635248a32d7e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:51.084319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91095683-fc27-433a-8333-55d6b00bef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:51.085282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91095683-fc27-433a-8333-55d6b00bef13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:51.085657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91095683-fc27-433a-8333-55d6b00bef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:51.085996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91095683-fc27-433a-8333-55d6b00bef13 admin admin] PATH_INFO: `/v3/projects/24a7e8cec9da491493448c2621ecc7ec/users/e8e06b87336d4d7d9a467fff96a65d2b/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:51.109534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91095683-fc27-433a-8333-55d6b00bef13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a7e8cec9da491493448c2621ecc7ec, user_id=e8e06b87336d4d7d9a467fff96a65d2b, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:51.112258 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91095683-fc27-433a-8333-55d6b00bef13 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:51.128006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1298/2610] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:51 2022] PUT /identity/v3/projects/24a7e8cec9da491493448c2621ecc7ec/users/e8e06b87336d4d7d9a467fff96a65d2b/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:51.139977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e08e2-1f18-409b-8d15-993ee3a4124c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:51.140205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e08e2-1f18-409b-8d15-993ee3a4124c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:51.140494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e08e2-1f18-409b-8d15-993ee3a4124c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:51.171456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-b82e08e2-1f18-409b-8d15-993ee3a4124c None None] MFA Rules not processed for user `e8e06b87336d4d7d9a467fff96a65d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:51.172792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-b82e08e2-1f18-409b-8d15-993ee3a4124c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:51.227903 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:51.269818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1313/2611] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:51.275537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91095683-fc27-433a-8333-55d6b00bef13 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:51.386875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91095683-fc27-433a-8333-55d6b00bef13 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:51.392404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5b45-1a4e-474a-9646-3c5cdd2fc388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:51.393040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5b45-1a4e-474a-9646-3c5cdd2fc388 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:51.393320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5b45-1a4e-474a-9646-3c5cdd2fc388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:51.393600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5b45-1a4e-474a-9646-3c5cdd2fc388 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:51.394247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e5b45-1a4e-474a-9646-3c5cdd2fc388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:51.396435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e5b45-1a4e-474a-9646-3c5cdd2fc388 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:51.436454 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1299/2612] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:16:51 2022] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:51.438412 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e08e2-1f18-409b-8d15-993ee3a4124c None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:51.454239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e08e2-1f18-409b-8d15-993ee3a4124c None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:51.527090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57105806-3bb1-427b-b61f-7406ac7580ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:51.527753 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57105806-3bb1-427b-b61f-7406ac7580ed admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:51.528706 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57105806-3bb1-427b-b61f-7406ac7580ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:51.529197 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57105806-3bb1-427b-b61f-7406ac7580ed admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:51.530034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57105806-3bb1-427b-b61f-7406ac7580ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:51.539909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57105806-3bb1-427b-b61f-7406ac7580ed admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:51.567072 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1314/2613] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:16:51 2022] POST /identity/v3/users => generated 301 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:16:51.568270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5b45-1a4e-474a-9646-3c5cdd2fc388 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:51.579045 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5b45-1a4e-474a-9646-3c5cdd2fc388 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:51.584170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29d0d8-08f9-4f24-b099-81bfa18f702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:51.584791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29d0d8-08f9-4f24-b099-81bfa18f702c admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:51.585077 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29d0d8-08f9-4f24-b099-81bfa18f702c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:51.585354 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29d0d8-08f9-4f24-b099-81bfa18f702c admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:51.586043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29d0d8-08f9-4f24-b099-81bfa18f702c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:51.587698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29d0d8-08f9-4f24-b099-81bfa18f702c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:51.599883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1300/2614] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:16:51.604335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57105806-3bb1-427b-b61f-7406ac7580ed admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:51.616498 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57105806-3bb1-427b-b61f-7406ac7580ed admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:51.621302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b4d0c-34e1-4445-9897-d8a12df96b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:51.622014 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b4d0c-34e1-4445-9897-d8a12df96b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:51.622299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b4d0c-34e1-4445-9897-d8a12df96b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:51.622582 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b4d0c-34e1-4445-9897-d8a12df96b99 admin admin] PATH_INFO: `/v3/projects/91d3a925a95141749e0216be1adf2ffa/users/4ebf51f902ed473d826dec5bbe7a658e/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:51.639181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b4d0c-34e1-4445-9897-d8a12df96b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d3a925a95141749e0216be1adf2ffa, user_id=4ebf51f902ed473d826dec5bbe7a658e, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:51.641899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b4d0c-34e1-4445-9897-d8a12df96b99 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:51.657086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1315/2615] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:51 2022] PUT /identity/v3/projects/91d3a925a95141749e0216be1adf2ffa/users/4ebf51f902ed473d826dec5bbe7a658e/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:51.661143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29d0d8-08f9-4f24-b099-81bfa18f702c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:51.669631 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:51.673328 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29d0d8-08f9-4f24-b099-81bfa18f702c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:51.746688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0c3bc-26a6-4ca4-a409-a388fbdfb4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:51.747657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0c3bc-26a6-4ca4-a409-a388fbdfb4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:51.747943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0c3bc-26a6-4ca4-a409-a388fbdfb4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:51.748221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0c3bc-26a6-4ca4-a409-a388fbdfb4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:51.748889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0c3bc-26a6-4ca4-a409-a388fbdfb4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:51.750524 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0c3bc-26a6-4ca4-a409-a388fbdfb4e8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:51.766533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1301/2616] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:51.767874 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b4d0c-34e1-4445-9897-d8a12df96b99 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:51.779943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b4d0c-34e1-4445-9897-d8a12df96b99 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:51.785126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8a559-a363-4b8e-9f51-d973d8efa30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:51.785797 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8a559-a363-4b8e-9f51-d973d8efa30d admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:51.786074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8a559-a363-4b8e-9f51-d973d8efa30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:51.786346 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8a559-a363-4b8e-9f51-d973d8efa30d admin admin] PATH_INFO: `/v3/projects/91d3a925a95141749e0216be1adf2ffa/users/4ebf51f902ed473d826dec5bbe7a658e/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:51.788327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8a559-a363-4b8e-9f51-d973d8efa30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d3a925a95141749e0216be1adf2ffa, user_id=4ebf51f902ed473d826dec5bbe7a658e, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:51.791080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8a559-a363-4b8e-9f51-d973d8efa30d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:51.803501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1316/2617] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:51 2022] PUT /identity/v3/projects/91d3a925a95141749e0216be1adf2ffa/users/4ebf51f902ed473d826dec5bbe7a658e/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:51.815001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d05024-d58c-4402-aa98-110c4dd9add1 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:51.815308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d05024-d58c-4402-aa98-110c4dd9add1 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:51.815468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d05024-d58c-4402-aa98-110c4dd9add1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:51.846374 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-65d05024-d58c-4402-aa98-110c4dd9add1 None None] MFA Rules not processed for user `4ebf51f902ed473d826dec5bbe7a658e`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:51.847373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-65d05024-d58c-4402-aa98-110c4dd9add1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:51.930178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1302/2618] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:16:51.941633 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8a559-a363-4b8e-9f51-d973d8efa30d admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:51.943530 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-98f8a559-a363-4b8e-9f51-d973d8efa30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:52.028816 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8a559-a363-4b8e-9f51-d973d8efa30d admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:52.033757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb68bd4-5ce9-4d70-9013-0868380ee4f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:52.034471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb68bd4-5ce9-4d70-9013-0868380ee4f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:52.035024 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb68bd4-5ce9-4d70-9013-0868380ee4f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:52.035386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb68bd4-5ce9-4d70-9013-0868380ee4f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:52.051808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb68bd4-5ce9-4d70-9013-0868380ee4f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:52.053295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb68bd4-5ce9-4d70-9013-0868380ee4f9 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:52.066028 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1317/2619] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:51 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:16:52.224810 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d05024-d58c-4402-aa98-110c4dd9add1 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:52.305808 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d05024-d58c-4402-aa98-110c4dd9add1 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:52.311855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:52.312528 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:52.312811 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:52.313093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] PATH_INFO: `/v3/users/e8e06b87336d4d7d9a467fff96a65d2b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:52.314279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e06b87336d4d7d9a467fff96a65d2b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:52.316265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:52.360854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:52.402206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e06b87336d4d7d9a467fff96a65d2b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:52.428567 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e06b87336d4d7d9a467fff96a65d2b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:52.441204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e06b87336d4d7d9a467fff96a65d2b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:52.442217 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e06b87336d4d7d9a467fff96a65d2b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:52.443060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e06b87336d4d7d9a467fff96a65d2b'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:52.463089 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1303/2620] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:16:52 2022] DELETE /identity/v3/users/e8e06b87336d4d7d9a467fff96a65d2b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:52.469011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4f675-c7be-4e7a-a939-6d02830f4a41 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:52.469539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4f675-c7be-4e7a-a939-6d02830f4a41 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:52.470350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4f675-c7be-4e7a-a939-6d02830f4a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:52.500462 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-37a4f675-c7be-4e7a-a939-6d02830f4a41 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:52.502534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-37a4f675-c7be-4e7a-a939-6d02830f4a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:52.567665 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:52.609413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1318/2621] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:16:52.620682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:52.622631 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:52.684934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f81ad-0bf3-438f-a92b-9807c3680c25 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:52.688541 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cb74f-71b8-464e-944d-f8e67325cb87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:52.689158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cb74f-71b8-464e-944d-f8e67325cb87 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:52.689439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cb74f-71b8-464e-944d-f8e67325cb87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:52.689713 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cb74f-71b8-464e-944d-f8e67325cb87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:52.700097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cb74f-71b8-464e-944d-f8e67325cb87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:52.702110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cb74f-71b8-464e-944d-f8e67325cb87 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:52.712428 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1304/2622] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:16:53.204344 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4f675-c7be-4e7a-a939-6d02830f4a41 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:53.205818 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-37a4f675-c7be-4e7a-a939-6d02830f4a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:53.219422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4f675-c7be-4e7a-a939-6d02830f4a41 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:53.224798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:53.225458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:53.225757 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:53.226017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] PATH_INFO: `/v3/projects/24a7e8cec9da491493448c2621ecc7ec` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:53.228335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a7e8cec9da491493448c2621ecc7ec)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:53.229194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:53.296220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a7e8cec9da491493448c2621ecc7ec', 'request_id': 'req-f3727579-2a36-4ba7-870f-247ac8ca3737'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:53.315691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a7e8cec9da491493448c2621ecc7ec', 'request_id': 'req-f3727579-2a36-4ba7-870f-247ac8ca3737'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:53.326296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a7e8cec9da491493448c2621ecc7ec', 'request_id': 'req-f3727579-2a36-4ba7-870f-247ac8ca3737'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:53.345010 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] The token cache is being invalidate because project 24a7e8cec9da491493448c2621ecc7ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:16:53.345449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:53.346124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:53.347963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1319/2623] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:16:53 2022] DELETE /identity/v3/projects/24a7e8cec9da491493448c2621ecc7ec => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:53.351905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cb74f-71b8-464e-944d-f8e67325cb87 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:53.364288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cb74f-71b8-464e-944d-f8e67325cb87 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:53.449421 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:53.450678 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:53.451198 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:53.451541 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] PATH_INFO: `/v3/users/4ebf51f902ed473d826dec5bbe7a658e` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:53.455637 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ebf51f902ed473d826dec5bbe7a658e)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:53.464552 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:53.545698 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ebf51f902ed473d826dec5bbe7a658e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:53.555724 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:53.569485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ebf51f902ed473d826dec5bbe7a658e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:53.583740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ebf51f902ed473d826dec5bbe7a658e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:53.584976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ebf51f902ed473d826dec5bbe7a658e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:53.586151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ebf51f902ed473d826dec5bbe7a658e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:53.606420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1305/2624] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:16:53 2022] DELETE /identity/v3/users/4ebf51f902ed473d826dec5bbe7a658e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:53.853859 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:53.858883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:53.876581 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3727579-2a36-4ba7-870f-247ac8ca3737 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:53.942205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a6dfa-994b-44ea-bc3c-5c0b1337f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:53.944030 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a6dfa-994b-44ea-bc3c-5c0b1337f236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:53.944253 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a6dfa-994b-44ea-bc3c-5c0b1337f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:53.944943 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a6dfa-994b-44ea-bc3c-5c0b1337f236 admin admin] PATH_INFO: `/v3/users/32bc4cb848c446ab8d4d330f9e2f0022` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:53.947575 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a6dfa-994b-44ea-bc3c-5c0b1337f236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32bc4cb848c446ab8d4d330f9e2f0022)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:53.950038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a6dfa-994b-44ea-bc3c-5c0b1337f236 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:53.969304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:53.971934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:53.998509 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ee0f9-04db-442f-bc0a-10b3caa2d9a4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.005009 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b36ffc-5aa9-4b70-93fe-441550865278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.006067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b36ffc-5aa9-4b70-93fe-441550865278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.006571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b36ffc-5aa9-4b70-93fe-441550865278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.006960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b36ffc-5aa9-4b70-93fe-441550865278 admin admin] PATH_INFO: `/v3/projects/91d3a925a95141749e0216be1adf2ffa` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.008278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b36ffc-5aa9-4b70-93fe-441550865278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d3a925a95141749e0216be1adf2ffa)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.010454 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-9c7a6dfa-994b-44ea-bc3c-5c0b1337f236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32bc4cb848c446ab8d4d330f9e2f0022'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.011244 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b36ffc-5aa9-4b70-93fe-441550865278 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.020612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-9c7a6dfa-994b-44ea-bc3c-5c0b1337f236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32bc4cb848c446ab8d4d330f9e2f0022'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.021314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-9c7a6dfa-994b-44ea-bc3c-5c0b1337f236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32bc4cb848c446ab8d4d330f9e2f0022'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.021938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-9c7a6dfa-994b-44ea-bc3c-5c0b1337f236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32bc4cb848c446ab8d4d330f9e2f0022'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.029716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:54.038060 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-9c7a6dfa-994b-44ea-bc3c-5c0b1337f236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32bc4cb848c446ab8d4d330f9e2f0022'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.052739 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1320/2625] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:16:53 2022] DELETE /identity/v3/users/32bc4cb848c446ab8d4d330f9e2f0022 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:54.071124 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e1b36ffc-5aa9-4b70-93fe-441550865278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d3a925a95141749e0216be1adf2ffa', 'request_id': 'req-e1b36ffc-5aa9-4b70-93fe-441550865278'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.077995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e1b36ffc-5aa9-4b70-93fe-441550865278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d3a925a95141749e0216be1adf2ffa', 'request_id': 'req-e1b36ffc-5aa9-4b70-93fe-441550865278'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.085863 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e1b36ffc-5aa9-4b70-93fe-441550865278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d3a925a95141749e0216be1adf2ffa', 'request_id': 'req-e1b36ffc-5aa9-4b70-93fe-441550865278'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.097966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e1b36ffc-5aa9-4b70-93fe-441550865278 admin admin] The token cache is being invalidate because project 91d3a925a95141749e0216be1adf2ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:16:54.098262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e1b36ffc-5aa9-4b70-93fe-441550865278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.098938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e1b36ffc-5aa9-4b70-93fe-441550865278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.100438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1306/2626] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:16:53 2022] DELETE /identity/v3/projects/91d3a925a95141749e0216be1adf2ffa => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:54.105268 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5af9b9-0413-4ce9-a0b7-aa37758c575d None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.105564 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5af9b9-0413-4ce9-a0b7-aa37758c575d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.105890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5af9b9-0413-4ce9-a0b7-aa37758c575d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.126787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-4b5af9b9-0413-4ce9-a0b7-aa37758c575d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:54.128024 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4b5af9b9-0413-4ce9-a0b7-aa37758c575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:54.191194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1321/2627] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:54.198965 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7f44d-7c16-48e1-a251-4ae15c62690e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.199264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7f44d-7c16-48e1-a251-4ae15c62690e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.199576 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7f44d-7c16-48e1-a251-4ae15c62690e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.227494 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d8d7f44d-7c16-48e1-a251-4ae15c62690e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:54.229585 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d8d7f44d-7c16-48e1-a251-4ae15c62690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:54.243105 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1307/2628] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:54.248865 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5af9b9-0413-4ce9-a0b7-aa37758c575d None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.260536 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5af9b9-0413-4ce9-a0b7-aa37758c575d None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.263445 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7f44d-7c16-48e1-a251-4ae15c62690e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.265104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d8d7f44d-7c16-48e1-a251-4ae15c62690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:54.267738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0523aa-4386-4c4e-a040-a59605de3231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.268564 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0523aa-4386-4c4e-a040-a59605de3231 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.269008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0523aa-4386-4c4e-a040-a59605de3231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.269456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0523aa-4386-4c4e-a040-a59605de3231 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.270127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0523aa-4386-4c4e-a040-a59605de3231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:16:54.270439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0523aa-4386-4c4e-a040-a59605de3231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.272362 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0523aa-4386-4c4e-a040-a59605de3231 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.281890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7f44d-7c16-48e1-a251-4ae15c62690e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.287573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49451174-271e-4d44-b265-7be14ca5857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.288227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49451174-271e-4d44-b265-7be14ca5857a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.290785 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49451174-271e-4d44-b265-7be14ca5857a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.290785 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49451174-271e-4d44-b265-7be14ca5857a admin admin] PATH_INFO: `/v3/projects/9e57baaa87ad42dd9f48e4bfe8ee4cf5` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.291512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1322/2629] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 21:16:54.291726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49451174-271e-4d44-b265-7be14ca5857a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e57baaa87ad42dd9f48e4bfe8ee4cf5)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.292153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49451174-271e-4d44-b265-7be14ca5857a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.294268 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0523aa-4386-4c4e-a040-a59605de3231 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.305780 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0523aa-4386-4c4e-a040-a59605de3231 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.312411 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f19c0-b133-4144-949c-e489ef78cabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.314240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f19c0-b133-4144-949c-e489ef78cabf admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.314240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f19c0-b133-4144-949c-e489ef78cabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.314240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f19c0-b133-4144-949c-e489ef78cabf admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.314567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f19c0-b133-4144-949c-e489ef78cabf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.316367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f19c0-b133-4144-949c-e489ef78cabf admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.347031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-49451174-271e-4d44-b265-7be14ca5857a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e57baaa87ad42dd9f48e4bfe8ee4cf5', 'request_id': 'req-49451174-271e-4d44-b265-7be14ca5857a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.353121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-49451174-271e-4d44-b265-7be14ca5857a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e57baaa87ad42dd9f48e4bfe8ee4cf5', 'request_id': 'req-49451174-271e-4d44-b265-7be14ca5857a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.363048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-49451174-271e-4d44-b265-7be14ca5857a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e57baaa87ad42dd9f48e4bfe8ee4cf5', 'request_id': 'req-49451174-271e-4d44-b265-7be14ca5857a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.363929 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1323/2630] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:16:54 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:54.368037 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f19c0-b133-4144-949c-e489ef78cabf admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.379184 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-49451174-271e-4d44-b265-7be14ca5857a admin admin] The token cache is being invalidate because project 9e57baaa87ad42dd9f48e4bfe8ee4cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:16:54.379418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-49451174-271e-4d44-b265-7be14ca5857a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.380056 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-49451174-271e-4d44-b265-7be14ca5857a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:54.381935 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1308/2631] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:16:54 2022] DELETE /identity/v3/projects/9e57baaa87ad42dd9f48e4bfe8ee4cf5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:54.388328 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc363363-8a62-4f73-94d9-ca40641ef3c4 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.388855 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc363363-8a62-4f73-94d9-ca40641ef3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.389336 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc363363-8a62-4f73-94d9-ca40641ef3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.412838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-fc363363-8a62-4f73-94d9-ca40641ef3c4 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:54.413982 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fc363363-8a62-4f73-94d9-ca40641ef3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:54.440043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:54.443777 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f19c0-b133-4144-949c-e489ef78cabf admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.448934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6329977-2825-4d28-bf63-1478e3675b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.450169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329977-2825-4d28-bf63-1478e3675b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.450458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329977-2825-4d28-bf63-1478e3675b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.451239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329977-2825-4d28-bf63-1478e3675b44 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.451648 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6329977-2825-4d28-bf63-1478e3675b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.453700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6329977-2825-4d28-bf63-1478e3675b44 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.481449 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1324/2632] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:16:54 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:16:54.486872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6329977-2825-4d28-bf63-1478e3675b44 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.488677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f6329977-2825-4d28-bf63-1478e3675b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:54.495153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1309/2633] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:54.504680 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d76d93-06e8-4ae5-9b89-214cf2b4d26d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.504970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d76d93-06e8-4ae5-9b89-214cf2b4d26d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.505248 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d76d93-06e8-4ae5-9b89-214cf2b4d26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.506331 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6329977-2825-4d28-bf63-1478e3675b44 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.511100 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ea883-50ee-496a-b606-fb18bee45474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.511720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea883-50ee-496a-b606-fb18bee45474 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.512005 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea883-50ee-496a-b606-fb18bee45474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.512469 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea883-50ee-496a-b606-fb18bee45474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.513187 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ea883-50ee-496a-b606-fb18bee45474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.514872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ea883-50ee-496a-b606-fb18bee45474 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.527144 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c2d76d93-06e8-4ae5-9b89-214cf2b4d26d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:54.529980 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c2d76d93-06e8-4ae5-9b89-214cf2b4d26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:54.531701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1325/2634] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:16:54.535563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ea883-50ee-496a-b606-fb18bee45474 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.544269 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1310/2635] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:16:54.546727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d76d93-06e8-4ae5-9b89-214cf2b4d26d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.551476 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ea883-50ee-496a-b606-fb18bee45474 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.558989 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e00a8-88b4-441c-b62a-abf12dcc7ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.560227 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e00a8-88b4-441c-b62a-abf12dcc7ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.560721 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e00a8-88b4-441c-b62a-abf12dcc7ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.561079 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e00a8-88b4-441c-b62a-abf12dcc7ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.561875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e00a8-88b4-441c-b62a-abf12dcc7ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.563789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e00a8-88b4-441c-b62a-abf12dcc7ac9 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.566985 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d76d93-06e8-4ae5-9b89-214cf2b4d26d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.580156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db55d6d-5844-446a-84d3-05becbab52c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.581127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db55d6d-5844-446a-84d3-05becbab52c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.581618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db55d6d-5844-446a-84d3-05becbab52c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.583519 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1326/2636] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:16:54.586439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db55d6d-5844-446a-84d3-05becbab52c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.588373 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db55d6d-5844-446a-84d3-05becbab52c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:16:54.588568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db55d6d-5844-446a-84d3-05becbab52c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.590983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e00a8-88b4-441c-b62a-abf12dcc7ac9 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.595348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db55d6d-5844-446a-84d3-05becbab52c7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.604425 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e00a8-88b4-441c-b62a-abf12dcc7ac9 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.611802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af7738-2715-4340-bd93-b62428172ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.612586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af7738-2715-4340-bd93-b62428172ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.612948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af7738-2715-4340-bd93-b62428172ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.613316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af7738-2715-4340-bd93-b62428172ab2 admin admin] PATH_INFO: `/v3/projects/a233385cdf2148b8ac0e8e2f01caf453/users/df40723ba2fb4208b5782436a0c15c22/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.626650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1311/2637] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:16:54.627811 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:54.631319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db55d6d-5844-446a-84d3-05becbab52c7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.634206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af7738-2715-4340-bd93-b62428172ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a233385cdf2148b8ac0e8e2f01caf453, user_id=df40723ba2fb4208b5782436a0c15c22, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.638003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af7738-2715-4340-bd93-b62428172ab2 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.645216 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db55d6d-5844-446a-84d3-05becbab52c7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.651192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb94a62-0550-4d24-bb86-3ca746db2522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.651974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb94a62-0550-4d24-bb86-3ca746db2522 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.652335 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb94a62-0550-4d24-bb86-3ca746db2522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.653299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb94a62-0550-4d24-bb86-3ca746db2522 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.654659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb94a62-0550-4d24-bb86-3ca746db2522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.657054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb94a62-0550-4d24-bb86-3ca746db2522 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.657666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1327/2638] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:54 2022] PUT /identity/v3/projects/a233385cdf2148b8ac0e8e2f01caf453/users/df40723ba2fb4208b5782436a0c15c22/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:54.668321 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b116ce-3cfa-49da-853f-e1af6c14f78e None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.670053 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b116ce-3cfa-49da-853f-e1af6c14f78e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.670053 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b116ce-3cfa-49da-853f-e1af6c14f78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.699162 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1312/2639] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:16:54 2022] POST /identity/v3/projects => generated 391 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:54.711013 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-91b116ce-3cfa-49da-853f-e1af6c14f78e None None] MFA Rules not processed for user `df40723ba2fb4208b5782436a0c15c22`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:54.712796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb94a62-0550-4d24-bb86-3ca746db2522 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.713039 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-91b116ce-3cfa-49da-853f-e1af6c14f78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:54.791388 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1328/2640] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:54.796947 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b116ce-3cfa-49da-853f-e1af6c14f78e None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.797998 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb94a62-0550-4d24-bb86-3ca746db2522 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.802819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932874a-f8f0-4ce4-9d38-1b76f2bf8548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.803591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932874a-f8f0-4ce4-9d38-1b76f2bf8548 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.803878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932874a-f8f0-4ce4-9d38-1b76f2bf8548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.804153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932874a-f8f0-4ce4-9d38-1b76f2bf8548 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.804796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932874a-f8f0-4ce4-9d38-1b76f2bf8548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.806765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932874a-f8f0-4ce4-9d38-1b76f2bf8548 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.808429 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b116ce-3cfa-49da-853f-e1af6c14f78e None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.814652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ff8ba-db8e-4f32-94fc-d11e147c4270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.815387 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ff8ba-db8e-4f32-94fc-d11e147c4270 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.815668 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ff8ba-db8e-4f32-94fc-d11e147c4270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.815940 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ff8ba-db8e-4f32-94fc-d11e147c4270 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.816605 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ff8ba-db8e-4f32-94fc-d11e147c4270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.818496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ff8ba-db8e-4f32-94fc-d11e147c4270 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.831949 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1313/2641] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:16:54 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:54.836120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932874a-f8f0-4ce4-9d38-1b76f2bf8548 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.847049 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932874a-f8f0-4ce4-9d38-1b76f2bf8548 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.851689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be4f9-3a75-41f7-aa9e-2a1d5b310edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.852296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be4f9-3a75-41f7-aa9e-2a1d5b310edd admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.852575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be4f9-3a75-41f7-aa9e-2a1d5b310edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.852896 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be4f9-3a75-41f7-aa9e-2a1d5b310edd admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.853716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52be4f9-3a75-41f7-aa9e-2a1d5b310edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.858511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1329/2642] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:16:54 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:16:54.858702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52be4f9-3a75-41f7-aa9e-2a1d5b310edd admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.859846 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ff8ba-db8e-4f32-94fc-d11e147c4270 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.867706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1314/2643] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:16:54.872145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be4f9-3a75-41f7-aa9e-2a1d5b310edd admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.883347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be4f9-3a75-41f7-aa9e-2a1d5b310edd admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.944511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ff8ba-db8e-4f32-94fc-d11e147c4270 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:54.949777 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411de1ed-a3d8-4ed2-98e0-13468771480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.950391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411de1ed-a3d8-4ed2-98e0-13468771480a admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.950959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411de1ed-a3d8-4ed2-98e0-13468771480a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.951151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411de1ed-a3d8-4ed2-98e0-13468771480a admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.951790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411de1ed-a3d8-4ed2-98e0-13468771480a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.954365 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411de1ed-a3d8-4ed2-98e0-13468771480a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.960557 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea846888-1fba-4649-888d-9dd39fa08a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:54.961183 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea846888-1fba-4649-888d-9dd39fa08a1e admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:54.961465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea846888-1fba-4649-888d-9dd39fa08a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:54.961740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea846888-1fba-4649-888d-9dd39fa08a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:54.962397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea846888-1fba-4649-888d-9dd39fa08a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:54.964078 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea846888-1fba-4649-888d-9dd39fa08a1e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:54.971419 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:54.979494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1330/2644] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:16:54 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:54.980662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1315/2645] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:16:54.984286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411de1ed-a3d8-4ed2-98e0-13468771480a admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.985473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea846888-1fba-4649-888d-9dd39fa08a1e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:54.994789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411de1ed-a3d8-4ed2-98e0-13468771480a admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.000281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea846888-1fba-4649-888d-9dd39fa08a1e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.000520 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bed05a-c846-4b89-88bc-29af34be0e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.000911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bed05a-c846-4b89-88bc-29af34be0e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.001250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bed05a-c846-4b89-88bc-29af34be0e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.001474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bed05a-c846-4b89-88bc-29af34be0e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.002107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bed05a-c846-4b89-88bc-29af34be0e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:55.003748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bed05a-c846-4b89-88bc-29af34be0e94 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:55.006344 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5bc5b-72e3-45ac-a42b-c926067a1c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.007133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5bc5b-72e3-45ac-a42b-c926067a1c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.007587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5bc5b-72e3-45ac-a42b-c926067a1c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.008200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5bc5b-72e3-45ac-a42b-c926067a1c57 admin admin] PATH_INFO: `/v3/projects/9ee26705c0e9464b973bde9b47959629/users/07ac12142c814061a1fa9daee0c66d1c/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.014872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1331/2646] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:55.019186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bed05a-c846-4b89-88bc-29af34be0e94 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:55.026771 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5bc5b-72e3-45ac-a42b-c926067a1c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee26705c0e9464b973bde9b47959629, user_id=07ac12142c814061a1fa9daee0c66d1c, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:55.029678 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bed05a-c846-4b89-88bc-29af34be0e94 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.030048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5bc5b-72e3-45ac-a42b-c926067a1c57 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:55.034517 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780ecf1-cb3d-446b-bc4a-0382dbf4fcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.035223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780ecf1-cb3d-446b-bc4a-0382dbf4fcc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.035494 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780ecf1-cb3d-446b-bc4a-0382dbf4fcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.035805 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780ecf1-cb3d-446b-bc4a-0382dbf4fcc4 admin admin] PATH_INFO: `/v3/projects/f6eaf2c7ddb849a398d1b2c3aeed813e/users/c8cf1f762df246ca8e77270ffb3347f5/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.051455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1316/2647] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:54 2022] PUT /identity/v3/projects/9ee26705c0e9464b973bde9b47959629/users/07ac12142c814061a1fa9daee0c66d1c/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:55.052621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780ecf1-cb3d-446b-bc4a-0382dbf4fcc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6eaf2c7ddb849a398d1b2c3aeed813e, user_id=c8cf1f762df246ca8e77270ffb3347f5, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:55.055418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780ecf1-cb3d-446b-bc4a-0382dbf4fcc4 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:55.063823 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab61ad-b048-49e0-8f1d-9314b3dd0f60 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.064146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab61ad-b048-49e0-8f1d-9314b3dd0f60 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.064431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab61ad-b048-49e0-8f1d-9314b3dd0f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.075099 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1332/2648] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:55 2022] PUT /identity/v3/projects/f6eaf2c7ddb849a398d1b2c3aeed813e/users/c8cf1f762df246ca8e77270ffb3347f5/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:55.079847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780ecf1-cb3d-446b-bc4a-0382dbf4fcc4 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:55.094663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:55.098543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d2ab61ad-b048-49e0-8f1d-9314b3dd0f60 None None] MFA Rules not processed for user `07ac12142c814061a1fa9daee0c66d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:55.099826 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d2ab61ad-b048-49e0-8f1d-9314b3dd0f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:55.167582 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780ecf1-cb3d-446b-bc4a-0382dbf4fcc4 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.173040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cc796-eab6-4996-abf9-85166d554529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.173680 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cc796-eab6-4996-abf9-85166d554529 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.174033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cc796-eab6-4996-abf9-85166d554529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.174308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cc796-eab6-4996-abf9-85166d554529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.174999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cc796-eab6-4996-abf9-85166d554529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:55.176638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cc796-eab6-4996-abf9-85166d554529 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:55.185657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1317/2649] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:16:55.188695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1333/2650] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:16:55.191288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cc796-eab6-4996-abf9-85166d554529 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:55.192013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab61ad-b048-49e0-8f1d-9314b3dd0f60 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:55.204080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cc796-eab6-4996-abf9-85166d554529 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.205003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab61ad-b048-49e0-8f1d-9314b3dd0f60 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.208821 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc5bf6-7965-4476-b070-784a4f28e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.209436 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5bf6-7965-4476-b070-784a4f28e6db admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.209689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b4014-8277-412b-8c90-c1ea92bd5fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.209803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5bf6-7965-4476-b070-784a4f28e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.209981 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5bf6-7965-4476-b070-784a4f28e6db admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.210357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4014-8277-412b-8c90-c1ea92bd5fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.210622 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc5bf6-7965-4476-b070-784a4f28e6db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:55.210722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4014-8277-412b-8c90-c1ea92bd5fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.210932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4014-8277-412b-8c90-c1ea92bd5fe4 admin admin] PATH_INFO: `/v3/projects/f6eaf2c7ddb849a398d1b2c3aeed813e/users/c8cf1f762df246ca8e77270ffb3347f5/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.212563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc5bf6-7965-4476-b070-784a4f28e6db admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:55.212876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b4014-8277-412b-8c90-c1ea92bd5fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6eaf2c7ddb849a398d1b2c3aeed813e, user_id=c8cf1f762df246ca8e77270ffb3347f5, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:55.216299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b4014-8277-412b-8c90-c1ea92bd5fe4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:55.227241 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1318/2651] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:55 2022] PUT /identity/v3/projects/f6eaf2c7ddb849a398d1b2c3aeed813e/users/c8cf1f762df246ca8e77270ffb3347f5/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:55.239161 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a93a1-d70d-4185-a0b7-add38f6286a3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.239474 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a93a1-d70d-4185-a0b7-add38f6286a3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.239719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a93a1-d70d-4185-a0b7-add38f6286a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.250781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1334/2652] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:16:55 2022] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:16:55.254100 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc5bf6-7965-4476-b070-784a4f28e6db admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:55.281155 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-550a93a1-d70d-4185-a0b7-add38f6286a3 None None] MFA Rules not processed for user `c8cf1f762df246ca8e77270ffb3347f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:55.282858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-550a93a1-d70d-4185-a0b7-add38f6286a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:55.333656 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc5bf6-7965-4476-b070-784a4f28e6db admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.338571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550e0ff-50fa-47cd-8353-a503f0e42396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.339221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550e0ff-50fa-47cd-8353-a503f0e42396 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.339506 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550e0ff-50fa-47cd-8353-a503f0e42396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.339782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550e0ff-50fa-47cd-8353-a503f0e42396 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.341130 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550e0ff-50fa-47cd-8353-a503f0e42396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:55.343092 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550e0ff-50fa-47cd-8353-a503f0e42396 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:55.366602 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1319/2653] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:16:55.366976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1335/2654] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:16:55 2022] POST /identity/v3/users => generated 303 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:16:55.372584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a93a1-d70d-4185-a0b7-add38f6286a3 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:55.379950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550e0ff-50fa-47cd-8353-a503f0e42396 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:55.381713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6550e0ff-50fa-47cd-8353-a503f0e42396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:55.383296 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a93a1-d70d-4185-a0b7-add38f6286a3 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.388016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470ce3e-1f0d-4ca9-9fd7-e85edd2b6a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.388618 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470ce3e-1f0d-4ca9-9fd7-e85edd2b6a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.388899 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470ce3e-1f0d-4ca9-9fd7-e85edd2b6a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.389175 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470ce3e-1f0d-4ca9-9fd7-e85edd2b6a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.389837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470ce3e-1f0d-4ca9-9fd7-e85edd2b6a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:55.391480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470ce3e-1f0d-4ca9-9fd7-e85edd2b6a08 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:55.402050 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1320/2655] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:16:55.407432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470ce3e-1f0d-4ca9-9fd7-e85edd2b6a08 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:55.417775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470ce3e-1f0d-4ca9-9fd7-e85edd2b6a08 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.423309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6147-f4a1-4e57-92ab-243bf8fbe9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.424088 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6147-f4a1-4e57-92ab-243bf8fbe9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.424416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6147-f4a1-4e57-92ab-243bf8fbe9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.424690 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6147-f4a1-4e57-92ab-243bf8fbe9a4 admin admin] PATH_INFO: `/v3/projects/bf36e154e9b84a63a3051a8a383ad0ae/users/2de4d6a25c2a4ba28ebca27fbf70ada5/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.440562 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b6147-f4a1-4e57-92ab-243bf8fbe9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf36e154e9b84a63a3051a8a383ad0ae, user_id=2de4d6a25c2a4ba28ebca27fbf70ada5, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:55.443348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b6147-f4a1-4e57-92ab-243bf8fbe9a4 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:55.458297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1321/2656] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:55 2022] PUT /identity/v3/projects/bf36e154e9b84a63a3051a8a383ad0ae/users/2de4d6a25c2a4ba28ebca27fbf70ada5/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:55.460693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550e0ff-50fa-47cd-8353-a503f0e42396 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.462067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6147-f4a1-4e57-92ab-243bf8fbe9a4 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:55.466757 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:55.496297 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:55.527409 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05507498-18c7-47b0-bba1-ddc773fd35dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.528250 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507498-18c7-47b0-bba1-ddc773fd35dc service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.528660 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507498-18c7-47b0-bba1-ddc773fd35dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.528983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507498-18c7-47b0-bba1-ddc773fd35dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.543777 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6147-f4a1-4e57-92ab-243bf8fbe9a4 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.549925 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83c995-4d5b-4fe3-965c-1021006d194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.551280 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83c995-4d5b-4fe3-965c-1021006d194c admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.551726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83c995-4d5b-4fe3-965c-1021006d194c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.552158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83c995-4d5b-4fe3-965c-1021006d194c admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.552970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83c995-4d5b-4fe3-965c-1021006d194c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:55.555461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83c995-4d5b-4fe3-965c-1021006d194c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:55.569638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1322/2657] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:16:55.573932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83c995-4d5b-4fe3-965c-1021006d194c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:55.584767 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83c995-4d5b-4fe3-965c-1021006d194c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.589710 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05507498-18c7-47b0-bba1-ddc773fd35dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:55.591435 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05507498-18c7-47b0-bba1-ddc773fd35dc service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:55.591977 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464d58f-b8d1-40b5-81aa-371cde227feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.592676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464d58f-b8d1-40b5-81aa-371cde227feb admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.592961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464d58f-b8d1-40b5-81aa-371cde227feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.593240 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464d58f-b8d1-40b5-81aa-371cde227feb admin admin] PATH_INFO: `/v3/projects/bf36e154e9b84a63a3051a8a383ad0ae/users/2de4d6a25c2a4ba28ebca27fbf70ada5/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.595499 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464d58f-b8d1-40b5-81aa-371cde227feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf36e154e9b84a63a3051a8a383ad0ae, user_id=2de4d6a25c2a4ba28ebca27fbf70ada5, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:55.598369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464d58f-b8d1-40b5-81aa-371cde227feb admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:55.608420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1336/2658] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:16:55.615553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1323/2659] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:16:55 2022] PUT /identity/v3/projects/bf36e154e9b84a63a3051a8a383ad0ae/users/2de4d6a25c2a4ba28ebca27fbf70ada5/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:16:55.639346 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f9ffb-fde0-4d60-b7a1-06a537d33607 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.639793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f9ffb-fde0-4d60-b7a1-06a537d33607 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.640164 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f9ffb-fde0-4d60-b7a1-06a537d33607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.672394 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ce3f9ffb-fde0-4d60-b7a1-06a537d33607 None None] MFA Rules not processed for user `2de4d6a25c2a4ba28ebca27fbf70ada5`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:55.673946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ce3f9ffb-fde0-4d60-b7a1-06a537d33607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:55.755638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1337/2660] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:55.772140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464d58f-b8d1-40b5-81aa-371cde227feb admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:55.840817 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464d58f-b8d1-40b5-81aa-371cde227feb admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.845163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6cfaf-fa82-4c32-897e-d6bb596ca1d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.846003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6cfaf-fa82-4c32-897e-d6bb596ca1d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.846003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6cfaf-fa82-4c32-897e-d6bb596ca1d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.847489 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6cfaf-fa82-4c32-897e-d6bb596ca1d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:55.858281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6cfaf-fa82-4c32-897e-d6bb596ca1d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:55.859769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6cfaf-fa82-4c32-897e-d6bb596ca1d5 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:55.871099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1324/2661] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:16:55.922580 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f9ffb-fde0-4d60-b7a1-06a537d33607 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:55.932962 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f9ffb-fde0-4d60-b7a1-06a537d33607 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:55.938784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596c7e5-926f-44f2-a91f-61e950010813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:55.939535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596c7e5-926f-44f2-a91f-61e950010813 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:55.939823 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596c7e5-926f-44f2-a91f-61e950010813 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:55.940149 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596c7e5-926f-44f2-a91f-61e950010813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:56.020946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596c7e5-926f-44f2-a91f-61e950010813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:56.022567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596c7e5-926f-44f2-a91f-61e950010813 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:56.038318 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1338/2662] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:16:59.583547 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6cfaf-fa82-4c32-897e-d6bb596ca1d5 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:59.686661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6cfaf-fa82-4c32-897e-d6bb596ca1d5 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:59.694246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:59.695361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:59.695874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:59.696365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] PATH_INFO: `/v3/users/07ac12142c814061a1fa9daee0c66d1c` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:59.698321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ac12142c814061a1fa9daee0c66d1c)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:16:59.702065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:16:59.759125 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:59.776245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ac12142c814061a1fa9daee0c66d1c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:59.789328 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ac12142c814061a1fa9daee0c66d1c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:59.797755 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ac12142c814061a1fa9daee0c66d1c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:59.798472 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ac12142c814061a1fa9daee0c66d1c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:59.799719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ac12142c814061a1fa9daee0c66d1c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:16:59.814252 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1325/2663] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:16:59 2022] DELETE /identity/v3/users/07ac12142c814061a1fa9daee0c66d1c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:16:59.819403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461bfc-3904-4939-82d8-f6c25d8f7c53 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:59.819959 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461bfc-3904-4939-82d8-f6c25d8f7c53 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:59.820212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461bfc-3904-4939-82d8-f6c25d8f7c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:16:59.841824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ef461bfc-3904-4939-82d8-f6c25d8f7c53 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:16:59.843100 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ef461bfc-3904-4939-82d8-f6c25d8f7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:59.847234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:59.908342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1339/2664] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:16:59.919239 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:16:59.920805 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:16:59.988055 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29162f04-4439-4100-abca-178f5796b9dd admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:16:59.991687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0a008-ce76-43a1-ab69-7c215eb317cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:16:59.992297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0a008-ce76-43a1-ab69-7c215eb317cf service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:16:59.992576 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0a008-ce76-43a1-ab69-7c215eb317cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:16:59.992850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0a008-ce76-43a1-ab69-7c215eb317cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:00.003401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0a008-ce76-43a1-ab69-7c215eb317cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:00.004837 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0a008-ce76-43a1-ab69-7c215eb317cf service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:00.016116 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1326/2665] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:00.039800 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef461bfc-3904-4939-82d8-f6c25d8f7c53 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:00.041419 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ef461bfc-3904-4939-82d8-f6c25d8f7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:00.121896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef461bfc-3904-4939-82d8-f6c25d8f7c53 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:00.125759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43207ab3-2503-43ba-9505-a9dc6188215e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:00.126448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207ab3-2503-43ba-9505-a9dc6188215e service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:00.126673 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207ab3-2503-43ba-9505-a9dc6188215e service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:00.127066 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207ab3-2503-43ba-9505-a9dc6188215e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:00.128932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-43207ab3-2503-43ba-9505-a9dc6188215e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:00.254685 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43207ab3-2503-43ba-9505-a9dc6188215e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:00.257617 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43207ab3-2503-43ba-9505-a9dc6188215e service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:00.276189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1340/2666] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:00.368650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0a008-ce76-43a1-ab69-7c215eb317cf service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:00.370629 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-8ed0a008-ce76-43a1-ab69-7c215eb317cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:00.396624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0a008-ce76-43a1-ab69-7c215eb317cf service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:00.406683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:00.407407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:00.407952 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:00.408649 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] PATH_INFO: `/v3/projects/9ee26705c0e9464b973bde9b47959629` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:00.410921 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee26705c0e9464b973bde9b47959629)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:00.414079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:00.496090 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee26705c0e9464b973bde9b47959629', 'request_id': 'req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:00.505238 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee26705c0e9464b973bde9b47959629', 'request_id': 'req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:00.515456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee26705c0e9464b973bde9b47959629', 'request_id': 'req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:00.534333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] The token cache is being invalidate because project 9ee26705c0e9464b973bde9b47959629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:17:00.535113 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:00.536342 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:00.539167 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1327/2667] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:17:00 2022] DELETE /identity/v3/projects/9ee26705c0e9464b973bde9b47959629 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:00.545458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43207ab3-2503-43ba-9505-a9dc6188215e service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:00.559450 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43207ab3-2503-43ba-9505-a9dc6188215e service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:00.637200 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83ad7c-c8d8-43dc-a244-6bb7f778eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:00.638388 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ad7c-c8d8-43dc-a244-6bb7f778eba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:00.638718 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ad7c-c8d8-43dc-a244-6bb7f778eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:00.639040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ad7c-c8d8-43dc-a244-6bb7f778eba2 admin admin] PATH_INFO: `/v3/users/2de4d6a25c2a4ba28ebca27fbf70ada5` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:00.640438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83ad7c-c8d8-43dc-a244-6bb7f778eba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de4d6a25c2a4ba28ebca27fbf70ada5)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:00.644107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83ad7c-c8d8-43dc-a244-6bb7f778eba2 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:00.644829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:00.724979 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1e83ad7c-c8d8-43dc-a244-6bb7f778eba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de4d6a25c2a4ba28ebca27fbf70ada5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:00.734591 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1e83ad7c-c8d8-43dc-a244-6bb7f778eba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de4d6a25c2a4ba28ebca27fbf70ada5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:00.735394 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1e83ad7c-c8d8-43dc-a244-6bb7f778eba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de4d6a25c2a4ba28ebca27fbf70ada5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:00.736030 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1e83ad7c-c8d8-43dc-a244-6bb7f778eba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de4d6a25c2a4ba28ebca27fbf70ada5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:00.752006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1e83ad7c-c8d8-43dc-a244-6bb7f778eba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de4d6a25c2a4ba28ebca27fbf70ada5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:00.769748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1341/2668] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:17:00 2022] DELETE /identity/v3/users/2de4d6a25c2a4ba28ebca27fbf70ada5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:01.127367 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:01.128822 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:01.146457 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee97b2-bc6d-4061-aff7-a82a1e6a05a9 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:01.193480 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:01.230120 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921854e-8816-4b33-b860-693f28c02d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:01.230953 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921854e-8816-4b33-b860-693f28c02d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:01.231210 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921854e-8816-4b33-b860-693f28c02d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:01.231485 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921854e-8816-4b33-b860-693f28c02d82 admin admin] PATH_INFO: `/v3/projects/bf36e154e9b84a63a3051a8a383ad0ae` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:01.232861 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921854e-8816-4b33-b860-693f28c02d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf36e154e9b84a63a3051a8a383ad0ae)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:01.234973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921854e-8816-4b33-b860-693f28c02d82 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:01.289510 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6921854e-8816-4b33-b860-693f28c02d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf36e154e9b84a63a3051a8a383ad0ae', 'request_id': 'req-6921854e-8816-4b33-b860-693f28c02d82'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:01.295798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6921854e-8816-4b33-b860-693f28c02d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf36e154e9b84a63a3051a8a383ad0ae', 'request_id': 'req-6921854e-8816-4b33-b860-693f28c02d82'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:01.304476 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6921854e-8816-4b33-b860-693f28c02d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf36e154e9b84a63a3051a8a383ad0ae', 'request_id': 'req-6921854e-8816-4b33-b860-693f28c02d82'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:01.318298 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6921854e-8816-4b33-b860-693f28c02d82 admin admin] The token cache is being invalidate because project bf36e154e9b84a63a3051a8a383ad0ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:17:01.318679 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6921854e-8816-4b33-b860-693f28c02d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:01.319705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6921854e-8816-4b33-b860-693f28c02d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:01.321267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1328/2669] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:17:01 2022] DELETE /identity/v3/projects/bf36e154e9b84a63a3051a8a383ad0ae => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:01.327920 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42c15f-7a5c-4e21-b67e-e4811936c6ab None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:01.328448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42c15f-7a5c-4e21-b67e-e4811936c6ab None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:01.328448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42c15f-7a5c-4e21-b67e-e4811936c6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:01.350440 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-bd42c15f-7a5c-4e21-b67e-e4811936c6ab None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:01.351926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-bd42c15f-7a5c-4e21-b67e-e4811936c6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:01.415533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1342/2670] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:01.424138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955178d0-7a20-462a-8848-8da474737bda None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:01.424424 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955178d0-7a20-462a-8848-8da474737bda None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:01.424706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955178d0-7a20-462a-8848-8da474737bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:01.446512 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-955178d0-7a20-462a-8848-8da474737bda None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:01.447848 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-955178d0-7a20-462a-8848-8da474737bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:01.456869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1329/2671] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:01.462140 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42c15f-7a5c-4e21-b67e-e4811936c6ab None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:01.472578 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42c15f-7a5c-4e21-b67e-e4811936c6ab None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:01.477504 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53400c5c-4730-4d84-87f0-f1b836305280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:01.478133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53400c5c-4730-4d84-87f0-f1b836305280 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:01.478427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53400c5c-4730-4d84-87f0-f1b836305280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:01.478707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53400c5c-4730-4d84-87f0-f1b836305280 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:01.479411 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53400c5c-4730-4d84-87f0-f1b836305280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:17:01.479715 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53400c5c-4730-4d84-87f0-f1b836305280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:01.481381 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53400c5c-4730-4d84-87f0-f1b836305280 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:01.501167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1343/2672] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 21:17:01.505942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955178d0-7a20-462a-8848-8da474737bda None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:01.516923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955178d0-7a20-462a-8848-8da474737bda None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:01.522098 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29f0f5-0d6f-496a-902c-e39baa50b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:01.522726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29f0f5-0d6f-496a-902c-e39baa50b5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:01.523043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29f0f5-0d6f-496a-902c-e39baa50b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:01.523320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29f0f5-0d6f-496a-902c-e39baa50b5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:01.523965 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29f0f5-0d6f-496a-902c-e39baa50b5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:01.525909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29f0f5-0d6f-496a-902c-e39baa50b5d7 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:01.562725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1330/2673] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:17:01 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:17:01.569408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53400c5c-4730-4d84-87f0-f1b836305280 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:01.580624 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53400c5c-4730-4d84-87f0-f1b836305280 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:01.643332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fe6d1-8329-4b89-ad76-224164f94406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:01.644050 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fe6d1-8329-4b89-ad76-224164f94406 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:01.644610 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fe6d1-8329-4b89-ad76-224164f94406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:01.644933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fe6d1-8329-4b89-ad76-224164f94406 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:01.645636 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fe6d1-8329-4b89-ad76-224164f94406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:01.647670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fe6d1-8329-4b89-ad76-224164f94406 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:01.660642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:01.677980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1344/2674] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:17:01 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:17:01.684306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29f0f5-0d6f-496a-902c-e39baa50b5d7 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:01.702775 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29f0f5-0d6f-496a-902c-e39baa50b5d7 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:01.707939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a02d-b968-4fa9-8a46-090cf8638a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:01.708562 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a02d-b968-4fa9-8a46-090cf8638a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:01.708840 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a02d-b968-4fa9-8a46-090cf8638a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:01.709119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a02d-b968-4fa9-8a46-090cf8638a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:01.709760 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492a02d-b968-4fa9-8a46-090cf8638a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:01.711398 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492a02d-b968-4fa9-8a46-090cf8638a4d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:01.723868 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1331/2675] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:17:01.728180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fe6d1-8329-4b89-ad76-224164f94406 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:01.741448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fe6d1-8329-4b89-ad76-224164f94406 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:01.747812 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e20df0-8a03-478e-a70b-11460d3f8e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:01.748441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e20df0-8a03-478e-a70b-11460d3f8e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:01.748722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e20df0-8a03-478e-a70b-11460d3f8e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:01.748992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e20df0-8a03-478e-a70b-11460d3f8e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:01.749644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e20df0-8a03-478e-a70b-11460d3f8e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:01.751273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e20df0-8a03-478e-a70b-11460d3f8e72 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:01.764665 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1345/2676] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:17:01.769402 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a02d-b968-4fa9-8a46-090cf8638a4d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:01.782488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a02d-b968-4fa9-8a46-090cf8638a4d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:01.787426 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9bca0-796c-4a2b-8e82-e11a8ab9ab05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:01.788180 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9bca0-796c-4a2b-8e82-e11a8ab9ab05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:01.788558 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9bca0-796c-4a2b-8e82-e11a8ab9ab05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:01.788844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9bca0-796c-4a2b-8e82-e11a8ab9ab05 admin admin] PATH_INFO: `/v3/projects/3e044c707e5940f4ad2fa1efb28f6e1b/users/f5afeaa79d7349f2bee94d7135622f02/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:01.806530 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9bca0-796c-4a2b-8e82-e11a8ab9ab05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e044c707e5940f4ad2fa1efb28f6e1b, user_id=f5afeaa79d7349f2bee94d7135622f02, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:01.809471 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9bca0-796c-4a2b-8e82-e11a8ab9ab05 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:01.827227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1332/2677] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:17:01 2022] PUT /identity/v3/projects/3e044c707e5940f4ad2fa1efb28f6e1b/users/f5afeaa79d7349f2bee94d7135622f02/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:01.837976 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7dfa-a810-497d-87e4-9b95fd5b8c5f None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:01.838265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7dfa-a810-497d-87e4-9b95fd5b8c5f None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:01.838547 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7dfa-a810-497d-87e4-9b95fd5b8c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:01.872322 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-222d7dfa-a810-497d-87e4-9b95fd5b8c5f None None] MFA Rules not processed for user `f5afeaa79d7349f2bee94d7135622f02`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:01.873609 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-222d7dfa-a810-497d-87e4-9b95fd5b8c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:01.964286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1346/2678] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:01.977356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9bca0-796c-4a2b-8e82-e11a8ab9ab05 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:01.979265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3ca9bca0-796c-4a2b-8e82-e11a8ab9ab05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:02.053333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9bca0-796c-4a2b-8e82-e11a8ab9ab05 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:02.057125 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb857f-cf1c-41f2-8b94-a3b2c1d6b523 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b105e7094aea9dcc7423d6205c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:02.057735 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb857f-cf1c-41f2-8b94-a3b2c1d6b523 service glance] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:02.058014 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb857f-cf1c-41f2-8b94-a3b2c1d6b523 service glance] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:02.058286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb857f-cf1c-41f2-8b94-a3b2c1d6b523 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:02.070264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb857f-cf1c-41f2-8b94-a3b2c1d6b523 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:02.071799 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb857f-cf1c-41f2-8b94-a3b2c1d6b523 service glance] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:02.083411 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1333/2679] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:05.404996 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7dfa-a810-497d-87e4-9b95fd5b8c5f None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:05.406759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-222d7dfa-a810-497d-87e4-9b95fd5b8c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:05.475352 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7dfa-a810-497d-87e4-9b95fd5b8c5f None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:05.479967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:05.481120 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:05.481407 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:05.481695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] PATH_INFO: `/v3/users/df40723ba2fb4208b5782436a0c15c22` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:05.482975 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df40723ba2fb4208b5782436a0c15c22)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:05.484960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:05.536441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df40723ba2fb4208b5782436a0c15c22'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:05.544918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df40723ba2fb4208b5782436a0c15c22'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:05.545713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df40723ba2fb4208b5782436a0c15c22'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:05.546458 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df40723ba2fb4208b5782436a0c15c22'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:05.565336 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df40723ba2fb4208b5782436a0c15c22'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:05.571125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:05.585206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1347/2680] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:17:05 2022] DELETE /identity/v3/users/df40723ba2fb4208b5782436a0c15c22 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:05.590025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3566d27-ba10-40a9-a7eb-deca49da35b2 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:05.590548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3566d27-ba10-40a9-a7eb-deca49da35b2 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:05.590548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3566d27-ba10-40a9-a7eb-deca49da35b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:05.598187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:05.613646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a3566d27-ba10-40a9-a7eb-deca49da35b2 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:05.615187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a3566d27-ba10-40a9-a7eb-deca49da35b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:05.681174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1334/2681] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:05.691858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:05.693452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:05.770085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b68680-5499-471e-99a1-dbd9fa6467e8 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:05.774138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa558fb-d4d4-48c7-8115-831ae1e5d808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:05.774792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa558fb-d4d4-48c7-8115-831ae1e5d808 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:05.775083 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa558fb-d4d4-48c7-8115-831ae1e5d808 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:05.775359 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa558fb-d4d4-48c7-8115-831ae1e5d808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:05.789029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa558fb-d4d4-48c7-8115-831ae1e5d808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:05.790658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa558fb-d4d4-48c7-8115-831ae1e5d808 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:05.802053 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1348/2682] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:17:06.142399 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3566d27-ba10-40a9-a7eb-deca49da35b2 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:06.145304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a3566d27-ba10-40a9-a7eb-deca49da35b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:06.165059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3566d27-ba10-40a9-a7eb-deca49da35b2 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:06.173051 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:06.174158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:06.174671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:06.175281 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] PATH_INFO: `/v3/projects/a233385cdf2148b8ac0e8e2f01caf453` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:06.178350 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a233385cdf2148b8ac0e8e2f01caf453)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:06.183209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:06.240632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a233385cdf2148b8ac0e8e2f01caf453', 'request_id': 'req-b496e876-e75b-4956-8fcd-02fb2efa6db6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:06.247349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a233385cdf2148b8ac0e8e2f01caf453', 'request_id': 'req-b496e876-e75b-4956-8fcd-02fb2efa6db6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:06.256340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a233385cdf2148b8ac0e8e2f01caf453', 'request_id': 'req-b496e876-e75b-4956-8fcd-02fb2efa6db6'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:06.273958 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] The token cache is being invalidate because project a233385cdf2148b8ac0e8e2f01caf453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:17:06.274261 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:06.275119 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:06.276685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1335/2683] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:17:06 2022] DELETE /identity/v3/projects/a233385cdf2148b8ac0e8e2f01caf453 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:06.281984 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa558fb-d4d4-48c7-8115-831ae1e5d808 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:06.291890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa558fb-d4d4-48c7-8115-831ae1e5d808 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:06.364051 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f22af-e7c1-4dcc-8470-97d2e2681253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:06.364698 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f22af-e7c1-4dcc-8470-97d2e2681253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:06.364982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f22af-e7c1-4dcc-8470-97d2e2681253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:06.365263 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f22af-e7c1-4dcc-8470-97d2e2681253 admin admin] PATH_INFO: `/v3/users/c8cf1f762df246ca8e77270ffb3347f5` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:06.366426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f22af-e7c1-4dcc-8470-97d2e2681253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8cf1f762df246ca8e77270ffb3347f5)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:06.368492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f22af-e7c1-4dcc-8470-97d2e2681253 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:06.426369 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-046f22af-e7c1-4dcc-8470-97d2e2681253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8cf1f762df246ca8e77270ffb3347f5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:06.436992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-046f22af-e7c1-4dcc-8470-97d2e2681253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8cf1f762df246ca8e77270ffb3347f5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:06.437838 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-046f22af-e7c1-4dcc-8470-97d2e2681253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8cf1f762df246ca8e77270ffb3347f5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:06.438581 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-046f22af-e7c1-4dcc-8470-97d2e2681253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8cf1f762df246ca8e77270ffb3347f5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:06.451960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-046f22af-e7c1-4dcc-8470-97d2e2681253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8cf1f762df246ca8e77270ffb3347f5'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:06.468165 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1349/2684] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:17:06 2022] DELETE /identity/v3/users/c8cf1f762df246ca8e77270ffb3347f5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:17:06.842503 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:06.846648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:06.861320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496e876-e75b-4956-8fcd-02fb2efa6db6 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:06.941904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:06.942551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:06.942860 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:06.943142 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e admin admin] PATH_INFO: `/v3/projects/f6eaf2c7ddb849a398d1b2c3aeed813e` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:06.944309 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6eaf2c7ddb849a398d1b2c3aeed813e)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:06.946260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:06.986307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:07.010093 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6eaf2c7ddb849a398d1b2c3aeed813e', 'request_id': 'req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:07.017516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6eaf2c7ddb849a398d1b2c3aeed813e', 'request_id': 'req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:07.029961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6eaf2c7ddb849a398d1b2c3aeed813e', 'request_id': 'req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:07.048102 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e admin admin] The token cache is being invalidate because project f6eaf2c7ddb849a398d1b2c3aeed813e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:17:07.048399 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:07.049079 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3ad5246f-9e58-46e4-94ae-4bcb9184ea3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:07.050627 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1336/2685] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:17:06 2022] DELETE /identity/v3/projects/f6eaf2c7ddb849a398d1b2c3aeed813e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:07.057034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc711e55-666f-405b-8139-178890f42085 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:07.057332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc711e55-666f-405b-8139-178890f42085 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:07.057613 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc711e55-666f-405b-8139-178890f42085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:07.080201 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-dc711e55-666f-405b-8139-178890f42085 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:07.081457 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-dc711e55-666f-405b-8139-178890f42085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:07.093095 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:07.156984 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1350/2686] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:17:07.165502 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ea32-0323-4e59-9e61-e5acd4187470 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:07.165779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ea32-0323-4e59-9e61-e5acd4187470 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:07.166137 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ea32-0323-4e59-9e61-e5acd4187470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:07.187494 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-6e28ea32-0323-4e59-9e61-e5acd4187470 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:07.188750 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-6e28ea32-0323-4e59-9e61-e5acd4187470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:07.197509 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1337/2687] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:07.202586 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc711e55-666f-405b-8139-178890f42085 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:07.212577 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc711e55-666f-405b-8139-178890f42085 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:07.218109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0d7e-dd40-442c-aefa-0868493f48d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:07.218720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0d7e-dd40-442c-aefa-0868493f48d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:07.219034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0d7e-dd40-442c-aefa-0868493f48d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:07.219308 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0d7e-dd40-442c-aefa-0868493f48d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:07.219970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a0d7e-dd40-442c-aefa-0868493f48d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:17:07.220267 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a0d7e-dd40-442c-aefa-0868493f48d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:07.221882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a0d7e-dd40-442c-aefa-0868493f48d2 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:07.235892 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1351/2688] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:17:07.241279 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28ea32-0323-4e59-9e61-e5acd4187470 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:07.258923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28ea32-0323-4e59-9e61-e5acd4187470 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:07.265365 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f610b2-de4b-49dd-b641-e42f2dd83479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:07.266013 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f610b2-de4b-49dd-b641-e42f2dd83479 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:07.266292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f610b2-de4b-49dd-b641-e42f2dd83479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:07.266590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f610b2-de4b-49dd-b641-e42f2dd83479 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:07.267306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f610b2-de4b-49dd-b641-e42f2dd83479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:07.269270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f610b2-de4b-49dd-b641-e42f2dd83479 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:07.302255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1338/2689] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:17:07 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:17:07.308992 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0d7e-dd40-442c-aefa-0868493f48d2 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:07.320104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0d7e-dd40-442c-aefa-0868493f48d2 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:07.385691 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b697e-3cbc-43b2-9a95-4f8835466f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:07.386315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b697e-3cbc-43b2-9a95-4f8835466f0a admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:07.386601 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b697e-3cbc-43b2-9a95-4f8835466f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:07.387467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b697e-3cbc-43b2-9a95-4f8835466f0a admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:07.388127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b697e-3cbc-43b2-9a95-4f8835466f0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:07.390061 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b697e-3cbc-43b2-9a95-4f8835466f0a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:07.415143 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1352/2690] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:17:07 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:17:07.420243 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f610b2-de4b-49dd-b641-e42f2dd83479 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:07.433270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f610b2-de4b-49dd-b641-e42f2dd83479 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:07.439201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94205017-b37a-4805-8302-fdb83182e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:07.439839 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94205017-b37a-4805-8302-fdb83182e1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:07.440122 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94205017-b37a-4805-8302-fdb83182e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:07.440399 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94205017-b37a-4805-8302-fdb83182e1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:07.441058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94205017-b37a-4805-8302-fdb83182e1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:07.442687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94205017-b37a-4805-8302-fdb83182e1a3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:07.459955 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1339/2691] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:17:07.464124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b697e-3cbc-43b2-9a95-4f8835466f0a admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:07.475382 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b697e-3cbc-43b2-9a95-4f8835466f0a admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:07.480215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8308e-9a66-4fe8-9024-313414c73c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:07.480939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8308e-9a66-4fe8-9024-313414c73c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:07.481236 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8308e-9a66-4fe8-9024-313414c73c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:07.481503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8308e-9a66-4fe8-9024-313414c73c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:07.482172 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8308e-9a66-4fe8-9024-313414c73c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:07.483815 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8308e-9a66-4fe8-9024-313414c73c22 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:07.495309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1353/2692] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:17:07.500699 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94205017-b37a-4805-8302-fdb83182e1a3 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:07.512746 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94205017-b37a-4805-8302-fdb83182e1a3 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:07.517726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b39612-3695-489e-b859-25db1d74ca7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:07.518403 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b39612-3695-489e-b859-25db1d74ca7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:07.518694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b39612-3695-489e-b859-25db1d74ca7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:07.519010 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b39612-3695-489e-b859-25db1d74ca7e admin admin] PATH_INFO: `/v3/projects/06f54ea53d444d75a3eca73399f33efc/users/14f7fd5fe5c64d47b107bcb9a838c697/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:07.536288 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b39612-3695-489e-b859-25db1d74ca7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f54ea53d444d75a3eca73399f33efc, user_id=14f7fd5fe5c64d47b107bcb9a838c697, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:07.539003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b39612-3695-489e-b859-25db1d74ca7e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:07.559720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1340/2693] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:17:07 2022] PUT /identity/v3/projects/06f54ea53d444d75a3eca73399f33efc/users/14f7fd5fe5c64d47b107bcb9a838c697/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:17:07.635720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bb3f5-6366-44bc-bd93-5451f9a9fccf None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:07.636034 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bb3f5-6366-44bc-bd93-5451f9a9fccf None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:07.636310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bb3f5-6366-44bc-bd93-5451f9a9fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:07.667738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-fa4bb3f5-6366-44bc-bd93-5451f9a9fccf None None] MFA Rules not processed for user `14f7fd5fe5c64d47b107bcb9a838c697`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:07.669764 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-fa4bb3f5-6366-44bc-bd93-5451f9a9fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:07.742321 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1354/2694] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:17:07.755025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b39612-3695-489e-b859-25db1d74ca7e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:07.756892 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-18b39612-3695-489e-b859-25db1d74ca7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:07.833791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b39612-3695-489e-b859-25db1d74ca7e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:07.838948 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b08356-f714-41ee-84e1-48f7dd629246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:07.839589 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b08356-f714-41ee-84e1-48f7dd629246 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:07.839964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b08356-f714-41ee-84e1-48f7dd629246 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:07.840284 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b08356-f714-41ee-84e1-48f7dd629246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:07.850807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b08356-f714-41ee-84e1-48f7dd629246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:07.852305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b08356-f714-41ee-84e1-48f7dd629246 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:07.867123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1341/2695] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:07.899261 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bb3f5-6366-44bc-bd93-5451f9a9fccf None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:07.914867 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:07.983210 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bb3f5-6366-44bc-bd93-5451f9a9fccf None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:07.988906 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:07.989726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:07.990058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:07.990452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] PATH_INFO: `/v3/users/14f7fd5fe5c64d47b107bcb9a838c697` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:07.992404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f7fd5fe5c64d47b107bcb9a838c697)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:07.996722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:08.072507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f7fd5fe5c64d47b107bcb9a838c697'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:08.087980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f7fd5fe5c64d47b107bcb9a838c697'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:08.088626 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f7fd5fe5c64d47b107bcb9a838c697'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:08.089353 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f7fd5fe5c64d47b107bcb9a838c697'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:08.104138 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f7fd5fe5c64d47b107bcb9a838c697'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:08.118600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1355/2696] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:17:07 2022] DELETE /identity/v3/users/14f7fd5fe5c64d47b107bcb9a838c697 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:08.123410 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76a740-82ec-49d0-9a90-9893c9bd8ef8 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:08.123695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76a740-82ec-49d0-9a90-9893c9bd8ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:08.123970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76a740-82ec-49d0-9a90-9893c9bd8ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:08.143942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-9f76a740-82ec-49d0-9a90-9893c9bd8ef8 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:08.145171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9f76a740-82ec-49d0-9a90-9893c9bd8ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:08.202192 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:08.218461 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1342/2697] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:08.229186 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:08.231280 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:08.301637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe77a65-8fb4-4f36-a26d-260600468fd9 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:08.305616 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add85d52-d1b6-42b7-8028-b794e7a5ee01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:08.306253 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add85d52-d1b6-42b7-8028-b794e7a5ee01 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:08.306537 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add85d52-d1b6-42b7-8028-b794e7a5ee01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:08.306848 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add85d52-d1b6-42b7-8028-b794e7a5ee01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:08.317348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add85d52-d1b6-42b7-8028-b794e7a5ee01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:08.318827 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add85d52-d1b6-42b7-8028-b794e7a5ee01 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:08.332945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1356/2698] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:08.640562 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76a740-82ec-49d0-9a90-9893c9bd8ef8 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:08.642092 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-9f76a740-82ec-49d0-9a90-9893c9bd8ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:08.659163 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76a740-82ec-49d0-9a90-9893c9bd8ef8 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:08.666347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf543b-2a83-401c-8be5-c0f30624e797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:08.667407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf543b-2a83-401c-8be5-c0f30624e797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:08.672000 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf543b-2a83-401c-8be5-c0f30624e797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:08.672397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf543b-2a83-401c-8be5-c0f30624e797 admin admin] PATH_INFO: `/v3/projects/06f54ea53d444d75a3eca73399f33efc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:08.673956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf543b-2a83-401c-8be5-c0f30624e797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f54ea53d444d75a3eca73399f33efc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:08.676030 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf543b-2a83-401c-8be5-c0f30624e797 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:08.740660 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f7cf543b-2a83-401c-8be5-c0f30624e797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f54ea53d444d75a3eca73399f33efc', 'request_id': 'req-f7cf543b-2a83-401c-8be5-c0f30624e797'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:08.747397 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f7cf543b-2a83-401c-8be5-c0f30624e797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f54ea53d444d75a3eca73399f33efc', 'request_id': 'req-f7cf543b-2a83-401c-8be5-c0f30624e797'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:08.757996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f7cf543b-2a83-401c-8be5-c0f30624e797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f54ea53d444d75a3eca73399f33efc', 'request_id': 'req-f7cf543b-2a83-401c-8be5-c0f30624e797'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:08.770872 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f7cf543b-2a83-401c-8be5-c0f30624e797 admin admin] The token cache is being invalidate because project 06f54ea53d444d75a3eca73399f33efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:17:08.771168 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f7cf543b-2a83-401c-8be5-c0f30624e797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:08.772129 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-f7cf543b-2a83-401c-8be5-c0f30624e797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:08.773645 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1343/2699] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:17:08 2022] DELETE /identity/v3/projects/06f54ea53d444d75a3eca73399f33efc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:17:08.779422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d72191-bec4-4e52-84ad-259e16970916 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:08.779914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d72191-bec4-4e52-84ad-259e16970916 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:08.780032 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d72191-bec4-4e52-84ad-259e16970916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:08.800467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-c2d72191-bec4-4e52-84ad-259e16970916 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:08.802333 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c2d72191-bec4-4e52-84ad-259e16970916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:08.834866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:08.868273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1357/2700] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:08.876791 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f64b6e-f061-4600-803e-f19c890e2759 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:08.877338 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f64b6e-f061-4600-803e-f19c890e2759 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:08.877431 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f64b6e-f061-4600-803e-f19c890e2759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:08.898372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-70f64b6e-f061-4600-803e-f19c890e2759 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:08.899638 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-70f64b6e-f061-4600-803e-f19c890e2759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:08.908019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1344/2701] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:08.912535 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d72191-bec4-4e52-84ad-259e16970916 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:08.923834 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d72191-bec4-4e52-84ad-259e16970916 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:08.928843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ee3eb-a133-41d9-b1c5-8313e3c3a657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:08.929752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ee3eb-a133-41d9-b1c5-8313e3c3a657 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:08.929752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ee3eb-a133-41d9-b1c5-8313e3c3a657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:08.930006 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ee3eb-a133-41d9-b1c5-8313e3c3a657 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:08.930664 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ee3eb-a133-41d9-b1c5-8313e3c3a657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:17:08.931048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ee3eb-a133-41d9-b1c5-8313e3c3a657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:08.932611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ee3eb-a133-41d9-b1c5-8313e3c3a657 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:08.953832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1358/2702] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:17:08.958337 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f64b6e-f061-4600-803e-f19c890e2759 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:08.969931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f64b6e-f061-4600-803e-f19c890e2759 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:08.977126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27049b00-56e4-4230-8192-8d308358724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:08.977766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27049b00-56e4-4230-8192-8d308358724a admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:08.978065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27049b00-56e4-4230-8192-8d308358724a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:08.978339 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27049b00-56e4-4230-8192-8d308358724a admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:08.979021 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27049b00-56e4-4230-8192-8d308358724a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:08.980959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27049b00-56e4-4230-8192-8d308358724a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:09.014590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1345/2703] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:17:08 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:17:09.018960 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ee3eb-a133-41d9-b1c5-8313e3c3a657 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:09.033765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ee3eb-a133-41d9-b1c5-8313e3c3a657 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:09.108233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc192d-5879-4927-bcc7-41edbdd785ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:09.108854 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc192d-5879-4927-bcc7-41edbdd785ef admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:09.109137 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc192d-5879-4927-bcc7-41edbdd785ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:09.109413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc192d-5879-4927-bcc7-41edbdd785ef admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:09.110092 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc192d-5879-4927-bcc7-41edbdd785ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:09.112057 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc192d-5879-4927-bcc7-41edbdd785ef admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:09.136644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1359/2704] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:17:09 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:17:09.143753 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27049b00-56e4-4230-8192-8d308358724a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:09.162805 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27049b00-56e4-4230-8192-8d308358724a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:09.170112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54170e0a-e4a7-478d-8a81-44ac49fbf3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:09.170769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54170e0a-e4a7-478d-8a81-44ac49fbf3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:09.171096 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54170e0a-e4a7-478d-8a81-44ac49fbf3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:09.171384 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54170e0a-e4a7-478d-8a81-44ac49fbf3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:09.172037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54170e0a-e4a7-478d-8a81-44ac49fbf3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:09.173700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54170e0a-e4a7-478d-8a81-44ac49fbf3e5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:09.186008 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1346/2705] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:17:09.190002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc192d-5879-4927-bcc7-41edbdd785ef admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:09.202074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc192d-5879-4927-bcc7-41edbdd785ef admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:09.206909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb10ec-096b-4456-8b6b-621ac07bdb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:09.207571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb10ec-096b-4456-8b6b-621ac07bdb60 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:09.207798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb10ec-096b-4456-8b6b-621ac07bdb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:09.208588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb10ec-096b-4456-8b6b-621ac07bdb60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:09.208726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb10ec-096b-4456-8b6b-621ac07bdb60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:09.210321 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb10ec-096b-4456-8b6b-621ac07bdb60 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:09.221232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1360/2706] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:17:09.225450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54170e0a-e4a7-478d-8a81-44ac49fbf3e5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:09.237193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54170e0a-e4a7-478d-8a81-44ac49fbf3e5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:09.241872 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6d0fd-fec8-4852-9fc2-98c6c809d81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:09.242632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6d0fd-fec8-4852-9fc2-98c6c809d81e admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:09.243012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6d0fd-fec8-4852-9fc2-98c6c809d81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:09.243233 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6d0fd-fec8-4852-9fc2-98c6c809d81e admin admin] PATH_INFO: `/v3/projects/5672cbf44ab448eda1bc31a7da81770c/users/b9b8e82e73924f3b89904adf1b3c1702/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:09.260942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6d0fd-fec8-4852-9fc2-98c6c809d81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5672cbf44ab448eda1bc31a7da81770c, user_id=b9b8e82e73924f3b89904adf1b3c1702, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:09.264435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6d0fd-fec8-4852-9fc2-98c6c809d81e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:09.287612 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1347/2707] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:17:09 2022] PUT /identity/v3/projects/5672cbf44ab448eda1bc31a7da81770c/users/b9b8e82e73924f3b89904adf1b3c1702/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:09.298857 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18438ea-6738-48e6-a549-269ac1332bff None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:09.299413 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18438ea-6738-48e6-a549-269ac1332bff None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:09.299702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18438ea-6738-48e6-a549-269ac1332bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:09.332445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-e18438ea-6738-48e6-a549-269ac1332bff None None] MFA Rules not processed for user `b9b8e82e73924f3b89904adf1b3c1702`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:09.333692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e18438ea-6738-48e6-a549-269ac1332bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:09.410807 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1361/2708] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:09.423492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6d0fd-fec8-4852-9fc2-98c6c809d81e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:09.425273 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5dc6d0fd-fec8-4852-9fc2-98c6c809d81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:09.489312 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6d0fd-fec8-4852-9fc2-98c6c809d81e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:09.493059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e0ac5-2389-4486-980e-b28396a1b9c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:09.493676 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e0ac5-2389-4486-980e-b28396a1b9c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:09.493961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e0ac5-2389-4486-980e-b28396a1b9c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:09.494262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e0ac5-2389-4486-980e-b28396a1b9c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:09.504299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e0ac5-2389-4486-980e-b28396a1b9c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:09.505865 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e0ac5-2389-4486-980e-b28396a1b9c1 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:09.516349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1348/2709] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:19.407778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:19.511577 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:20.991175 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18438ea-6738-48e6-a549-269ac1332bff None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:20.992633 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e18438ea-6738-48e6-a549-269ac1332bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:21.077612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18438ea-6738-48e6-a549-269ac1332bff None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:21.082709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:21.086463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:21.086790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:21.087080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] PATH_INFO: `/v3/users/f5afeaa79d7349f2bee94d7135622f02` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:21.088804 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5afeaa79d7349f2bee94d7135622f02)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:21.091387 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:21.157332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5afeaa79d7349f2bee94d7135622f02'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:21.165314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5afeaa79d7349f2bee94d7135622f02'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:21.165936 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5afeaa79d7349f2bee94d7135622f02'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:21.166546 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5afeaa79d7349f2bee94d7135622f02'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:21.180471 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5afeaa79d7349f2bee94d7135622f02'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:21.194092 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1362/2710] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:17:20 2022] DELETE /identity/v3/users/f5afeaa79d7349f2bee94d7135622f02 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:21.198700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13bf3f-957b-49f5-bbbe-2521ae570e15 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:21.199218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13bf3f-957b-49f5-bbbe-2521ae570e15 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:21.199534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13bf3f-957b-49f5-bbbe-2521ae570e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:21.221875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4e13bf3f-957b-49f5-bbbe-2521ae570e15 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:21.223156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4e13bf3f-957b-49f5-bbbe-2521ae570e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:21.295991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1349/2711] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:21.305926 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:21.307663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:21.368321 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b2a05-7a75-48ae-ba01-41088b22d42d admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:21.372683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a6744-11de-4bd0-867a-0b3e1c86cfc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:21.373298 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a6744-11de-4bd0-867a-0b3e1c86cfc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:21.373579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a6744-11de-4bd0-867a-0b3e1c86cfc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:21.373850 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a6744-11de-4bd0-867a-0b3e1c86cfc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:21.384529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a6744-11de-4bd0-867a-0b3e1c86cfc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:21.385963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a6744-11de-4bd0-867a-0b3e1c86cfc0 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:21.396965 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1363/2712] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:21.660138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13bf3f-957b-49f5-bbbe-2521ae570e15 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:21.661758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4e13bf3f-957b-49f5-bbbe-2521ae570e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:21.675187 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13bf3f-957b-49f5-bbbe-2521ae570e15 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:21.680904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c2ea7-e849-4657-98a1-90f796dda3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:21.681513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c2ea7-e849-4657-98a1-90f796dda3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:21.681797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c2ea7-e849-4657-98a1-90f796dda3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:21.682186 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c2ea7-e849-4657-98a1-90f796dda3b2 admin admin] PATH_INFO: `/v3/projects/3e044c707e5940f4ad2fa1efb28f6e1b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:21.683888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c2ea7-e849-4657-98a1-90f796dda3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e044c707e5940f4ad2fa1efb28f6e1b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:21.685919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c2ea7-e849-4657-98a1-90f796dda3b2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:21.735789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0b7c2ea7-e849-4657-98a1-90f796dda3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e044c707e5940f4ad2fa1efb28f6e1b', 'request_id': 'req-0b7c2ea7-e849-4657-98a1-90f796dda3b2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:21.742264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0b7c2ea7-e849-4657-98a1-90f796dda3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e044c707e5940f4ad2fa1efb28f6e1b', 'request_id': 'req-0b7c2ea7-e849-4657-98a1-90f796dda3b2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:21.750956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0b7c2ea7-e849-4657-98a1-90f796dda3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e044c707e5940f4ad2fa1efb28f6e1b', 'request_id': 'req-0b7c2ea7-e849-4657-98a1-90f796dda3b2'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:21.764405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0b7c2ea7-e849-4657-98a1-90f796dda3b2 admin admin] The token cache is being invalidate because project 3e044c707e5940f4ad2fa1efb28f6e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:17:21.764722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0b7c2ea7-e849-4657-98a1-90f796dda3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:21.767283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0b7c2ea7-e849-4657-98a1-90f796dda3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:21.767283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1350/2713] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:17:21 2022] DELETE /identity/v3/projects/3e044c707e5940f4ad2fa1efb28f6e1b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:21.771897 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c3212-3a65-4016-9267-9bbfa01d0398 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:21.772885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c3212-3a65-4016-9267-9bbfa01d0398 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:21.772885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c3212-3a65-4016-9267-9bbfa01d0398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:21.794163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-828c3212-3a65-4016-9267-9bbfa01d0398 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:21.795422 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-828c3212-3a65-4016-9267-9bbfa01d0398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:21.814899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:21.862890 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1364/2714] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:21.872576 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c0df5-d615-4478-8eff-9f3f0982204c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:21.872864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c0df5-d615-4478-8eff-9f3f0982204c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:21.873172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c0df5-d615-4478-8eff-9f3f0982204c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:21.894126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c45c0df5-d615-4478-8eff-9f3f0982204c None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:21.895390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c45c0df5-d615-4478-8eff-9f3f0982204c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:21.903349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1351/2715] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:21.908481 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c3212-3a65-4016-9267-9bbfa01d0398 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:21.925405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c3212-3a65-4016-9267-9bbfa01d0398 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:21.930281 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e451e-6d26-450d-8fc7-7a7a0ee4d2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:21.930946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e451e-6d26-450d-8fc7-7a7a0ee4d2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:21.931225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e451e-6d26-450d-8fc7-7a7a0ee4d2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:21.931502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e451e-6d26-450d-8fc7-7a7a0ee4d2a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:21.932157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e451e-6d26-450d-8fc7-7a7a0ee4d2a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:17:21.932460 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e451e-6d26-450d-8fc7-7a7a0ee4d2a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:21.934706 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e451e-6d26-450d-8fc7-7a7a0ee4d2a0 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:21.946900 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1365/2716] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:17:21.951527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c0df5-d615-4478-8eff-9f3f0982204c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:21.961329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c0df5-d615-4478-8eff-9f3f0982204c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:21.967060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2435bd3-ce00-4941-8e8a-e7d5da8de2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:21.967714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2435bd3-ce00-4941-8e8a-e7d5da8de2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:21.968003 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2435bd3-ce00-4941-8e8a-e7d5da8de2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:21.968282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2435bd3-ce00-4941-8e8a-e7d5da8de2e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:21.968927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2435bd3-ce00-4941-8e8a-e7d5da8de2e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:21.971058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2435bd3-ce00-4941-8e8a-e7d5da8de2e5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:22.008984 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1352/2717] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:17:21 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:17:22.013289 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e451e-6d26-450d-8fc7-7a7a0ee4d2a0 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:22.023395 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e451e-6d26-450d-8fc7-7a7a0ee4d2a0 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:22.080391 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c252bd0-b1a9-4512-84c2-5c967e23ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:22.081002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252bd0-b1a9-4512-84c2-5c967e23ed95 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:22.081288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252bd0-b1a9-4512-84c2-5c967e23ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:22.081567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252bd0-b1a9-4512-84c2-5c967e23ed95 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:22.082202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c252bd0-b1a9-4512-84c2-5c967e23ed95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:22.084159 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c252bd0-b1a9-4512-84c2-5c967e23ed95 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:22.109773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1366/2718] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:17:22 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:17:22.114072 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2435bd3-ce00-4941-8e8a-e7d5da8de2e5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:22.125067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2435bd3-ce00-4941-8e8a-e7d5da8de2e5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:22.130952 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a3c5d-a1ec-49af-9006-1506dc3ee847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:22.131572 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a3c5d-a1ec-49af-9006-1506dc3ee847 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:22.131854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a3c5d-a1ec-49af-9006-1506dc3ee847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:22.132140 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a3c5d-a1ec-49af-9006-1506dc3ee847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:22.132780 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a3c5d-a1ec-49af-9006-1506dc3ee847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:22.134427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a3c5d-a1ec-49af-9006-1506dc3ee847 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:22.145127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1353/2719] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:17:22.149744 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c252bd0-b1a9-4512-84c2-5c967e23ed95 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:22.160331 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c252bd0-b1a9-4512-84c2-5c967e23ed95 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:22.165552 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04f811-fd51-4f2a-9cec-a496b3d8758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:22.166281 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04f811-fd51-4f2a-9cec-a496b3d8758a admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:22.166563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04f811-fd51-4f2a-9cec-a496b3d8758a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:22.166878 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04f811-fd51-4f2a-9cec-a496b3d8758a admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:22.168038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04f811-fd51-4f2a-9cec-a496b3d8758a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:22.169804 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04f811-fd51-4f2a-9cec-a496b3d8758a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:22.185397 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1367/2720] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:17:22.188789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a3c5d-a1ec-49af-9006-1506dc3ee847 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:22.197213 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a3c5d-a1ec-49af-9006-1506dc3ee847 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:22.202363 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78a0bc-342e-4c60-892f-9c7807ddce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:22.203057 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78a0bc-342e-4c60-892f-9c7807ddce13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:22.203371 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78a0bc-342e-4c60-892f-9c7807ddce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:22.203690 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78a0bc-342e-4c60-892f-9c7807ddce13 admin admin] PATH_INFO: `/v3/projects/7dbfdfc823634146913937f062973d99/users/8356bc584f6e4f97bfba2eee5cabb487/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:22.219747 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78a0bc-342e-4c60-892f-9c7807ddce13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbfdfc823634146913937f062973d99, user_id=8356bc584f6e4f97bfba2eee5cabb487, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:22.222392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78a0bc-342e-4c60-892f-9c7807ddce13 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:22.237305 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1354/2721] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:17:22 2022] PUT /identity/v3/projects/7dbfdfc823634146913937f062973d99/users/8356bc584f6e4f97bfba2eee5cabb487/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:22.248272 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd4f84-f7a9-444e-a677-d58c2b4abe9e None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:22.248563 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd4f84-f7a9-444e-a677-d58c2b4abe9e None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:22.248839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd4f84-f7a9-444e-a677-d58c2b4abe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:22.275632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78a0bc-342e-4c60-892f-9c7807ddce13 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:22.277886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ac78a0bc-342e-4c60-892f-9c7807ddce13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:22.278767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-cfdd4f84-f7a9-444e-a677-d58c2b4abe9e None None] MFA Rules not processed for user `8356bc584f6e4f97bfba2eee5cabb487`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:22.279957 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cfdd4f84-f7a9-444e-a677-d58c2b4abe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:22.291755 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:22.346841 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78a0bc-342e-4c60-892f-9c7807ddce13 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:22.348985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1368/2722] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:17:22.352495 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508ff64-4b49-471f-a70d-d23594208120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:22.353321 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ff64-4b49-471f-a70d-d23594208120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:22.353679 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ff64-4b49-471f-a70d-d23594208120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:22.353913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ff64-4b49-471f-a70d-d23594208120 admin admin] PATH_INFO: `/v3/users/b9b8e82e73924f3b89904adf1b3c1702` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:22.356058 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508ff64-4b49-471f-a70d-d23594208120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b8e82e73924f3b89904adf1b3c1702)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:22.357975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508ff64-4b49-471f-a70d-d23594208120 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:22.363991 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd4f84-f7a9-444e-a677-d58c2b4abe9e None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:22.365641 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cfdd4f84-f7a9-444e-a677-d58c2b4abe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:22.386130 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:22.407477 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e508ff64-4b49-471f-a70d-d23594208120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b8e82e73924f3b89904adf1b3c1702'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:22.420470 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e508ff64-4b49-471f-a70d-d23594208120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b8e82e73924f3b89904adf1b3c1702'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:22.428902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd4f84-f7a9-444e-a677-d58c2b4abe9e None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:22.430549 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e508ff64-4b49-471f-a70d-d23594208120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b8e82e73924f3b89904adf1b3c1702'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:22.431292 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e508ff64-4b49-471f-a70d-d23594208120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b8e82e73924f3b89904adf1b3c1702'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:22.432978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-e508ff64-4b49-471f-a70d-d23594208120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b8e82e73924f3b89904adf1b3c1702'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:22.433701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad5212-30df-47da-a198-33a4cf3ff72c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:22.434310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad5212-30df-47da-a198-33a4cf3ff72c service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:22.434601 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad5212-30df-47da-a198-33a4cf3ff72c service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:22.434930 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad5212-30df-47da-a198-33a4cf3ff72c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:22.436742 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-38ad5212-30df-47da-a198-33a4cf3ff72c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:22.446909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1355/2723] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:17:22 2022] DELETE /identity/v3/users/b9b8e82e73924f3b89904adf1b3c1702 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:17:22.449592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad5212-30df-47da-a198-33a4cf3ff72c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:22.451091 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad5212-30df-47da-a198-33a4cf3ff72c service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:22.452479 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd30d0-1dd4-4c75-bf8b-c6f9037d9cb5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:22.452881 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd30d0-1dd4-4c75-bf8b-c6f9037d9cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:22.453253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd30d0-1dd4-4c75-bf8b-c6f9037d9cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:22.461659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1369/2724] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:17:22.476068 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e6cd30d0-1dd4-4c75-bf8b-c6f9037d9cb5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:22.477312 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e6cd30d0-1dd4-4c75-bf8b-c6f9037d9cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:22.550001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1356/2725] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:17:22.556686 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad5212-30df-47da-a198-33a4cf3ff72c service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:22.558758 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-38ad5212-30df-47da-a198-33a4cf3ff72c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:22.623968 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad5212-30df-47da-a198-33a4cf3ff72c service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:22.683707 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca7e89-bdc9-4449-9990-ad64e632a211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:22.684738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca7e89-bdc9-4449-9990-ad64e632a211 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:22.685253 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca7e89-bdc9-4449-9990-ad64e632a211 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:22.685727 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca7e89-bdc9-4449-9990-ad64e632a211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:22.696505 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca7e89-bdc9-4449-9990-ad64e632a211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:22.697973 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca7e89-bdc9-4449-9990-ad64e632a211 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:22.708746 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1370/2726] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:23.000270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd30d0-1dd4-4c75-bf8b-c6f9037d9cb5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:23.001702 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e6cd30d0-1dd4-4c75-bf8b-c6f9037d9cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:23.015048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd30d0-1dd4-4c75-bf8b-c6f9037d9cb5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:23.019694 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b755a-59e2-483a-b31b-25541bcc0fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:23.020342 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b755a-59e2-483a-b31b-25541bcc0fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:23.020627 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b755a-59e2-483a-b31b-25541bcc0fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:23.020910 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b755a-59e2-483a-b31b-25541bcc0fce admin admin] PATH_INFO: `/v3/projects/5672cbf44ab448eda1bc31a7da81770c` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:23.022061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b755a-59e2-483a-b31b-25541bcc0fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5672cbf44ab448eda1bc31a7da81770c)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:23.024204 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b755a-59e2-483a-b31b-25541bcc0fce admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:23.056674 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:23.074960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6d2b755a-59e2-483a-b31b-25541bcc0fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5672cbf44ab448eda1bc31a7da81770c', 'request_id': 'req-6d2b755a-59e2-483a-b31b-25541bcc0fce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:23.080603 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6d2b755a-59e2-483a-b31b-25541bcc0fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5672cbf44ab448eda1bc31a7da81770c', 'request_id': 'req-6d2b755a-59e2-483a-b31b-25541bcc0fce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:23.087919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6d2b755a-59e2-483a-b31b-25541bcc0fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5672cbf44ab448eda1bc31a7da81770c', 'request_id': 'req-6d2b755a-59e2-483a-b31b-25541bcc0fce'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:23.099598 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6d2b755a-59e2-483a-b31b-25541bcc0fce admin admin] The token cache is being invalidate because project 5672cbf44ab448eda1bc31a7da81770c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:17:23.099890 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6d2b755a-59e2-483a-b31b-25541bcc0fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:23.100529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-6d2b755a-59e2-483a-b31b-25541bcc0fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:23.102020 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1357/2727] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:17:22 2022] DELETE /identity/v3/projects/5672cbf44ab448eda1bc31a7da81770c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:17:23.107629 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33bcb2-2500-4467-a1cc-f3c36ea3e6ed None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:23.108142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33bcb2-2500-4467-a1cc-f3c36ea3e6ed None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:23.108240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33bcb2-2500-4467-a1cc-f3c36ea3e6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:23.128155 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-0b33bcb2-2500-4467-a1cc-f3c36ea3e6ed None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:23.129375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0b33bcb2-2500-4467-a1cc-f3c36ea3e6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:23.194748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1371/2728] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:23.203044 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0210d73-b6aa-4537-b36c-54de3f131967 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:23.203778 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0210d73-b6aa-4537-b36c-54de3f131967 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:23.203778 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0210d73-b6aa-4537-b36c-54de3f131967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:23.225222 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c0210d73-b6aa-4537-b36c-54de3f131967 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:23.226432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c0210d73-b6aa-4537-b36c-54de3f131967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:23.235048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1358/2729] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:23.240125 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33bcb2-2500-4467-a1cc-f3c36ea3e6ed None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:23.251142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33bcb2-2500-4467-a1cc-f3c36ea3e6ed None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:23.256300 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e549-b534-4d72-ad02-25c898c93d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:23.256913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e549-b534-4d72-ad02-25c898c93d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:23.257196 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e549-b534-4d72-ad02-25c898c93d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:23.257474 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e549-b534-4d72-ad02-25c898c93d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:23.258135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2e549-b534-4d72-ad02-25c898c93d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:17:23.258442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2e549-b534-4d72-ad02-25c898c93d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:23.260090 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2e549-b534-4d72-ad02-25c898c93d96 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:23.271720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1372/2730] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:17:23.276225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0210d73-b6aa-4537-b36c-54de3f131967 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:23.286324 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0210d73-b6aa-4537-b36c-54de3f131967 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:23.291169 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644e244-3f0b-4b83-a5e5-62a9f7441e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:23.291774 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644e244-3f0b-4b83-a5e5-62a9f7441e80 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:23.292057 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644e244-3f0b-4b83-a5e5-62a9f7441e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:23.292334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644e244-3f0b-4b83-a5e5-62a9f7441e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:23.293616 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644e244-3f0b-4b83-a5e5-62a9f7441e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:23.295557 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644e244-3f0b-4b83-a5e5-62a9f7441e80 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:23.323677 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1359/2731] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:17:23 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:17:23.328225 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e549-b534-4d72-ad02-25c898c93d96 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:23.338004 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e549-b534-4d72-ad02-25c898c93d96 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:23.342092 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:23.395358 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca3688-294e-441d-a417-2fc6486db8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:23.395969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca3688-294e-441d-a417-2fc6486db8aa admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:23.396255 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca3688-294e-441d-a417-2fc6486db8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:23.396536 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca3688-294e-441d-a417-2fc6486db8aa admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:23.397176 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca3688-294e-441d-a417-2fc6486db8aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:23.399114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca3688-294e-441d-a417-2fc6486db8aa admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:23.420773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1373/2732] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:17:23 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:17:23.425148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644e244-3f0b-4b83-a5e5-62a9f7441e80 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:23.435542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644e244-3f0b-4b83-a5e5-62a9f7441e80 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:23.440151 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8ebf-51c1-41b4-9a82-a0bfb42d2726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:23.440751 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8ebf-51c1-41b4-9a82-a0bfb42d2726 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:23.441037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8ebf-51c1-41b4-9a82-a0bfb42d2726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:23.441316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8ebf-51c1-41b4-9a82-a0bfb42d2726 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:23.441957 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a8ebf-51c1-41b4-9a82-a0bfb42d2726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:23.443602 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a8ebf-51c1-41b4-9a82-a0bfb42d2726 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:23.454158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1360/2733] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:17:23.458299 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca3688-294e-441d-a417-2fc6486db8aa admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:23.469163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca3688-294e-441d-a417-2fc6486db8aa admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:23.473851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab79bb4-934f-42ed-857b-510ea3d651b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:23.474466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79bb4-934f-42ed-857b-510ea3d651b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:23.474774 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79bb4-934f-42ed-857b-510ea3d651b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:23.475114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79bb4-934f-42ed-857b-510ea3d651b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:23.475702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab79bb4-934f-42ed-857b-510ea3d651b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:23.477288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab79bb4-934f-42ed-857b-510ea3d651b1 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:23.490232 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1374/2734] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:17:23.495390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8ebf-51c1-41b4-9a82-a0bfb42d2726 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:23.506277 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8ebf-51c1-41b4-9a82-a0bfb42d2726 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:23.511219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a19d2-9f43-4d14-9ac6-1f88e8569b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:23.511938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a19d2-9f43-4d14-9ac6-1f88e8569b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:23.512218 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a19d2-9f43-4d14-9ac6-1f88e8569b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:23.512493 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a19d2-9f43-4d14-9ac6-1f88e8569b36 admin admin] PATH_INFO: `/v3/projects/d29ce0b7c95e4f2ebc4d594c0ff4735b/users/b497b8ca4f6b45c0ab0b45c36f40b16a/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:23.527448 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a19d2-9f43-4d14-9ac6-1f88e8569b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29ce0b7c95e4f2ebc4d594c0ff4735b, user_id=b497b8ca4f6b45c0ab0b45c36f40b16a, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:23.530109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a19d2-9f43-4d14-9ac6-1f88e8569b36 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:23.544349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1361/2735] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:17:23 2022] PUT /identity/v3/projects/d29ce0b7c95e4f2ebc4d594c0ff4735b/users/b497b8ca4f6b45c0ab0b45c36f40b16a/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:23.554916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876167be-281c-4685-b39a-aba01e7ab579 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:23.555207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876167be-281c-4685-b39a-aba01e7ab579 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:23.555488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876167be-281c-4685-b39a-aba01e7ab579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:23.582898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-876167be-281c-4685-b39a-aba01e7ab579 None None] MFA Rules not processed for user `b497b8ca4f6b45c0ab0b45c36f40b16a`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:23.584119 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-876167be-281c-4685-b39a-aba01e7ab579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:23.650029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1375/2736] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:23.662004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a19d2-9f43-4d14-9ac6-1f88e8569b36 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:23.663757 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-620a19d2-9f43-4d14-9ac6-1f88e8569b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:23.723592 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a19d2-9f43-4d14-9ac6-1f88e8569b36 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:23.727368 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a5fef-de3f-44c6-bf32-20970bf3661b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:23.727992 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a5fef-de3f-44c6-bf32-20970bf3661b service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:23.728280 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a5fef-de3f-44c6-bf32-20970bf3661b service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:23.728561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a5fef-de3f-44c6-bf32-20970bf3661b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:23.738654 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a5fef-de3f-44c6-bf32-20970bf3661b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:23.740136 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a5fef-de3f-44c6-bf32-20970bf3661b service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:23.752011 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1362/2737] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:17:27.885828 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876167be-281c-4685-b39a-aba01e7ab579 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:27.888147 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-876167be-281c-4685-b39a-aba01e7ab579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:27.954275 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876167be-281c-4685-b39a-aba01e7ab579 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:27.959103 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:27.959737 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:27.960015 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:27.960296 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] PATH_INFO: `/v3/users/8356bc584f6e4f97bfba2eee5cabb487` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:27.961488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8356bc584f6e4f97bfba2eee5cabb487)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:27.963749 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:27.982180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:28.019937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8356bc584f6e4f97bfba2eee5cabb487'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:28.027986 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8356bc584f6e4f97bfba2eee5cabb487'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:28.028553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8356bc584f6e4f97bfba2eee5cabb487'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:28.029163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8356bc584f6e4f97bfba2eee5cabb487'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:28.041542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8356bc584f6e4f97bfba2eee5cabb487'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:28.055273 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1376/2738] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:17:27 2022] DELETE /identity/v3/users/8356bc584f6e4f97bfba2eee5cabb487 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:28.060635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62c370-9ee2-479b-813a-bc516f16fdc3 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:28.061131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62c370-9ee2-479b-813a-bc516f16fdc3 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:28.061308 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62c370-9ee2-479b-813a-bc516f16fdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:28.080824 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-bd62c370-9ee2-479b-813a-bc516f16fdc3 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:28.082228 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bd62c370-9ee2-479b-813a-bc516f16fdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:28.132932 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:28.148970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1363/2739] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:28.160078 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:28.161486 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:28.222105 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910148d-a21e-4615-b40c-56720c6bae0d admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:28.225719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979aa379-9996-4044-a8a9-5035e779cc73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:28.226327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979aa379-9996-4044-a8a9-5035e779cc73 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:28.226606 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979aa379-9996-4044-a8a9-5035e779cc73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:28.226911 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979aa379-9996-4044-a8a9-5035e779cc73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:28.236251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979aa379-9996-4044-a8a9-5035e779cc73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:28.237675 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979aa379-9996-4044-a8a9-5035e779cc73 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:28.247549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1377/2740] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:28.548366 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62c370-9ee2-479b-813a-bc516f16fdc3 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:28.549913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bd62c370-9ee2-479b-813a-bc516f16fdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:28.564200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62c370-9ee2-479b-813a-bc516f16fdc3 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:28.570608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63fd85-6e63-475e-be77-cdf758d53a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:28.571414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63fd85-6e63-475e-be77-cdf758d53a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:28.571715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63fd85-6e63-475e-be77-cdf758d53a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:28.571972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63fd85-6e63-475e-be77-cdf758d53a87 admin admin] PATH_INFO: `/v3/projects/7dbfdfc823634146913937f062973d99` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:28.573212 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63fd85-6e63-475e-be77-cdf758d53a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbfdfc823634146913937f062973d99)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:28.575788 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63fd85-6e63-475e-be77-cdf758d53a87 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:28.635466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bf63fd85-6e63-475e-be77-cdf758d53a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbfdfc823634146913937f062973d99', 'request_id': 'req-bf63fd85-6e63-475e-be77-cdf758d53a87'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:28.642533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bf63fd85-6e63-475e-be77-cdf758d53a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbfdfc823634146913937f062973d99', 'request_id': 'req-bf63fd85-6e63-475e-be77-cdf758d53a87'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:28.651195 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bf63fd85-6e63-475e-be77-cdf758d53a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbfdfc823634146913937f062973d99', 'request_id': 'req-bf63fd85-6e63-475e-be77-cdf758d53a87'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:28.668573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bf63fd85-6e63-475e-be77-cdf758d53a87 admin admin] The token cache is being invalidate because project 7dbfdfc823634146913937f062973d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:17:28.668866 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bf63fd85-6e63-475e-be77-cdf758d53a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:28.669547 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bf63fd85-6e63-475e-be77-cdf758d53a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:28.671256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1364/2741] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:17:28 2022] DELETE /identity/v3/projects/7dbfdfc823634146913937f062973d99 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:28.676809 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249995ef-9a12-483f-b7f8-34e362d764b5 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:28.676956 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249995ef-9a12-483f-b7f8-34e362d764b5 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:28.677233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249995ef-9a12-483f-b7f8-34e362d764b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:28.698189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-249995ef-9a12-483f-b7f8-34e362d764b5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:28.699733 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-249995ef-9a12-483f-b7f8-34e362d764b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:28.765883 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1378/2742] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:28.773818 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593be41c-6867-429e-a4c7-78388e2654a6 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:28.774108 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593be41c-6867-429e-a4c7-78388e2654a6 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:28.774390 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593be41c-6867-429e-a4c7-78388e2654a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:28.795357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-593be41c-6867-429e-a4c7-78388e2654a6 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:28.796498 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-593be41c-6867-429e-a4c7-78388e2654a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:28.807623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1365/2743] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:28.809640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249995ef-9a12-483f-b7f8-34e362d764b5 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:28.824680 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249995ef-9a12-483f-b7f8-34e362d764b5 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:28.829794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82384d8-e238-4cf8-82ad-ccc52305c9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:28.830416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82384d8-e238-4cf8-82ad-ccc52305c9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:28.830709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82384d8-e238-4cf8-82ad-ccc52305c9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:28.831105 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82384d8-e238-4cf8-82ad-ccc52305c9a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:28.831766 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82384d8-e238-4cf8-82ad-ccc52305c9a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:17:28.832074 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82384d8-e238-4cf8-82ad-ccc52305c9a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:28.833709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82384d8-e238-4cf8-82ad-ccc52305c9a1 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:28.849031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1379/2744] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:17:28.851564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593be41c-6867-429e-a4c7-78388e2654a6 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:28.862621 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593be41c-6867-429e-a4c7-78388e2654a6 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:28.867320 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170fbcc-f982-4155-9d4a-e51d14e66737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:28.867923 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170fbcc-f982-4155-9d4a-e51d14e66737 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:28.868209 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170fbcc-f982-4155-9d4a-e51d14e66737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:28.868555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170fbcc-f982-4155-9d4a-e51d14e66737 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:28.869104 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170fbcc-f982-4155-9d4a-e51d14e66737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:28.871712 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170fbcc-f982-4155-9d4a-e51d14e66737 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:28.899972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1366/2745] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:17:28 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:17:28.904896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82384d8-e238-4cf8-82ad-ccc52305c9a1 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:28.915154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82384d8-e238-4cf8-82ad-ccc52305c9a1 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:28.940019 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:28.982054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb5048-15a1-487a-bc85-82649aa946f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:28.982672 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb5048-15a1-487a-bc85-82649aa946f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:28.982982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb5048-15a1-487a-bc85-82649aa946f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:28.983260 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb5048-15a1-487a-bc85-82649aa946f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:28.984054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb5048-15a1-487a-bc85-82649aa946f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:28.985985 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb5048-15a1-487a-bc85-82649aa946f8 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:29.009726 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1380/2746] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:17:28 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:17:29.014156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170fbcc-f982-4155-9d4a-e51d14e66737 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:29.024357 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170fbcc-f982-4155-9d4a-e51d14e66737 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:29.029505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ec43a-9d61-430e-bb82-e95c718f889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:29.030102 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ec43a-9d61-430e-bb82-e95c718f889c admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:29.030383 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ec43a-9d61-430e-bb82-e95c718f889c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:29.030657 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ec43a-9d61-430e-bb82-e95c718f889c admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:29.031636 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ec43a-9d61-430e-bb82-e95c718f889c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:29.033182 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ec43a-9d61-430e-bb82-e95c718f889c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:29.044139 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1367/2747] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:17:29.051431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb5048-15a1-487a-bc85-82649aa946f8 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:29.062145 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb5048-15a1-487a-bc85-82649aa946f8 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:29.066880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9679d8-494c-48de-9015-06278a6856d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:29.067485 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9679d8-494c-48de-9015-06278a6856d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:29.067767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9679d8-494c-48de-9015-06278a6856d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:29.068072 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9679d8-494c-48de-9015-06278a6856d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:29.068709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9679d8-494c-48de-9015-06278a6856d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:29.070295 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9679d8-494c-48de-9015-06278a6856d9 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:29.081910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1381/2748] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:17:29.085816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ec43a-9d61-430e-bb82-e95c718f889c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:29.096692 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ec43a-9d61-430e-bb82-e95c718f889c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:29.101156 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f1a38-75d6-47e2-9052-571ca001746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:29.101824 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f1a38-75d6-47e2-9052-571ca001746b admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:29.102110 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f1a38-75d6-47e2-9052-571ca001746b admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:29.102388 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f1a38-75d6-47e2-9052-571ca001746b admin admin] PATH_INFO: `/v3/projects/27afe31ab8784e1ea6690f0774171d89/users/299c1f839b494f2bb4ece295eee9bd23/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:29.118064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f1a38-75d6-47e2-9052-571ca001746b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27afe31ab8784e1ea6690f0774171d89, user_id=299c1f839b494f2bb4ece295eee9bd23, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:29.121438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f1a38-75d6-47e2-9052-571ca001746b admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:29.137303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1368/2749] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:17:29 2022] PUT /identity/v3/projects/27afe31ab8784e1ea6690f0774171d89/users/299c1f839b494f2bb4ece295eee9bd23/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:29.147412 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a7a6e-c886-45e1-9fd3-656220a0366a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:29.147704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a7a6e-c886-45e1-9fd3-656220a0366a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:29.147983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a7a6e-c886-45e1-9fd3-656220a0366a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:29.186933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-922a7a6e-c886-45e1-9fd3-656220a0366a None None] MFA Rules not processed for user `299c1f839b494f2bb4ece295eee9bd23`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:29.188307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-922a7a6e-c886-45e1-9fd3-656220a0366a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:29.280461 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1382/2750] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:29.292010 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f1a38-75d6-47e2-9052-571ca001746b admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:29.294179 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a09f1a38-75d6-47e2-9052-571ca001746b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:29.369513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f1a38-75d6-47e2-9052-571ca001746b admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:29.374968 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0433867-58fb-440c-bc9a-7be10cbc90f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:29.375685 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0433867-58fb-440c-bc9a-7be10cbc90f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:29.376048 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0433867-58fb-440c-bc9a-7be10cbc90f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:29.376401 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0433867-58fb-440c-bc9a-7be10cbc90f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:29.385727 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0433867-58fb-440c-bc9a-7be10cbc90f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:29.388141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0433867-58fb-440c-bc9a-7be10cbc90f6 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:29.398276 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1369/2751] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:29.431367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a7a6e-c886-45e1-9fd3-656220a0366a None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:29.508915 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a7a6e-c886-45e1-9fd3-656220a0366a None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:29.516480 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:29.517132 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:29.517421 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:29.517702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] PATH_INFO: `/v3/users/299c1f839b494f2bb4ece295eee9bd23` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:29.518916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=299c1f839b494f2bb4ece295eee9bd23)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:29.520874 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:29.564958 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:29.577503 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299c1f839b494f2bb4ece295eee9bd23'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:29.587499 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299c1f839b494f2bb4ece295eee9bd23'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:29.588181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299c1f839b494f2bb4ece295eee9bd23'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:29.588794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299c1f839b494f2bb4ece295eee9bd23'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:29.606933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299c1f839b494f2bb4ece295eee9bd23'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:29.623752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1383/2752] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:17:29 2022] DELETE /identity/v3/users/299c1f839b494f2bb4ece295eee9bd23 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:29.628249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037f71-21a5-4fc8-98b3-ca31252425e0 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:29.628719 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037f71-21a5-4fc8-98b3-ca31252425e0 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:29.629072 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037f71-21a5-4fc8-98b3-ca31252425e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:29.649463 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-4d037f71-21a5-4fc8-98b3-ca31252425e0 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:29.650807 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4d037f71-21a5-4fc8-98b3-ca31252425e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:29.661529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:29.732433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1370/2753] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:17:29.748670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:29.750127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:29.837342 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3046e-1137-4f7e-a64a-3e51a66b11c8 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:29.843211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5d26c-636e-4562-a7fa-628712f684c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:29.844234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5d26c-636e-4562-a7fa-628712f684c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:29.847072 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5d26c-636e-4562-a7fa-628712f684c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:29.847501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5d26c-636e-4562-a7fa-628712f684c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:29.863430 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5d26c-636e-4562-a7fa-628712f684c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:29.865288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5d26c-636e-4562-a7fa-628712f684c7 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:29.876912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1384/2754] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:30.201561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d037f71-21a5-4fc8-98b3-ca31252425e0 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:30.203939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-4d037f71-21a5-4fc8-98b3-ca31252425e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:30.218328 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d037f71-21a5-4fc8-98b3-ca31252425e0 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:30.227643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06c03f-e512-4390-b778-c9f01fc3d141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:30.228299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06c03f-e512-4390-b778-c9f01fc3d141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:30.228581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06c03f-e512-4390-b778-c9f01fc3d141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:30.228854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06c03f-e512-4390-b778-c9f01fc3d141 admin admin] PATH_INFO: `/v3/projects/27afe31ab8784e1ea6690f0774171d89` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:30.234266 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06c03f-e512-4390-b778-c9f01fc3d141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27afe31ab8784e1ea6690f0774171d89)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:30.236265 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06c03f-e512-4390-b778-c9f01fc3d141 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:30.288351 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bd06c03f-e512-4390-b778-c9f01fc3d141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27afe31ab8784e1ea6690f0774171d89', 'request_id': 'req-bd06c03f-e512-4390-b778-c9f01fc3d141'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:30.294138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bd06c03f-e512-4390-b778-c9f01fc3d141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27afe31ab8784e1ea6690f0774171d89', 'request_id': 'req-bd06c03f-e512-4390-b778-c9f01fc3d141'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:30.302937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bd06c03f-e512-4390-b778-c9f01fc3d141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27afe31ab8784e1ea6690f0774171d89', 'request_id': 'req-bd06c03f-e512-4390-b778-c9f01fc3d141'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:30.315094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bd06c03f-e512-4390-b778-c9f01fc3d141 admin admin] The token cache is being invalidate because project 27afe31ab8784e1ea6690f0774171d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:17:30.315450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bd06c03f-e512-4390-b778-c9f01fc3d141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:30.316114 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bd06c03f-e512-4390-b778-c9f01fc3d141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:30.317750 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1371/2755] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:17:30 2022] DELETE /identity/v3/projects/27afe31ab8784e1ea6690f0774171d89 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:30.322866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6bad1-c043-414c-9e6c-013061574562 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:30.323343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6bad1-c043-414c-9e6c-013061574562 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:30.323955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6bad1-c043-414c-9e6c-013061574562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:30.344198 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-8bf6bad1-c043-414c-9e6c-013061574562 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:30.345468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8bf6bad1-c043-414c-9e6c-013061574562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:30.409644 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1385/2756] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:30.417424 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91098eec-338b-491b-987b-9e516abdd963 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:30.417794 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91098eec-338b-491b-987b-9e516abdd963 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:30.418088 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91098eec-338b-491b-987b-9e516abdd963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:30.438468 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-91098eec-338b-491b-987b-9e516abdd963 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:30.439790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-91098eec-338b-491b-987b-9e516abdd963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:30.448216 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1372/2757] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:30.452764 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6bad1-c043-414c-9e6c-013061574562 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:30.464149 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6bad1-c043-414c-9e6c-013061574562 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:30.472065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24514231-1060-414c-9a76-734ad0a47130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:30.472686 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24514231-1060-414c-9a76-734ad0a47130 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:30.472970 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24514231-1060-414c-9a76-734ad0a47130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:30.473289 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24514231-1060-414c-9a76-734ad0a47130 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:30.473894 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24514231-1060-414c-9a76-734ad0a47130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:17:30.474204 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24514231-1060-414c-9a76-734ad0a47130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:30.475814 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24514231-1060-414c-9a76-734ad0a47130 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:30.489713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1386/2758] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:17:30.495121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91098eec-338b-491b-987b-9e516abdd963 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:30.508200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91098eec-338b-491b-987b-9e516abdd963 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:30.513808 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97343340-ec82-405a-a375-5c317e044651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:30.514433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97343340-ec82-405a-a375-5c317e044651 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:30.514716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97343340-ec82-405a-a375-5c317e044651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:30.515026 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97343340-ec82-405a-a375-5c317e044651 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:30.515691 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97343340-ec82-405a-a375-5c317e044651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:30.517906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97343340-ec82-405a-a375-5c317e044651 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:30.549520 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1373/2759] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:17:30 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:17:30.553647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24514231-1060-414c-9a76-734ad0a47130 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:30.564631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24514231-1060-414c-9a76-734ad0a47130 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:30.606539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:30.627491 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6753540-e70c-454d-9849-17573c81f7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:30.628135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6753540-e70c-454d-9849-17573c81f7bb admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:30.628426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6753540-e70c-454d-9849-17573c81f7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:30.628704 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6753540-e70c-454d-9849-17573c81f7bb admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:30.629338 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6753540-e70c-454d-9849-17573c81f7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:30.631304 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6753540-e70c-454d-9849-17573c81f7bb admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:30.654248 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1387/2760] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:17:30 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:17:30.658979 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97343340-ec82-405a-a375-5c317e044651 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:30.671146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97343340-ec82-405a-a375-5c317e044651 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:30.675902 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54421b-630f-48e6-a15f-6ed89ff8b1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:30.676541 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54421b-630f-48e6-a15f-6ed89ff8b1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:30.676829 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54421b-630f-48e6-a15f-6ed89ff8b1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:30.677109 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54421b-630f-48e6-a15f-6ed89ff8b1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:30.677755 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54421b-630f-48e6-a15f-6ed89ff8b1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:30.679408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54421b-630f-48e6-a15f-6ed89ff8b1b2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:30.690034 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1374/2761] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:17:30.694049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6753540-e70c-454d-9849-17573c81f7bb admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:30.706910 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6753540-e70c-454d-9849-17573c81f7bb admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:30.713003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e19bd-911c-41e3-ae54-d6db6d75bd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:30.713725 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e19bd-911c-41e3-ae54-d6db6d75bd91 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:30.714552 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e19bd-911c-41e3-ae54-d6db6d75bd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:30.714924 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e19bd-911c-41e3-ae54-d6db6d75bd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:30.715755 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e19bd-911c-41e3-ae54-d6db6d75bd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:30.717824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e19bd-911c-41e3-ae54-d6db6d75bd91 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:30.728955 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1388/2762] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:17:30.734035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54421b-630f-48e6-a15f-6ed89ff8b1b2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:30.744591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54421b-630f-48e6-a15f-6ed89ff8b1b2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:30.749427 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5809e4-0fb4-4108-b2c5-4de96504306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:30.750107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5809e4-0fb4-4108-b2c5-4de96504306a admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:30.750664 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5809e4-0fb4-4108-b2c5-4de96504306a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:30.750831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5809e4-0fb4-4108-b2c5-4de96504306a admin admin] PATH_INFO: `/v3/projects/446d1736d4094ac3b69168f0b42b7b7a/users/77b5def890434efa9ea598bbabead2df/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:30.766060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5809e4-0fb4-4108-b2c5-4de96504306a admin admin] RBAC: Authorizing `identity:create_grant(project_id=446d1736d4094ac3b69168f0b42b7b7a, user_id=77b5def890434efa9ea598bbabead2df, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:30.769250 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5809e4-0fb4-4108-b2c5-4de96504306a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:30.783857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1375/2763] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:17:30 2022] PUT /identity/v3/projects/446d1736d4094ac3b69168f0b42b7b7a/users/77b5def890434efa9ea598bbabead2df/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:30.795790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d93a82-b66a-46a7-843b-1f0d09be8eb3 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:30.796075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d93a82-b66a-46a7-843b-1f0d09be8eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:30.796348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d93a82-b66a-46a7-843b-1f0d09be8eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:30.826450 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-71d93a82-b66a-46a7-843b-1f0d09be8eb3 None None] MFA Rules not processed for user `77b5def890434efa9ea598bbabead2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:30.827729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-71d93a82-b66a-46a7-843b-1f0d09be8eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:30.894492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1389/2764] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:30.907372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5809e4-0fb4-4108-b2c5-4de96504306a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:30.909063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bc5809e4-0fb4-4108-b2c5-4de96504306a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:30.950314 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:30.971085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5809e4-0fb4-4108-b2c5-4de96504306a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:30.974769 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1f5c4-3cbc-41d3-9bec-3b0ba33c1299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:30.975439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f5c4-3cbc-41d3-9bec-3b0ba33c1299 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:30.975726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f5c4-3cbc-41d3-9bec-3b0ba33c1299 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:30.976015 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f5c4-3cbc-41d3-9bec-3b0ba33c1299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:30.985417 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1f5c4-3cbc-41d3-9bec-3b0ba33c1299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:30.986919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1f5c4-3cbc-41d3-9bec-3b0ba33c1299 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:30.996487 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1376/2765] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:33.865014 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d93a82-b66a-46a7-843b-1f0d09be8eb3 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:33.866496 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-71d93a82-b66a-46a7-843b-1f0d09be8eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:33.931723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d93a82-b66a-46a7-843b-1f0d09be8eb3 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:33.937310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:33.937946 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:33.938240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:33.938521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] PATH_INFO: `/v3/users/b497b8ca4f6b45c0ab0b45c36f40b16a` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:33.939713 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b497b8ca4f6b45c0ab0b45c36f40b16a)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:33.941614 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:33.986567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b497b8ca4f6b45c0ab0b45c36f40b16a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:33.990258 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:33.995002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b497b8ca4f6b45c0ab0b45c36f40b16a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:33.996659 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b497b8ca4f6b45c0ab0b45c36f40b16a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:33.997862 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b497b8ca4f6b45c0ab0b45c36f40b16a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:34.011314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b497b8ca4f6b45c0ab0b45c36f40b16a'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:34.023920 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1390/2766] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:17:33 2022] DELETE /identity/v3/users/b497b8ca4f6b45c0ab0b45c36f40b16a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:34.029115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff7127-78ed-48f9-a110-cac833555abc None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:34.029606 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff7127-78ed-48f9-a110-cac833555abc None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:34.029720 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff7127-78ed-48f9-a110-cac833555abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:34.049414 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a2ff7127-78ed-48f9-a110-cac833555abc None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:34.050647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a2ff7127-78ed-48f9-a110-cac833555abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:34.113263 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1377/2767] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:34.124252 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:34.125720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:34.183681 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f614b4-c62b-4717-92d5-19bf7049c36a admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:34.187663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d63e92-bc2c-4816-bee4-1c90dfef855c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:34.188215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d63e92-bc2c-4816-bee4-1c90dfef855c service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:34.188498 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d63e92-bc2c-4816-bee4-1c90dfef855c service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:34.188773 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d63e92-bc2c-4816-bee4-1c90dfef855c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:34.198134 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d63e92-bc2c-4816-bee4-1c90dfef855c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:34.200262 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d63e92-bc2c-4816-bee4-1c90dfef855c service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:34.212723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1391/2768] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:34.489094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff7127-78ed-48f9-a110-cac833555abc None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:34.490600 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a2ff7127-78ed-48f9-a110-cac833555abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:34.503302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff7127-78ed-48f9-a110-cac833555abc None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:34.508626 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:34.509361 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:34.509624 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:34.509901 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad admin admin] PATH_INFO: `/v3/projects/d29ce0b7c95e4f2ebc4d594c0ff4735b` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:34.511154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29ce0b7c95e4f2ebc4d594c0ff4735b)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:34.513123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:34.569143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29ce0b7c95e4f2ebc4d594c0ff4735b', 'request_id': 'req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:34.575133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29ce0b7c95e4f2ebc4d594c0ff4735b', 'request_id': 'req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:34.583672 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29ce0b7c95e4f2ebc4d594c0ff4735b', 'request_id': 'req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:34.597532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad admin admin] The token cache is being invalidate because project d29ce0b7c95e4f2ebc4d594c0ff4735b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:17:34.597835 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:34.598525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c2ebe3f7-0662-4da6-ab1b-182c46ef48ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:34.600051 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1378/2769] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:17:34 2022] DELETE /identity/v3/projects/d29ce0b7c95e4f2ebc4d594c0ff4735b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:36.013509 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d63e92-bc2c-4816-bee4-1c90dfef855c service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:36.014954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-02d63e92-bc2c-4816-bee4-1c90dfef855c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:36.027820 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d63e92-bc2c-4816-bee4-1c90dfef855c service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:36.084679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:36.085317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:36.085600 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:36.085880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] PATH_INFO: `/v3/users/77b5def890434efa9ea598bbabead2df` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:36.087047 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b5def890434efa9ea598bbabead2df)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:36.088963 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:36.134983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b5def890434efa9ea598bbabead2df'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:36.142933 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b5def890434efa9ea598bbabead2df'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:36.143618 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b5def890434efa9ea598bbabead2df'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:36.144249 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b5def890434efa9ea598bbabead2df'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:36.156157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b5def890434efa9ea598bbabead2df'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:36.158364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:36.171033 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1392/2770] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:17:36 2022] DELETE /identity/v3/users/77b5def890434efa9ea598bbabead2df => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:36.175670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f01d60-2767-462e-9b43-a6d300f5b2ae None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:36.176165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f01d60-2767-462e-9b43-a6d300f5b2ae None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:36.176266 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f01d60-2767-462e-9b43-a6d300f5b2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:36.195821 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-b8f01d60-2767-462e-9b43-a6d300f5b2ae None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:36.197035 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b8f01d60-2767-462e-9b43-a6d300f5b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:36.256706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1379/2771] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:36.266559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:36.267994 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:36.326677 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131de73-71c3-4c47-a0fc-ed0589755fec admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:36.330269 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f20ea3-c2ba-41e9-9105-f8b6fb1e6c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:36.330897 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f20ea3-c2ba-41e9-9105-f8b6fb1e6c5b service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:36.331177 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f20ea3-c2ba-41e9-9105-f8b6fb1e6c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:36.331451 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f20ea3-c2ba-41e9-9105-f8b6fb1e6c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:36.341019 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f20ea3-c2ba-41e9-9105-f8b6fb1e6c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:36.342443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f20ea3-c2ba-41e9-9105-f8b6fb1e6c5b service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:36.351772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1393/2772] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:36.619191 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f01d60-2767-462e-9b43-a6d300f5b2ae None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:36.620795 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-b8f01d60-2767-462e-9b43-a6d300f5b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:36.628538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:36.634196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f01d60-2767-462e-9b43-a6d300f5b2ae None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:36.641651 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:36.642267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:36.642905 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:36.643176 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] PATH_INFO: `/v3/projects/446d1736d4094ac3b69168f0b42b7b7a` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:36.644362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=446d1736d4094ac3b69168f0b42b7b7a)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:36.646352 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:36.694850 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446d1736d4094ac3b69168f0b42b7b7a', 'request_id': 'req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:36.700364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446d1736d4094ac3b69168f0b42b7b7a', 'request_id': 'req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:36.707803 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446d1736d4094ac3b69168f0b42b7b7a', 'request_id': 'req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:36.720046 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] The token cache is being invalidate because project 446d1736d4094ac3b69168f0b42b7b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:17:36.720338 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:36.720986 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:17:36.722490 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1380/2773] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:17:36 2022] DELETE /identity/v3/projects/446d1736d4094ac3b69168f0b42b7b7a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:17:43.736789 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f20ea3-c2ba-41e9-9105-f8b6fb1e6c5b service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:43.738212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-55f20ea3-c2ba-41e9-9105-f8b6fb1e6c5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:43.826603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f20ea3-c2ba-41e9-9105-f8b6fb1e6c5b service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:43.881024 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fccce-dcc3-4b38-a581-ccf6a8884eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:43.881647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fccce-dcc3-4b38-a581-ccf6a8884eed service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:43.881932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fccce-dcc3-4b38-a581-ccf6a8884eed service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:43.882212 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fccce-dcc3-4b38-a581-ccf6a8884eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:43.884567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f31fccce-dcc3-4b38-a581-ccf6a8884eed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:43.947104 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:43.963858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fccce-dcc3-4b38-a581-ccf6a8884eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:43.965935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fccce-dcc3-4b38-a581-ccf6a8884eed service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:43.978007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1394/2774] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:45.469809 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:45.471316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:45.535816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55edd4-d02d-4050-a84e-1f5fd1c1c551 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:45.539671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f9ffa-9aaf-48a4-bbcb-c68626073af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:45.540307 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f9ffa-9aaf-48a4-bbcb-c68626073af0 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:45.540595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f9ffa-9aaf-48a4-bbcb-c68626073af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:45.540875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f9ffa-9aaf-48a4-bbcb-c68626073af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:45.544936 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d63f9ffa-9aaf-48a4-bbcb-c68626073af0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:45.561334 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f9ffa-9aaf-48a4-bbcb-c68626073af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:45.562851 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f9ffa-9aaf-48a4-bbcb-c68626073af0 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:45.576521 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1381/2775] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:17:53.972631 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:55.570514 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:55.800460 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36bd97-cf7b-4dc3-894d-22be8b61b308 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:55.800967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36bd97-cf7b-4dc3-894d-22be8b61b308 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:55.801171 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36bd97-cf7b-4dc3-894d-22be8b61b308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:55.823029 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-8b36bd97-cf7b-4dc3-894d-22be8b61b308 None None] MFA Rules not processed for user `a6e838dfd7a64de5b1e95f8276bcdca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:17:55.824832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8b36bd97-cf7b-4dc3-894d-22be8b61b308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:55.883490 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1395/2776] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:17:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:17:58.319973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f9ffa-9aaf-48a4-bbcb-c68626073af0 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:17:58.321538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d63f9ffa-9aaf-48a4-bbcb-c68626073af0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:58.332883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f9ffa-9aaf-48a4-bbcb-c68626073af0 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:17:58.336880 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d48efb-e2cf-46d4-8748-a7997cec7240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:17:58.337496 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d48efb-e2cf-46d4-8748-a7997cec7240 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:17:58.337779 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d48efb-e2cf-46d4-8748-a7997cec7240 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:17:58.338063 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d48efb-e2cf-46d4-8748-a7997cec7240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:17:58.340587 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-76d48efb-e2cf-46d4-8748-a7997cec7240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:17:58.351716 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d48efb-e2cf-46d4-8748-a7997cec7240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:17:58.353172 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d48efb-e2cf-46d4-8748-a7997cec7240 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:17:58.363452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1382/2777] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:17:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:18:05.876622 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=25 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:18:08.359939 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=6 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:19:21.448964 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36bd97-cf7b-4dc3-894d-22be8b61b308 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:19:21.456389 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-8b36bd97-cf7b-4dc3-894d-22be8b61b308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:19:21.481888 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36bd97-cf7b-4dc3-894d-22be8b61b308 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:19:21.488370 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756082b-2e45-4ab6-8e3a-070b3c5ba425 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:19:21.489021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756082b-2e45-4ab6-8e3a-070b3c5ba425 service nova] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:19:21.489323 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756082b-2e45-4ab6-8e3a-070b3c5ba425 service nova] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:19:21.489559 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756082b-2e45-4ab6-8e3a-070b3c5ba425 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:19:21.491583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7756082b-2e45-4ab6-8e3a-070b3c5ba425 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:19:21.510059 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756082b-2e45-4ab6-8e3a-070b3c5ba425 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:19:21.512335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756082b-2e45-4ab6-8e3a-070b3c5ba425 service nova] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:19:21.530888 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1396/2778] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:19:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:19:23.154540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d48efb-e2cf-46d4-8748-a7997cec7240 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:19:23.156613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-76d48efb-e2cf-46d4-8748-a7997cec7240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:19:23.182484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d48efb-e2cf-46d4-8748-a7997cec7240 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:19:23.192059 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bcab2-9eed-4b3e-989f-7e593b50db6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:19:23.193142 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bcab2-9eed-4b3e-989f-7e593b50db6f service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:19:23.193658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bcab2-9eed-4b3e-989f-7e593b50db6f service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:19:23.194148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bcab2-9eed-4b3e-989f-7e593b50db6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:19:23.197208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d97bcab2-9eed-4b3e-989f-7e593b50db6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:19:23.217541 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bcab2-9eed-4b3e-989f-7e593b50db6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:19:23.220458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bcab2-9eed-4b3e-989f-7e593b50db6f service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:19:23.235203 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1383/2779] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:19:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:19:25.068781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e7e59-8358-421e-af74-92f70df9ad6d None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:19:25.069366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e7e59-8358-421e-af74-92f70df9ad6d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:19:25.069553 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e7e59-8358-421e-af74-92f70df9ad6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:19:25.101983 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-589e7e59-8358-421e-af74-92f70df9ad6d None None] MFA Rules not processed for user `a6e838dfd7a64de5b1e95f8276bcdca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:19:25.104155 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-589e7e59-8358-421e-af74-92f70df9ad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:19:25.116804 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1397/2780] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:19:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:19:25.486126 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bcab2-9eed-4b3e-989f-7e593b50db6f service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:19:25.504129 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bcab2-9eed-4b3e-989f-7e593b50db6f service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:19:25.510143 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36b6dc-fc97-4a72-a0f3-ff0405dd71ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:19:25.511006 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36b6dc-fc97-4a72-a0f3-ff0405dd71ed service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:19:25.511529 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36b6dc-fc97-4a72-a0f3-ff0405dd71ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:19:25.512012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36b6dc-fc97-4a72-a0f3-ff0405dd71ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:19:25.515033 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ca36b6dc-fc97-4a72-a0f3-ff0405dd71ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:19:25.531590 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36b6dc-fc97-4a72-a0f3-ff0405dd71ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:19:25.536584 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36b6dc-fc97-4a72-a0f3-ff0405dd71ed service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:19:25.548090 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1384/2781] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:19:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:19:25.929607 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e7e59-8358-421e-af74-92f70df9ad6d None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:19:25.931892 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-589e7e59-8358-421e-af74-92f70df9ad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:19:26.027830 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e7e59-8358-421e-af74-92f70df9ad6d None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:19:26.035720 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4af7b5-71c7-4623-834a-3daf6b89fa42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:19:26.036356 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4af7b5-71c7-4623-834a-3daf6b89fa42 service placement] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:19:26.036643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4af7b5-71c7-4623-834a-3daf6b89fa42 service placement] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:19:26.036917 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4af7b5-71c7-4623-834a-3daf6b89fa42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:19:26.038817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0d4af7b5-71c7-4623-834a-3daf6b89fa42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:19:26.051980 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4af7b5-71c7-4623-834a-3daf6b89fa42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:19:26.053615 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4af7b5-71c7-4623-834a-3daf6b89fa42 service placement] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:19:26.065526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1398/2782] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:19:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:19:35.541857 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=12 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:19:36.060326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=41 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:19:37.612725 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36b6dc-fc97-4a72-a0f3-ff0405dd71ed service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:19:37.628752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36b6dc-fc97-4a72-a0f3-ff0405dd71ed service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:19:37.635255 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaadad-b923-49c7-ba89-efc5300d21e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e51beb8d0e4219af906860ce906500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:19:37.635897 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaadad-b923-49c7-ba89-efc5300d21e7 service nova] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:19:37.636380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaadad-b923-49c7-ba89-efc5300d21e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:19:37.636790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaadad-b923-49c7-ba89-efc5300d21e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:19:37.638904 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-20eaadad-b923-49c7-ba89-efc5300d21e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:19:37.656135 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaadad-b923-49c7-ba89-efc5300d21e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:19:37.657877 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaadad-b923-49c7-ba89-efc5300d21e7 service nova] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:19:37.670981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1385/2783] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:19:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:19:47.664946 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=6 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:20:54.858284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4af7b5-71c7-4623-834a-3daf6b89fa42 service placement] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:20:54.870512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4af7b5-71c7-4623-834a-3daf6b89fa42 service placement] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:20:54.876098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955638a-0152-4bab-9028-38c0433f13e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:20:54.876733 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955638a-0152-4bab-9028-38c0433f13e6 service placement] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:20:54.877027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955638a-0152-4bab-9028-38c0433f13e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:20:54.878324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955638a-0152-4bab-9028-38c0433f13e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:20:54.880207 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6955638a-0152-4bab-9028-38c0433f13e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:20:54.893969 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955638a-0152-4bab-9028-38c0433f13e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:20:54.896145 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955638a-0152-4bab-9028-38c0433f13e6 service placement] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:20:54.908189 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1399/2784] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:20:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:00.192349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaadad-b923-49c7-ba89-efc5300d21e7 service nova] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:00.202033 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaadad-b923-49c7-ba89-efc5300d21e7 service nova] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:00.205956 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87037212-7136-41b8-aa85-02309608dc07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:00.206586 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87037212-7136-41b8-aa85-02309608dc07 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:00.206909 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87037212-7136-41b8-aa85-02309608dc07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:00.207188 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87037212-7136-41b8-aa85-02309608dc07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:00.208961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-87037212-7136-41b8-aa85-02309608dc07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:00.278459 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87037212-7136-41b8-aa85-02309608dc07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:00.279955 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87037212-7136-41b8-aa85-02309608dc07 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:00.293419 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1386/2785] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:03.235367 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955638a-0152-4bab-9028-38c0433f13e6 service placement] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:03.236875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6955638a-0152-4bab-9028-38c0433f13e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:03.251567 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955638a-0152-4bab-9028-38c0433f13e6 service placement] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:03.257646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f5b73-8c4c-4a6b-bc5f-ed4e9bef7026 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:03.258284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f5b73-8c4c-4a6b-bc5f-ed4e9bef7026 service placement] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:03.258566 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f5b73-8c4c-4a6b-bc5f-ed4e9bef7026 service placement] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:03.258880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f5b73-8c4c-4a6b-bc5f-ed4e9bef7026 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:03.260984 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9e8f5b73-8c4c-4a6b-bc5f-ed4e9bef7026 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:03.282982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f5b73-8c4c-4a6b-bc5f-ed4e9bef7026 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:03.286532 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f5b73-8c4c-4a6b-bc5f-ed4e9bef7026 service placement] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:03.312448 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87037212-7136-41b8-aa85-02309608dc07 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:03.313971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1400/2786] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:03.314208 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-87037212-7136-41b8-aa85-02309608dc07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:03.336212 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87037212-7136-41b8-aa85-02309608dc07 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:03.341477 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb666710-c5c7-4200-8ef0-1743a2978483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:03.342356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb666710-c5c7-4200-8ef0-1743a2978483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:03.343108 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb666710-c5c7-4200-8ef0-1743a2978483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:03.343451 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb666710-c5c7-4200-8ef0-1743a2978483 admin admin] PATH_INFO: `/v3/users/a6e838dfd7a64de5b1e95f8276bcdca0` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:03.344551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb666710-c5c7-4200-8ef0-1743a2978483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e838dfd7a64de5b1e95f8276bcdca0)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:03.347386 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb666710-c5c7-4200-8ef0-1743a2978483 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:03.401838 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fb666710-c5c7-4200-8ef0-1743a2978483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e838dfd7a64de5b1e95f8276bcdca0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:03.418253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fb666710-c5c7-4200-8ef0-1743a2978483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e838dfd7a64de5b1e95f8276bcdca0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:03.426648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fb666710-c5c7-4200-8ef0-1743a2978483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e838dfd7a64de5b1e95f8276bcdca0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:03.427557 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fb666710-c5c7-4200-8ef0-1743a2978483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e838dfd7a64de5b1e95f8276bcdca0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:03.428608 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fb666710-c5c7-4200-8ef0-1743a2978483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e838dfd7a64de5b1e95f8276bcdca0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:03.441898 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1387/2787] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:21:03 2022] DELETE /identity/v3/users/a6e838dfd7a64de5b1e95f8276bcdca0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:03.616781 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f5b73-8c4c-4a6b-bc5f-ed4e9bef7026 service placement] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:03.628235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f5b73-8c4c-4a6b-bc5f-ed4e9bef7026 service placement] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:03.685324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e606b1-2c9c-4186-a290-a4c64f8db412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:03.685877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e606b1-2c9c-4186-a290-a4c64f8db412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:03.686154 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e606b1-2c9c-4186-a290-a4c64f8db412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:03.686426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e606b1-2c9c-4186-a290-a4c64f8db412 admin admin] PATH_INFO: `/v3/projects/f611baf8f2274fe6a3444eb8aad41b47` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:03.687576 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e606b1-2c9c-4186-a290-a4c64f8db412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f611baf8f2274fe6a3444eb8aad41b47)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:03.689467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e606b1-2c9c-4186-a290-a4c64f8db412 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:03.734954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-13e606b1-2c9c-4186-a290-a4c64f8db412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f611baf8f2274fe6a3444eb8aad41b47', 'request_id': 'req-13e606b1-2c9c-4186-a290-a4c64f8db412'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:03.743100 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-13e606b1-2c9c-4186-a290-a4c64f8db412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f611baf8f2274fe6a3444eb8aad41b47', 'request_id': 'req-13e606b1-2c9c-4186-a290-a4c64f8db412'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:03.750098 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-13e606b1-2c9c-4186-a290-a4c64f8db412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f611baf8f2274fe6a3444eb8aad41b47', 'request_id': 'req-13e606b1-2c9c-4186-a290-a4c64f8db412'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:03.761579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-13e606b1-2c9c-4186-a290-a4c64f8db412 admin admin] The token cache is being invalidate because project f611baf8f2274fe6a3444eb8aad41b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:21:03.761872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-13e606b1-2c9c-4186-a290-a4c64f8db412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:03.762548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-13e606b1-2c9c-4186-a290-a4c64f8db412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:03.764093 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1401/2788] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:21:03 2022] DELETE /identity/v3/projects/f611baf8f2274fe6a3444eb8aad41b47 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:03.769841 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0aa33-05a8-4a2d-b7ac-6f0f275fd1a5 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:03.770196 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0aa33-05a8-4a2d-b7ac-6f0f275fd1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:03.770483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0aa33-05a8-4a2d-b7ac-6f0f275fd1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:03.790553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-d8c0aa33-05a8-4a2d-b7ac-6f0f275fd1a5 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:03.791796 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d8c0aa33-05a8-4a2d-b7ac-6f0f275fd1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:03.852705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1388/2789] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:03.860683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4ec97-e19a-4724-b2e0-4ff8cac45490 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:03.860913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4ec97-e19a-4724-b2e0-4ff8cac45490 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:03.861203 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4ec97-e19a-4724-b2e0-4ff8cac45490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:03.884009 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-0de4ec97-e19a-4724-b2e0-4ff8cac45490 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:03.885240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0de4ec97-e19a-4724-b2e0-4ff8cac45490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:03.894046 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1402/2790] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:03.898349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0aa33-05a8-4a2d-b7ac-6f0f275fd1a5 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:03.910112 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0aa33-05a8-4a2d-b7ac-6f0f275fd1a5 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:03.914784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd0dec-8bdb-4b85-bfaa-b3a76c989b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:03.915393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd0dec-8bdb-4b85-bfaa-b3a76c989b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:03.915681 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd0dec-8bdb-4b85-bfaa-b3a76c989b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:03.915959 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd0dec-8bdb-4b85-bfaa-b3a76c989b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:03.916612 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd0dec-8bdb-4b85-bfaa-b3a76c989b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:21:03.916920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd0dec-8bdb-4b85-bfaa-b3a76c989b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:03.918505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd0dec-8bdb-4b85-bfaa-b3a76c989b90 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:03.920141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:03.933996 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1389/2791] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:21:03.938303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4ec97-e19a-4724-b2e0-4ff8cac45490 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:03.948133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4ec97-e19a-4724-b2e0-4ff8cac45490 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:03.952840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41834888-2fa3-4e29-9234-15957c1793e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:03.953441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41834888-2fa3-4e29-9234-15957c1793e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:03.953723 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41834888-2fa3-4e29-9234-15957c1793e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:03.953999 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41834888-2fa3-4e29-9234-15957c1793e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:03.954638 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41834888-2fa3-4e29-9234-15957c1793e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:03.957317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41834888-2fa3-4e29-9234-15957c1793e5 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:03.984424 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1403/2792] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:21:03 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:03.988997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd0dec-8bdb-4b85-bfaa-b3a76c989b90 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:03.999640 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd0dec-8bdb-4b85-bfaa-b3a76c989b90 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:04.057264 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25640a78-9a9a-4483-9bd3-8781771923f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:04.057879 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25640a78-9a9a-4483-9bd3-8781771923f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:04.058165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25640a78-9a9a-4483-9bd3-8781771923f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:04.058443 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25640a78-9a9a-4483-9bd3-8781771923f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:04.059117 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25640a78-9a9a-4483-9bd3-8781771923f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:04.061025 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25640a78-9a9a-4483-9bd3-8781771923f0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:04.082617 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1390/2793] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:21:03 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:04.086784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41834888-2fa3-4e29-9234-15957c1793e5 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:04.096936 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41834888-2fa3-4e29-9234-15957c1793e5 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:04.101551 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dde138-1b95-43c5-94cf-878fa8b67aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:04.102160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dde138-1b95-43c5-94cf-878fa8b67aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:04.102442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dde138-1b95-43c5-94cf-878fa8b67aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:04.102716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dde138-1b95-43c5-94cf-878fa8b67aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:04.103386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dde138-1b95-43c5-94cf-878fa8b67aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:04.104982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dde138-1b95-43c5-94cf-878fa8b67aa6 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:04.115925 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1404/2794] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:21:04.120558 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25640a78-9a9a-4483-9bd3-8781771923f0 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:04.132660 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25640a78-9a9a-4483-9bd3-8781771923f0 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:04.138057 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa08e-f693-4ae1-b171-d3f5333ab1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:04.138683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa08e-f693-4ae1-b171-d3f5333ab1ef admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:04.138997 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa08e-f693-4ae1-b171-d3f5333ab1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:04.139277 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa08e-f693-4ae1-b171-d3f5333ab1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:04.139937 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfa08e-f693-4ae1-b171-d3f5333ab1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:04.141537 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfa08e-f693-4ae1-b171-d3f5333ab1ef admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:04.152822 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1391/2795] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:04.157135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dde138-1b95-43c5-94cf-878fa8b67aa6 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:04.167782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dde138-1b95-43c5-94cf-878fa8b67aa6 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:04.172549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86d548-e4ad-4139-8508-911bc69b2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:04.173221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86d548-e4ad-4139-8508-911bc69b2dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:04.173500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86d548-e4ad-4139-8508-911bc69b2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:04.173775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86d548-e4ad-4139-8508-911bc69b2dd0 admin admin] PATH_INFO: `/v3/projects/08160fce16a047dd9809653ba333dd2f/users/a99f4f9e8cdb4ae5a3dd4d57f44dd44c/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:04.189062 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86d548-e4ad-4139-8508-911bc69b2dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08160fce16a047dd9809653ba333dd2f, user_id=a99f4f9e8cdb4ae5a3dd4d57f44dd44c, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:04.192368 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86d548-e4ad-4139-8508-911bc69b2dd0 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:04.201312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:04.207348 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1405/2796] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:04 2022] PUT /identity/v3/projects/08160fce16a047dd9809653ba333dd2f/users/a99f4f9e8cdb4ae5a3dd4d57f44dd44c/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:21:04.217961 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a39f5-0203-405a-bde3-a8304d505beb None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:04.218249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a39f5-0203-405a-bde3-a8304d505beb None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:04.218525 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a39f5-0203-405a-bde3-a8304d505beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:04.247729 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-e11a39f5-0203-405a-bde3-a8304d505beb None None] MFA Rules not processed for user `a99f4f9e8cdb4ae5a3dd4d57f44dd44c`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:04.248940 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-e11a39f5-0203-405a-bde3-a8304d505beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:04.316201 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1392/2797] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:04.321155 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86d548-e4ad-4139-8508-911bc69b2dd0 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:04.383331 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86d548-e4ad-4139-8508-911bc69b2dd0 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:04.388031 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ec1a7-2be9-4261-badb-f08e5a092394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:04.388646 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ec1a7-2be9-4261-badb-f08e5a092394 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:04.388932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ec1a7-2be9-4261-badb-f08e5a092394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:04.389208 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ec1a7-2be9-4261-badb-f08e5a092394 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:04.389840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ec1a7-2be9-4261-badb-f08e5a092394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:04.391765 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ec1a7-2be9-4261-badb-f08e5a092394 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:04.419647 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1406/2798] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:21:04 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:04.423778 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a39f5-0203-405a-bde3-a8304d505beb None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:04.435313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a39f5-0203-405a-bde3-a8304d505beb None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:04.496705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1caa37-bfe3-4ffd-b3ad-d0fd6f2d0f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:04.497330 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1caa37-bfe3-4ffd-b3ad-d0fd6f2d0f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:04.497615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1caa37-bfe3-4ffd-b3ad-d0fd6f2d0f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:04.497894 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1caa37-bfe3-4ffd-b3ad-d0fd6f2d0f0d admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:04.498527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1caa37-bfe3-4ffd-b3ad-d0fd6f2d0f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:04.500508 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1caa37-bfe3-4ffd-b3ad-d0fd6f2d0f0d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:04.510106 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:04.523722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1393/2799] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:21:04 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:04.528071 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ec1a7-2be9-4261-badb-f08e5a092394 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:04.540987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ec1a7-2be9-4261-badb-f08e5a092394 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:04.546038 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac073632-6418-40b8-ba0d-696e44fd789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:04.546653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac073632-6418-40b8-ba0d-696e44fd789b admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:04.546982 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac073632-6418-40b8-ba0d-696e44fd789b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:04.547265 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac073632-6418-40b8-ba0d-696e44fd789b admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:04.547914 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac073632-6418-40b8-ba0d-696e44fd789b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:04.550163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac073632-6418-40b8-ba0d-696e44fd789b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:04.562288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1407/2800] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:21:04.566133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1caa37-bfe3-4ffd-b3ad-d0fd6f2d0f0d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:04.576446 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1caa37-bfe3-4ffd-b3ad-d0fd6f2d0f0d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:04.581293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f206d9-7641-494e-9167-a5516131047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:04.581943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f206d9-7641-494e-9167-a5516131047a admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:04.582227 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f206d9-7641-494e-9167-a5516131047a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:04.582500 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f206d9-7641-494e-9167-a5516131047a admin admin] PATH_INFO: `/v3/projects/fad80b2e98a84f1896eb694257d12411/users/fefd22a6dea3487dbf2ea1e007e838a7/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:04.598718 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f206d9-7641-494e-9167-a5516131047a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad80b2e98a84f1896eb694257d12411, user_id=fefd22a6dea3487dbf2ea1e007e838a7, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:04.601379 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f206d9-7641-494e-9167-a5516131047a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:04.615012 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1394/2801] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:04 2022] PUT /identity/v3/projects/fad80b2e98a84f1896eb694257d12411/users/fefd22a6dea3487dbf2ea1e007e838a7/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:04.619156 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac073632-6418-40b8-ba0d-696e44fd789b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:04.629234 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac073632-6418-40b8-ba0d-696e44fd789b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:04.698392 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fa321-a7b0-4fa3-abcb-868276b1886b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:04.699054 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fa321-a7b0-4fa3-abcb-868276b1886b admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:04.699656 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fa321-a7b0-4fa3-abcb-868276b1886b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:04.699656 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fa321-a7b0-4fa3-abcb-868276b1886b admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:04.700259 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fa321-a7b0-4fa3-abcb-868276b1886b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:04.701842 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fa321-a7b0-4fa3-abcb-868276b1886b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:04.713866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1408/2802] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:21:04.718115 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f206d9-7641-494e-9167-a5516131047a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:04.730123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f206d9-7641-494e-9167-a5516131047a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:04.735888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6669a2-c404-48e2-9165-22fd07bf171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:04.736596 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6669a2-c404-48e2-9165-22fd07bf171e admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:04.736882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6669a2-c404-48e2-9165-22fd07bf171e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:04.737190 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6669a2-c404-48e2-9165-22fd07bf171e admin admin] PATH_INFO: `/v3/projects/fad80b2e98a84f1896eb694257d12411/users/fefd22a6dea3487dbf2ea1e007e838a7/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:04.739179 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6669a2-c404-48e2-9165-22fd07bf171e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad80b2e98a84f1896eb694257d12411, user_id=fefd22a6dea3487dbf2ea1e007e838a7, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:04.742021 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6669a2-c404-48e2-9165-22fd07bf171e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:04.754267 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1395/2803] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:04 2022] PUT /identity/v3/projects/fad80b2e98a84f1896eb694257d12411/users/fefd22a6dea3487dbf2ea1e007e838a7/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:04.765824 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff345f9-c64c-460e-b591-a8450a565eb3 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:04.766211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff345f9-c64c-460e-b591-a8450a565eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:04.766565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff345f9-c64c-460e-b591-a8450a565eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:04.797786 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-6ff345f9-c64c-460e-b591-a8450a565eb3 None None] MFA Rules not processed for user `fefd22a6dea3487dbf2ea1e007e838a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:04.799587 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6ff345f9-c64c-460e-b591-a8450a565eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:04.858301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:04.868277 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1409/2804] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:04.884158 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6669a2-c404-48e2-9165-22fd07bf171e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:04.886128 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5d6669a2-c404-48e2-9165-22fd07bf171e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:04.946162 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6669a2-c404-48e2-9165-22fd07bf171e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:04.949742 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4748bc-03c6-4dc3-8a26-3d8f2204143f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:04.950349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4748bc-03c6-4dc3-8a26-3d8f2204143f service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:04.950632 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4748bc-03c6-4dc3-8a26-3d8f2204143f service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:04.950945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4748bc-03c6-4dc3-8a26-3d8f2204143f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:04.959928 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4748bc-03c6-4dc3-8a26-3d8f2204143f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:04.961349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4748bc-03c6-4dc3-8a26-3d8f2204143f service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:04.970669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1396/2805] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:05.046318 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff345f9-c64c-460e-b591-a8450a565eb3 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:05.056662 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff345f9-c64c-460e-b591-a8450a565eb3 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:05.060238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311469f7-81cf-41dc-8565-e0a3fb198834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:05.060832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311469f7-81cf-41dc-8565-e0a3fb198834 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:05.061115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311469f7-81cf-41dc-8565-e0a3fb198834 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:05.061392 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311469f7-81cf-41dc-8565-e0a3fb198834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:05.118390 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311469f7-81cf-41dc-8565-e0a3fb198834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:05.119893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311469f7-81cf-41dc-8565-e0a3fb198834 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:05.129771 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1410/2806] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:12.156356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4748bc-03c6-4dc3-8a26-3d8f2204143f service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:12.219658 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4748bc-03c6-4dc3-8a26-3d8f2204143f service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:12.224348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:12.225097 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:12.225382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:12.225662 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] PATH_INFO: `/v3/users/a99f4f9e8cdb4ae5a3dd4d57f44dd44c` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:12.226815 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99f4f9e8cdb4ae5a3dd4d57f44dd44c)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:12.228758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:12.277039 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99f4f9e8cdb4ae5a3dd4d57f44dd44c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:12.285230 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:12.290571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99f4f9e8cdb4ae5a3dd4d57f44dd44c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:12.298167 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99f4f9e8cdb4ae5a3dd4d57f44dd44c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:12.299824 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99f4f9e8cdb4ae5a3dd4d57f44dd44c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:12.300435 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99f4f9e8cdb4ae5a3dd4d57f44dd44c'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:12.312466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1397/2807] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:21:12 2022] DELETE /identity/v3/users/a99f4f9e8cdb4ae5a3dd4d57f44dd44c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:12.317894 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfea53-8c5f-48e7-abf6-bd32e7ed2495 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:12.318417 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfea53-8c5f-48e7-abf6-bd32e7ed2495 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:12.318525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfea53-8c5f-48e7-abf6-bd32e7ed2495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:12.337848 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-3dcfea53-8c5f-48e7-abf6-bd32e7ed2495 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:12.339397 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3dcfea53-8c5f-48e7-abf6-bd32e7ed2495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:12.398049 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1411/2808] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:12.408236 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:12.409643 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:12.467232 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c28a3-004a-48b0-995a-ef9352d8bc7c admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:12.470911 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1385e3-8976-444f-aa91-ca1ee82898c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:12.471527 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1385e3-8976-444f-aa91-ca1ee82898c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:12.471810 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1385e3-8976-444f-aa91-ca1ee82898c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:12.472086 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1385e3-8976-444f-aa91-ca1ee82898c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:12.483473 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1385e3-8976-444f-aa91-ca1ee82898c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:12.484906 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1385e3-8976-444f-aa91-ca1ee82898c6 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:12.495071 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1398/2809] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:12.763106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfea53-8c5f-48e7-abf6-bd32e7ed2495 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:12.764880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-3dcfea53-8c5f-48e7-abf6-bd32e7ed2495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:12.783261 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfea53-8c5f-48e7-abf6-bd32e7ed2495 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:12.787916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:12.788682 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:12.788833 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:12.789114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] PATH_INFO: `/v3/projects/08160fce16a047dd9809653ba333dd2f` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:12.790291 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08160fce16a047dd9809653ba333dd2f)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:12.792188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:12.838953 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08160fce16a047dd9809653ba333dd2f', 'request_id': 'req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:12.846822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08160fce16a047dd9809653ba333dd2f', 'request_id': 'req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:12.853118 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08160fce16a047dd9809653ba333dd2f', 'request_id': 'req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:12.863261 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] The token cache is being invalidate because project 08160fce16a047dd9809653ba333dd2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:21:12.863548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:12.864180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:12.865674 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1412/2810] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:21:12 2022] DELETE /identity/v3/projects/08160fce16a047dd9809653ba333dd2f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:12.869689 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1385e3-8976-444f-aa91-ca1ee82898c6 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:12.879972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1385e3-8976-444f-aa91-ca1ee82898c6 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:12.937737 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5f823-b2b0-41f8-a0bd-e4cd96926f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:12.938378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5f823-b2b0-41f8-a0bd-e4cd96926f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:12.938666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5f823-b2b0-41f8-a0bd-e4cd96926f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:12.938970 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5f823-b2b0-41f8-a0bd-e4cd96926f4c admin admin] PATH_INFO: `/v3/users/fefd22a6dea3487dbf2ea1e007e838a7` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:12.940174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5f823-b2b0-41f8-a0bd-e4cd96926f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fefd22a6dea3487dbf2ea1e007e838a7)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:12.942094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5f823-b2b0-41f8-a0bd-e4cd96926f4c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:12.993404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aea5f823-b2b0-41f8-a0bd-e4cd96926f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fefd22a6dea3487dbf2ea1e007e838a7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:13.005609 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aea5f823-b2b0-41f8-a0bd-e4cd96926f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fefd22a6dea3487dbf2ea1e007e838a7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:13.012181 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aea5f823-b2b0-41f8-a0bd-e4cd96926f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fefd22a6dea3487dbf2ea1e007e838a7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:13.012883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aea5f823-b2b0-41f8-a0bd-e4cd96926f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fefd22a6dea3487dbf2ea1e007e838a7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:13.013487 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aea5f823-b2b0-41f8-a0bd-e4cd96926f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fefd22a6dea3487dbf2ea1e007e838a7'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:13.021604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:13.027705 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1399/2811] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:21:12 2022] DELETE /identity/v3/users/fefd22a6dea3487dbf2ea1e007e838a7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:13.305918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:13.307445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:13.321612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a9a5-35f6-4f1b-a74a-506349e1c3b9 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:13.337027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:13.385889 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:13.386589 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:13.386937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:13.387239 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b admin admin] PATH_INFO: `/v3/projects/fad80b2e98a84f1896eb694257d12411` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:13.388643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad80b2e98a84f1896eb694257d12411)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:13.390587 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:13.442045 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad80b2e98a84f1896eb694257d12411', 'request_id': 'req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:13.450791 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad80b2e98a84f1896eb694257d12411', 'request_id': 'req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:13.458428 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad80b2e98a84f1896eb694257d12411', 'request_id': 'req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:13.469402 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b admin admin] The token cache is being invalidate because project fad80b2e98a84f1896eb694257d12411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:21:13.469684 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:13.470350 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-f2f287ef-e395-4fbd-9592-5b863bdc5b9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:13.472399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1413/2812] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:21:13 2022] DELETE /identity/v3/projects/fad80b2e98a84f1896eb694257d12411 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:13.478479 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28845a5-332b-42b2-8f99-de2c8bad4c4d None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:13.479037 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28845a5-332b-42b2-8f99-de2c8bad4c4d None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:13.479148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28845a5-332b-42b2-8f99-de2c8bad4c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:13.499660 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-a28845a5-332b-42b2-8f99-de2c8bad4c4d None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:13.500896 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a28845a5-332b-42b2-8f99-de2c8bad4c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:13.575369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1400/2813] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:21:13.585858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1bcbc-aa5c-4f5f-9630-02a822ace4a4 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:13.586228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1bcbc-aa5c-4f5f-9630-02a822ace4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:13.586419 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1bcbc-aa5c-4f5f-9630-02a822ace4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:13.607699 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-cde1bcbc-aa5c-4f5f-9630-02a822ace4a4 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:13.608939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-cde1bcbc-aa5c-4f5f-9630-02a822ace4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:13.617427 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1414/2814] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:13.621752 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28845a5-332b-42b2-8f99-de2c8bad4c4d None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:13.632942 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28845a5-332b-42b2-8f99-de2c8bad4c4d None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:13.637650 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72fb9d-5544-460d-a949-d0721ab65248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:13.638202 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72fb9d-5544-460d-a949-d0721ab65248 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:13.638484 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72fb9d-5544-460d-a949-d0721ab65248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:13.638789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72fb9d-5544-460d-a949-d0721ab65248 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:13.639452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72fb9d-5544-460d-a949-d0721ab65248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:21:13.639762 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72fb9d-5544-460d-a949-d0721ab65248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:13.641360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72fb9d-5544-460d-a949-d0721ab65248 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:13.653797 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1401/2815] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:21:13.659278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1bcbc-aa5c-4f5f-9630-02a822ace4a4 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:13.668670 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1bcbc-aa5c-4f5f-9630-02a822ace4a4 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:13.673555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa6425-00f1-4587-9e64-a840737f0cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:13.674775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa6425-00f1-4587-9e64-a840737f0cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:13.675161 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa6425-00f1-4587-9e64-a840737f0cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:13.675446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa6425-00f1-4587-9e64-a840737f0cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:13.676092 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa6425-00f1-4587-9e64-a840737f0cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:13.677994 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa6425-00f1-4587-9e64-a840737f0cf2 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:13.707908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1415/2816] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:21:13 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:13.709121 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72fb9d-5544-460d-a949-d0721ab65248 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:13.719420 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72fb9d-5544-460d-a949-d0721ab65248 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:13.781402 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ea2ee-341b-4f91-b87c-c98c745fab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:13.782017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ea2ee-341b-4f91-b87c-c98c745fab5a admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:13.782303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ea2ee-341b-4f91-b87c-c98c745fab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:13.782864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ea2ee-341b-4f91-b87c-c98c745fab5a admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:13.784085 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ea2ee-341b-4f91-b87c-c98c745fab5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:13.786205 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ea2ee-341b-4f91-b87c-c98c745fab5a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:13.811300 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1402/2817] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:21:13 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:13.815372 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa6425-00f1-4587-9e64-a840737f0cf2 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:13.826134 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa6425-00f1-4587-9e64-a840737f0cf2 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:13.831445 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd8f79-18d5-4921-ac7a-ed39a9f4ba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:13.832058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd8f79-18d5-4921-ac7a-ed39a9f4ba85 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:13.832364 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd8f79-18d5-4921-ac7a-ed39a9f4ba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:13.832649 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd8f79-18d5-4921-ac7a-ed39a9f4ba85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:13.833303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd8f79-18d5-4921-ac7a-ed39a9f4ba85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:13.834984 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd8f79-18d5-4921-ac7a-ed39a9f4ba85 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:13.846811 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1416/2818] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:13.850185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ea2ee-341b-4f91-b87c-c98c745fab5a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:13.860830 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ea2ee-341b-4f91-b87c-c98c745fab5a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:13.866053 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315eafe2-7726-471d-9882-46fe485300f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:13.866708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eafe2-7726-471d-9882-46fe485300f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:13.867070 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eafe2-7726-471d-9882-46fe485300f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:13.867349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eafe2-7726-471d-9882-46fe485300f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:13.868044 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315eafe2-7726-471d-9882-46fe485300f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:13.869655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315eafe2-7726-471d-9882-46fe485300f8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:13.881533 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1403/2819] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:13.885772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd8f79-18d5-4921-ac7a-ed39a9f4ba85 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:13.896634 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd8f79-18d5-4921-ac7a-ed39a9f4ba85 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:13.901278 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980921fc-6676-4e14-a5c2-da5d3bdd4c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:13.901934 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980921fc-6676-4e14-a5c2-da5d3bdd4c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:13.902219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980921fc-6676-4e14-a5c2-da5d3bdd4c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:13.902497 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980921fc-6676-4e14-a5c2-da5d3bdd4c15 admin admin] PATH_INFO: `/v3/projects/37b632b6d2474d6bb8119dac858a9072/users/f7a364e309fb4a1cb9aa8b6de536964e/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:13.918240 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980921fc-6676-4e14-a5c2-da5d3bdd4c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37b632b6d2474d6bb8119dac858a9072, user_id=f7a364e309fb4a1cb9aa8b6de536964e, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:13.920907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980921fc-6676-4e14-a5c2-da5d3bdd4c15 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:13.935075 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1417/2820] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:13 2022] PUT /identity/v3/projects/37b632b6d2474d6bb8119dac858a9072/users/f7a364e309fb4a1cb9aa8b6de536964e/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:21:13.947154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1bdbd-210e-4b40-bc1f-a6b745093a86 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:13.947445 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1bdbd-210e-4b40-bc1f-a6b745093a86 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:13.947735 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1bdbd-210e-4b40-bc1f-a6b745093a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:13.975990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-abd1bdbd-210e-4b40-bc1f-a6b745093a86 None None] MFA Rules not processed for user `f7a364e309fb4a1cb9aa8b6de536964e`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:13.977223 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-abd1bdbd-210e-4b40-bc1f-a6b745093a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:14.034424 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:14.046066 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1404/2821] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:14.051293 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980921fc-6676-4e14-a5c2-da5d3bdd4c15 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:14.104948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:14.122679 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980921fc-6676-4e14-a5c2-da5d3bdd4c15 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:14.127923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd267e39-1c58-4e58-8709-5a0229eb43d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:14.128541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd267e39-1c58-4e58-8709-5a0229eb43d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:14.128822 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd267e39-1c58-4e58-8709-5a0229eb43d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:14.129096 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd267e39-1c58-4e58-8709-5a0229eb43d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:14.129728 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd267e39-1c58-4e58-8709-5a0229eb43d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:14.131656 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd267e39-1c58-4e58-8709-5a0229eb43d2 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:14.161035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1418/2822] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:21:14 2022] POST /identity/v3/projects => generated 401 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:14.165101 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1bdbd-210e-4b40-bc1f-a6b745093a86 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:14.176683 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1bdbd-210e-4b40-bc1f-a6b745093a86 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:14.235843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804c4e6-1bb9-47bb-8cd5-61950b976ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:14.237021 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c4e6-1bb9-47bb-8cd5-61950b976ecd admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:14.237313 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c4e6-1bb9-47bb-8cd5-61950b976ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:14.237579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c4e6-1bb9-47bb-8cd5-61950b976ecd admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:14.238215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804c4e6-1bb9-47bb-8cd5-61950b976ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:14.240169 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804c4e6-1bb9-47bb-8cd5-61950b976ecd admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:14.261644 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1405/2823] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:21:14 2022] POST /identity/v3/users => generated 307 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:14.266385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd267e39-1c58-4e58-8709-5a0229eb43d2 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:14.277761 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd267e39-1c58-4e58-8709-5a0229eb43d2 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:14.283596 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70214-ba08-47b9-b8b4-19a6d7d471cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:14.284327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70214-ba08-47b9-b8b4-19a6d7d471cf admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:14.284612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70214-ba08-47b9-b8b4-19a6d7d471cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:14.284899 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70214-ba08-47b9-b8b4-19a6d7d471cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:14.285545 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba70214-ba08-47b9-b8b4-19a6d7d471cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:14.287191 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba70214-ba08-47b9-b8b4-19a6d7d471cf admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:14.300909 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1419/2824] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:14.305543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804c4e6-1bb9-47bb-8cd5-61950b976ecd admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:14.317465 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804c4e6-1bb9-47bb-8cd5-61950b976ecd admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:14.322588 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7bdeb-be1f-4c55-8725-467245ec447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:14.323278 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7bdeb-be1f-4c55-8725-467245ec447e admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:14.323581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7bdeb-be1f-4c55-8725-467245ec447e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:14.323854 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7bdeb-be1f-4c55-8725-467245ec447e admin admin] PATH_INFO: `/v3/projects/d70bc40187cc45f0a3f00c337d7a015c/users/8b199951f0554f5fbcef89d0db372557/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:14.344303 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7bdeb-be1f-4c55-8725-467245ec447e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70bc40187cc45f0a3f00c337d7a015c, user_id=8b199951f0554f5fbcef89d0db372557, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:14.350488 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7bdeb-be1f-4c55-8725-467245ec447e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:14.365930 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1406/2825] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:14 2022] PUT /identity/v3/projects/d70bc40187cc45f0a3f00c337d7a015c/users/8b199951f0554f5fbcef89d0db372557/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:21:14.370080 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70214-ba08-47b9-b8b4-19a6d7d471cf admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:14.380633 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70214-ba08-47b9-b8b4-19a6d7d471cf admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:14.443339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f861c16-979f-4204-bfa3-0a1902b5c389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:14.443951 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f861c16-979f-4204-bfa3-0a1902b5c389 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:14.444228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f861c16-979f-4204-bfa3-0a1902b5c389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:14.444500 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f861c16-979f-4204-bfa3-0a1902b5c389 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:14.445167 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f861c16-979f-4204-bfa3-0a1902b5c389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:14.446767 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f861c16-979f-4204-bfa3-0a1902b5c389 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:14.458213 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1420/2826] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:14.462549 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7bdeb-be1f-4c55-8725-467245ec447e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:14.473981 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7bdeb-be1f-4c55-8725-467245ec447e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:14.479543 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ad3a4-a563-4ae1-8f39-558327bf7400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:14.480210 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ad3a4-a563-4ae1-8f39-558327bf7400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:14.480486 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ad3a4-a563-4ae1-8f39-558327bf7400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:14.480761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ad3a4-a563-4ae1-8f39-558327bf7400 admin admin] PATH_INFO: `/v3/projects/d70bc40187cc45f0a3f00c337d7a015c/users/8b199951f0554f5fbcef89d0db372557/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:14.482728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ad3a4-a563-4ae1-8f39-558327bf7400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70bc40187cc45f0a3f00c337d7a015c, user_id=8b199951f0554f5fbcef89d0db372557, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:14.485370 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ad3a4-a563-4ae1-8f39-558327bf7400 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:14.496783 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1407/2827] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:14 2022] PUT /identity/v3/projects/d70bc40187cc45f0a3f00c337d7a015c/users/8b199951f0554f5fbcef89d0db372557/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:21:14.507188 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c7a08-a18a-442a-80ac-284e405f4f2d None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:14.507467 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c7a08-a18a-442a-80ac-284e405f4f2d None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:14.507734 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c7a08-a18a-442a-80ac-284e405f4f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:14.536908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-ef2c7a08-a18a-442a-80ac-284e405f4f2d None None] MFA Rules not processed for user `8b199951f0554f5fbcef89d0db372557`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:14.538446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-ef2c7a08-a18a-442a-80ac-284e405f4f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:14.608554 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1421/2828] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:14.620758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ad3a4-a563-4ae1-8f39-558327bf7400 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:14.622497 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3e3ad3a4-a563-4ae1-8f39-558327bf7400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:14.806534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ad3a4-a563-4ae1-8f39-558327bf7400 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:14.810364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefd05b-d9d4-401f-888d-131449ca9bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:14.811016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefd05b-d9d4-401f-888d-131449ca9bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:14.811301 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefd05b-d9d4-401f-888d-131449ca9bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:14.811578 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefd05b-d9d4-401f-888d-131449ca9bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:14.821789 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefd05b-d9d4-401f-888d-131449ca9bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:14.823246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefd05b-d9d4-401f-888d-131449ca9bb6 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:14.832682 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1408/2829] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:14 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:14.909316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c7a08-a18a-442a-80ac-284e405f4f2d None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:14.918990 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c7a08-a18a-442a-80ac-284e405f4f2d None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:14.922541 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0fa64-a924-443c-9cce-59c77f6854d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:14.923175 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0fa64-a924-443c-9cce-59c77f6854d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:14.923456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0fa64-a924-443c-9cce-59c77f6854d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:14.924284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0fa64-a924-443c-9cce-59c77f6854d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:14.963287 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:14.983220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0fa64-a924-443c-9cce-59c77f6854d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:14.984655 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0fa64-a924-443c-9cce-59c77f6854d7 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:14.994238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1422/2830] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:14 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:19.090053 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefd05b-d9d4-401f-888d-131449ca9bb6 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:19.146648 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:19.165675 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefd05b-d9d4-401f-888d-131449ca9bb6 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:19.172356 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:19.172931 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:19.173215 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:19.173492 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] PATH_INFO: `/v3/users/f7a364e309fb4a1cb9aa8b6de536964e` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:19.175212 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a364e309fb4a1cb9aa8b6de536964e)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:19.177145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:19.231170 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a364e309fb4a1cb9aa8b6de536964e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.252432 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a364e309fb4a1cb9aa8b6de536964e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.260462 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a364e309fb4a1cb9aa8b6de536964e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.261429 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a364e309fb4a1cb9aa8b6de536964e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.262285 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a364e309fb4a1cb9aa8b6de536964e'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.277655 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1409/2831] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:21:19 2022] DELETE /identity/v3/users/f7a364e309fb4a1cb9aa8b6de536964e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:19.282294 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae951a3-ddf2-42aa-88d9-74ebb3f363ec None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:19.283181 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae951a3-ddf2-42aa-88d9-74ebb3f363ec None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:19.283326 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae951a3-ddf2-42aa-88d9-74ebb3f363ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:19.304041 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-eae951a3-ddf2-42aa-88d9-74ebb3f363ec None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:19.305274 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-eae951a3-ddf2-42aa-88d9-74ebb3f363ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:19.375414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1423/2832] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:19.385641 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:19.387405 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:19.457834 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a5aee-a0b6-474a-9fe0-827771e3c0dc admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:19.461283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7be6-5af7-463b-afdc-e181736fccbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:19.461893 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7be6-5af7-463b-afdc-e181736fccbb service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:19.462178 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7be6-5af7-463b-afdc-e181736fccbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:19.462458 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7be6-5af7-463b-afdc-e181736fccbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:19.472395 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c7be6-5af7-463b-afdc-e181736fccbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:19.473821 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c7be6-5af7-463b-afdc-e181736fccbb service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:19.483439 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1410/2833] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:19.757046 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae951a3-ddf2-42aa-88d9-74ebb3f363ec None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:19.758693 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-eae951a3-ddf2-42aa-88d9-74ebb3f363ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:19.771966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae951a3-ddf2-42aa-88d9-74ebb3f363ec None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:19.776671 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:19.777317 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:19.777602 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:19.777877 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] PATH_INFO: `/v3/projects/37b632b6d2474d6bb8119dac858a9072` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:19.779062 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37b632b6d2474d6bb8119dac858a9072)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:19.780987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:19.830017 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37b632b6d2474d6bb8119dac858a9072', 'request_id': 'req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.837416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37b632b6d2474d6bb8119dac858a9072', 'request_id': 'req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.844016 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37b632b6d2474d6bb8119dac858a9072', 'request_id': 'req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.854823 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] The token cache is being invalidate because project 37b632b6d2474d6bb8119dac858a9072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:21:19.855113 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.855775 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.857324 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1424/2834] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:21:19 2022] DELETE /identity/v3/projects/37b632b6d2474d6bb8119dac858a9072 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:19.861993 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7be6-5af7-463b-afdc-e181736fccbb service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:19.871644 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7be6-5af7-463b-afdc-e181736fccbb service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:19.928007 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1ba0c-6980-44fb-a890-08c979f7082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:19.928642 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1ba0c-6980-44fb-a890-08c979f7082a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:19.928920 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1ba0c-6980-44fb-a890-08c979f7082a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:19.929197 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1ba0c-6980-44fb-a890-08c979f7082a admin admin] PATH_INFO: `/v3/users/8b199951f0554f5fbcef89d0db372557` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:19.930340 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1ba0c-6980-44fb-a890-08c979f7082a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b199951f0554f5fbcef89d0db372557)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:19.932304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1ba0c-6980-44fb-a890-08c979f7082a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:19.945487 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:19.979026 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2ae1ba0c-6980-44fb-a890-08c979f7082a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b199951f0554f5fbcef89d0db372557'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.991065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2ae1ba0c-6980-44fb-a890-08c979f7082a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b199951f0554f5fbcef89d0db372557'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.998412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2ae1ba0c-6980-44fb-a890-08c979f7082a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b199951f0554f5fbcef89d0db372557'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.999033 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2ae1ba0c-6980-44fb-a890-08c979f7082a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b199951f0554f5fbcef89d0db372557'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:19.999646 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-2ae1ba0c-6980-44fb-a890-08c979f7082a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b199951f0554f5fbcef89d0db372557'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:20.012609 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1411/2835] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:21:19 2022] DELETE /identity/v3/users/8b199951f0554f5fbcef89d0db372557 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:21:20.279873 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:20.281344 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:20.294686 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558cda6-6cf3-4ebf-ae68-e6e976a1e9a1 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:20.352420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c919de4-3ba2-412b-8a13-5f137391b461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:20.353088 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c919de4-3ba2-412b-8a13-5f137391b461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:20.353373 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c919de4-3ba2-412b-8a13-5f137391b461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:20.353749 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c919de4-3ba2-412b-8a13-5f137391b461 admin admin] PATH_INFO: `/v3/projects/d70bc40187cc45f0a3f00c337d7a015c` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:20.354866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c919de4-3ba2-412b-8a13-5f137391b461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70bc40187cc45f0a3f00c337d7a015c)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:20.356792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c919de4-3ba2-412b-8a13-5f137391b461 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:20.359155 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:20.406340 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6c919de4-3ba2-412b-8a13-5f137391b461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70bc40187cc45f0a3f00c337d7a015c', 'request_id': 'req-6c919de4-3ba2-412b-8a13-5f137391b461'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:20.414565 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6c919de4-3ba2-412b-8a13-5f137391b461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70bc40187cc45f0a3f00c337d7a015c', 'request_id': 'req-6c919de4-3ba2-412b-8a13-5f137391b461'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:20.420749 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6c919de4-3ba2-412b-8a13-5f137391b461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70bc40187cc45f0a3f00c337d7a015c', 'request_id': 'req-6c919de4-3ba2-412b-8a13-5f137391b461'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:20.431800 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6c919de4-3ba2-412b-8a13-5f137391b461 admin admin] The token cache is being invalidate because project d70bc40187cc45f0a3f00c337d7a015c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:21:20.432091 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6c919de4-3ba2-412b-8a13-5f137391b461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:20.432729 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-6c919de4-3ba2-412b-8a13-5f137391b461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:20.434221 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1425/2836] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:21:20 2022] DELETE /identity/v3/projects/d70bc40187cc45f0a3f00c337d7a015c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:21:20.439129 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1de1f8-ccf4-4ab5-8f85-298760fe483f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:20.440206 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1de1f8-ccf4-4ab5-8f85-298760fe483f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:20.440344 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1de1f8-ccf4-4ab5-8f85-298760fe483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:20.462123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1e1de1f8-ccf4-4ab5-8f85-298760fe483f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:20.463429 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1e1de1f8-ccf4-4ab5-8f85-298760fe483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:20.531378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1412/2837] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:20.540151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246443d-0b48-455d-9755-ff76e2b82a4a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:20.540451 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246443d-0b48-455d-9755-ff76e2b82a4a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:20.540732 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246443d-0b48-455d-9755-ff76e2b82a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:20.561309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-9246443d-0b48-455d-9755-ff76e2b82a4a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:20.562531 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-9246443d-0b48-455d-9755-ff76e2b82a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:20.570847 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1426/2838] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:20.575166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1de1f8-ccf4-4ab5-8f85-298760fe483f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:20.585559 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1de1f8-ccf4-4ab5-8f85-298760fe483f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:20.590715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b473564-ac0f-4b21-bed3-1493a939c224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:20.591349 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473564-ac0f-4b21-bed3-1493a939c224 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:20.591634 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473564-ac0f-4b21-bed3-1493a939c224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:20.591913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473564-ac0f-4b21-bed3-1493a939c224 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:20.592561 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b473564-ac0f-4b21-bed3-1493a939c224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:21:20.592867 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b473564-ac0f-4b21-bed3-1493a939c224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:20.594449 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b473564-ac0f-4b21-bed3-1493a939c224 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:20.606615 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1413/2839] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:21:20.611155 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246443d-0b48-455d-9755-ff76e2b82a4a None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:20.620598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246443d-0b48-455d-9755-ff76e2b82a4a None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:20.625313 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba113-2258-4bbb-a769-e4b9720c67ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:20.625875 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba113-2258-4bbb-a769-e4b9720c67ea admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:20.626162 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba113-2258-4bbb-a769-e4b9720c67ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:20.626442 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba113-2258-4bbb-a769-e4b9720c67ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:20.627464 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaba113-2258-4bbb-a769-e4b9720c67ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:20.629366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaba113-2258-4bbb-a769-e4b9720c67ea admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:20.659558 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1427/2840] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:21:20 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:20.663455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b473564-ac0f-4b21-bed3-1493a939c224 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:20.674144 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b473564-ac0f-4b21-bed3-1493a939c224 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:20.734553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b601a0b-343f-4683-a740-fa59e48ba943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:20.735260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b601a0b-343f-4683-a740-fa59e48ba943 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:20.735545 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b601a0b-343f-4683-a740-fa59e48ba943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:20.735820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b601a0b-343f-4683-a740-fa59e48ba943 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:20.737024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b601a0b-343f-4683-a740-fa59e48ba943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:20.738954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b601a0b-343f-4683-a740-fa59e48ba943 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:20.761392 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1414/2841] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:21:20 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:20.765653 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba113-2258-4bbb-a769-e4b9720c67ea admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:20.776776 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba113-2258-4bbb-a769-e4b9720c67ea admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:20.781486 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9229ca-87c1-475f-9ad8-6758bdc3882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:20.782030 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9229ca-87c1-475f-9ad8-6758bdc3882c admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:20.782312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9229ca-87c1-475f-9ad8-6758bdc3882c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:20.782880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9229ca-87c1-475f-9ad8-6758bdc3882c admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:20.783642 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9229ca-87c1-475f-9ad8-6758bdc3882c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:20.785226 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9229ca-87c1-475f-9ad8-6758bdc3882c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:20.795426 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1428/2842] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 21:21:20.799887 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b601a0b-343f-4683-a740-fa59e48ba943 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:20.810099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b601a0b-343f-4683-a740-fa59e48ba943 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:20.815418 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad158b7-a2dc-4c92-9be2-d25dae72451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:20.816046 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad158b7-a2dc-4c92-9be2-d25dae72451f admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:20.816329 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad158b7-a2dc-4c92-9be2-d25dae72451f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:20.816604 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad158b7-a2dc-4c92-9be2-d25dae72451f admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:20.817247 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad158b7-a2dc-4c92-9be2-d25dae72451f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:20.818866 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad158b7-a2dc-4c92-9be2-d25dae72451f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:20.820189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:20.831189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1415/2843] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:20.835126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9229ca-87c1-475f-9ad8-6758bdc3882c admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:20.845091 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9229ca-87c1-475f-9ad8-6758bdc3882c admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:20.849839 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76340143-85af-4fab-8014-cb1a9b482268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:20.850533 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76340143-85af-4fab-8014-cb1a9b482268 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:20.850844 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76340143-85af-4fab-8014-cb1a9b482268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:20.851124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76340143-85af-4fab-8014-cb1a9b482268 admin admin] PATH_INFO: `/v3/projects/f4284ac4a09d4ae6b3a02b8bcdf2b349/users/022ba0d720c8459cb180680e434c9c60/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:20.868215 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76340143-85af-4fab-8014-cb1a9b482268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4284ac4a09d4ae6b3a02b8bcdf2b349, user_id=022ba0d720c8459cb180680e434c9c60, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:20.870902 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76340143-85af-4fab-8014-cb1a9b482268 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:20.888420 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1429/2844] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:20 2022] PUT /identity/v3/projects/f4284ac4a09d4ae6b3a02b8bcdf2b349/users/022ba0d720c8459cb180680e434c9c60/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:20.955408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085daa58-a48e-4c29-bd74-483174b3dc7f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:20.955688 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085daa58-a48e-4c29-bd74-483174b3dc7f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:20.955976 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085daa58-a48e-4c29-bd74-483174b3dc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:20.992580 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-085daa58-a48e-4c29-bd74-483174b3dc7f None None] MFA Rules not processed for user `022ba0d720c8459cb180680e434c9c60`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:20.993798 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-085daa58-a48e-4c29-bd74-483174b3dc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:21.070701 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1416/2845] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:21.075048 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76340143-85af-4fab-8014-cb1a9b482268 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:21.138539 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76340143-85af-4fab-8014-cb1a9b482268 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:21.143537 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e09fb-d62b-4547-be77-4e72ebeb4a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:21.144148 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e09fb-d62b-4547-be77-4e72ebeb4a2d admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:21.144433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e09fb-d62b-4547-be77-4e72ebeb4a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:21.144709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e09fb-d62b-4547-be77-4e72ebeb4a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:21.145343 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e09fb-d62b-4547-be77-4e72ebeb4a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:21.147288 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e09fb-d62b-4547-be77-4e72ebeb4a2d admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:21.174801 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1430/2846] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:21:21 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:21.178927 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085daa58-a48e-4c29-bd74-483174b3dc7f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:21.189735 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085daa58-a48e-4c29-bd74-483174b3dc7f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:21.246065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1375845-1fb0-4696-9da0-877ff0c89116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:21.246663 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1375845-1fb0-4696-9da0-877ff0c89116 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:21.246972 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1375845-1fb0-4696-9da0-877ff0c89116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:21.247259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1375845-1fb0-4696-9da0-877ff0c89116 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:21.247874 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1375845-1fb0-4696-9da0-877ff0c89116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:21.249781 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1375845-1fb0-4696-9da0-877ff0c89116 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:21.271548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1417/2847] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:21:21 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:21.275588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e09fb-d62b-4547-be77-4e72ebeb4a2d admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:21.286719 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e09fb-d62b-4547-be77-4e72ebeb4a2d admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:21.291332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba1829-9b9b-4d08-b5cb-d197af34759a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:21.291941 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1829-9b9b-4d08-b5cb-d197af34759a admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:21.292229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1829-9b9b-4d08-b5cb-d197af34759a admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:21.292521 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1829-9b9b-4d08-b5cb-d197af34759a admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:21.293150 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba1829-9b9b-4d08-b5cb-d197af34759a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:21.294759 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba1829-9b9b-4d08-b5cb-d197af34759a admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:21.305752 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1431/2848] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:21.309801 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1375845-1fb0-4696-9da0-877ff0c89116 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:21.320094 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1375845-1fb0-4696-9da0-877ff0c89116 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:21.324614 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc99bc-4a78-4ef3-8b15-8d65900eecb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:21.325325 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc99bc-4a78-4ef3-8b15-8d65900eecb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:21.325611 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc99bc-4a78-4ef3-8b15-8d65900eecb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:21.325903 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc99bc-4a78-4ef3-8b15-8d65900eecb8 admin admin] PATH_INFO: `/v3/projects/2e89105f6bc148b193cbf16594d028ee/users/c4f2a67905dd458d912610ce1b1ccd26/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:21.341174 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc99bc-4a78-4ef3-8b15-8d65900eecb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e89105f6bc148b193cbf16594d028ee, user_id=c4f2a67905dd458d912610ce1b1ccd26, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:21.343844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc99bc-4a78-4ef3-8b15-8d65900eecb8 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:21.357952 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1418/2849] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:21 2022] PUT /identity/v3/projects/2e89105f6bc148b193cbf16594d028ee/users/c4f2a67905dd458d912610ce1b1ccd26/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:21.362107 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba1829-9b9b-4d08-b5cb-d197af34759a admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:21.367289 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:21.373611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba1829-9b9b-4d08-b5cb-d197af34759a admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:21.432415 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823e54b-ed7d-44f9-9d2f-686a58d1f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:21.433021 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823e54b-ed7d-44f9-9d2f-686a58d1f8fa admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:21.433320 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823e54b-ed7d-44f9-9d2f-686a58d1f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:21.433621 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823e54b-ed7d-44f9-9d2f-686a58d1f8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:21.434257 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823e54b-ed7d-44f9-9d2f-686a58d1f8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:21.435896 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823e54b-ed7d-44f9-9d2f-686a58d1f8fa admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:21.445654 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1432/2850] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:21.449917 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc99bc-4a78-4ef3-8b15-8d65900eecb8 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:21.460734 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc99bc-4a78-4ef3-8b15-8d65900eecb8 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:21.465377 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3207a-6024-43d9-900c-45f07ae22c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:21.466027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3207a-6024-43d9-900c-45f07ae22c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:21.466311 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3207a-6024-43d9-900c-45f07ae22c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:21.466593 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3207a-6024-43d9-900c-45f07ae22c25 admin admin] PATH_INFO: `/v3/projects/2e89105f6bc148b193cbf16594d028ee/users/c4f2a67905dd458d912610ce1b1ccd26/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:21.468665 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3207a-6024-43d9-900c-45f07ae22c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e89105f6bc148b193cbf16594d028ee, user_id=c4f2a67905dd458d912610ce1b1ccd26, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:21.472221 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3207a-6024-43d9-900c-45f07ae22c25 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:21.482759 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1419/2851] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:21 2022] PUT /identity/v3/projects/2e89105f6bc148b193cbf16594d028ee/users/c4f2a67905dd458d912610ce1b1ccd26/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:21.493403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321e8fe-eef1-45f3-a8cc-b221511a5089 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:21.493692 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321e8fe-eef1-45f3-a8cc-b221511a5089 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:21.494040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321e8fe-eef1-45f3-a8cc-b221511a5089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:21.522289 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-0321e8fe-eef1-45f3-a8cc-b221511a5089 None None] MFA Rules not processed for user `c4f2a67905dd458d912610ce1b1ccd26`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:21.523554 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0321e8fe-eef1-45f3-a8cc-b221511a5089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:21.591432 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1433/2852] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:21.603671 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3207a-6024-43d9-900c-45f07ae22c25 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:21.605372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-88c3207a-6024-43d9-900c-45f07ae22c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:21.648695 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:21.665031 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3207a-6024-43d9-900c-45f07ae22c25 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:21.668667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c109a57-983f-41d1-af86-4c241c55b9d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:21.669270 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c109a57-983f-41d1-af86-4c241c55b9d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:21.669550 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c109a57-983f-41d1-af86-4c241c55b9d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:21.669822 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c109a57-983f-41d1-af86-4c241c55b9d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:21.678885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c109a57-983f-41d1-af86-4c241c55b9d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:21.680304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c109a57-983f-41d1-af86-4c241c55b9d5 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:21.690070 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1420/2853] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:21.781172 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321e8fe-eef1-45f3-a8cc-b221511a5089 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:21.792195 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321e8fe-eef1-45f3-a8cc-b221511a5089 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:21.795891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e86f4-d2cf-461b-9106-25d9c1974fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:21.796501 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e86f4-d2cf-461b-9106-25d9c1974fde service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:21.796782 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e86f4-d2cf-461b-9106-25d9c1974fde service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:21.797065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e86f4-d2cf-461b-9106-25d9c1974fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:21.864534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e86f4-d2cf-461b-9106-25d9c1974fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:21.865885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e86f4-d2cf-461b-9106-25d9c1974fde service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:21.875378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1434/2854] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:22.165815 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c109a57-983f-41d1-af86-4c241c55b9d5 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:22.228759 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c109a57-983f-41d1-af86-4c241c55b9d5 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:22.233343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:22.233975 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:22.234256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:22.234532 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] PATH_INFO: `/v3/users/022ba0d720c8459cb180680e434c9c60` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:22.235687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=022ba0d720c8459cb180680e434c9c60)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:22.238106 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:22.283786 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '022ba0d720c8459cb180680e434c9c60'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:22.295341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '022ba0d720c8459cb180680e434c9c60'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:22.303505 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '022ba0d720c8459cb180680e434c9c60'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:22.304153 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '022ba0d720c8459cb180680e434c9c60'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:22.304768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '022ba0d720c8459cb180680e434c9c60'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:22.317229 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1421/2855] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:21:22 2022] DELETE /identity/v3/users/022ba0d720c8459cb180680e434c9c60 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:22.321666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a68b9e-45c2-41d2-9cf8-6130baa33f07 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:22.322177 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a68b9e-45c2-41d2-9cf8-6130baa33f07 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:22.322307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a68b9e-45c2-41d2-9cf8-6130baa33f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:22.341099 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-a3a68b9e-45c2-41d2-9cf8-6130baa33f07 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:22.342347 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a3a68b9e-45c2-41d2-9cf8-6130baa33f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:22.359801 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=100 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:22.404908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1435/2856] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:21:22.415452 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:22.417067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:22.480199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7da66-6e10-40ae-b11b-8290c009c7ad admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:22.484289 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa2063-74c2-4bd5-80eb-57b65017e887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:22.484918 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa2063-74c2-4bd5-80eb-57b65017e887 service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:22.485200 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa2063-74c2-4bd5-80eb-57b65017e887 service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:22.485483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa2063-74c2-4bd5-80eb-57b65017e887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:22.497858 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa2063-74c2-4bd5-80eb-57b65017e887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:22.499378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa2063-74c2-4bd5-80eb-57b65017e887 service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:22.510099 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1422/2857] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:22.831667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a68b9e-45c2-41d2-9cf8-6130baa33f07 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:22.833114 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-a3a68b9e-45c2-41d2-9cf8-6130baa33f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:22.846581 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a68b9e-45c2-41d2-9cf8-6130baa33f07 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:22.851576 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:22.852885 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:22.853312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:22.853594 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] PATH_INFO: `/v3/projects/f4284ac4a09d4ae6b3a02b8bcdf2b349` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:22.854790 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4284ac4a09d4ae6b3a02b8bcdf2b349)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:22.856652 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:22.904799 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4284ac4a09d4ae6b3a02b8bcdf2b349', 'request_id': 'req-30b21fdb-501c-4645-a9c0-6ba5003610e6'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:22.912756 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4284ac4a09d4ae6b3a02b8bcdf2b349', 'request_id': 'req-30b21fdb-501c-4645-a9c0-6ba5003610e6'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:22.919044 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4284ac4a09d4ae6b3a02b8bcdf2b349', 'request_id': 'req-30b21fdb-501c-4645-a9c0-6ba5003610e6'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:22.930306 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] The token cache is being invalidate because project f4284ac4a09d4ae6b3a02b8bcdf2b349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:21:22.930603 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:22.931286 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:22.932787 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1436/2858] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:21:22 2022] DELETE /identity/v3/projects/f4284ac4a09d4ae6b3a02b8bcdf2b349 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:22.936945 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa2063-74c2-4bd5-80eb-57b65017e887 service neutron] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:22.942513 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:22.949008 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa2063-74c2-4bd5-80eb-57b65017e887 service neutron] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:23.005245 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef5c9b-ffa1-4c32-9bda-95dee012bbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:23.005864 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef5c9b-ffa1-4c32-9bda-95dee012bbdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:23.006144 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef5c9b-ffa1-4c32-9bda-95dee012bbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:23.006419 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef5c9b-ffa1-4c32-9bda-95dee012bbdc admin admin] PATH_INFO: `/v3/users/c4f2a67905dd458d912610ce1b1ccd26` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:23.007673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef5c9b-ffa1-4c32-9bda-95dee012bbdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4f2a67905dd458d912610ce1b1ccd26)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:23.009574 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef5c9b-ffa1-4c32-9bda-95dee012bbdc admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:23.056888 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-abef5c9b-ffa1-4c32-9bda-95dee012bbdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4f2a67905dd458d912610ce1b1ccd26'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:23.069283 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-abef5c9b-ffa1-4c32-9bda-95dee012bbdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4f2a67905dd458d912610ce1b1ccd26'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:23.077219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-abef5c9b-ffa1-4c32-9bda-95dee012bbdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4f2a67905dd458d912610ce1b1ccd26'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:23.077889 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-abef5c9b-ffa1-4c32-9bda-95dee012bbdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4f2a67905dd458d912610ce1b1ccd26'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:23.079669 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-abef5c9b-ffa1-4c32-9bda-95dee012bbdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4f2a67905dd458d912610ce1b1ccd26'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:23.093052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1423/2859] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:21:22 2022] DELETE /identity/v3/users/c4f2a67905dd458d912610ce1b1ccd26 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:23.375716 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:23.377977 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:23.395463 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b21fdb-501c-4645-a9c0-6ba5003610e6 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:23.455007 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:23.455538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:23.455817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:23.456089 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c admin admin] PATH_INFO: `/v3/projects/2e89105f6bc148b193cbf16594d028ee` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:23.457205 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e89105f6bc148b193cbf16594d028ee)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:23.459133 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:23.506108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:23.507701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e89105f6bc148b193cbf16594d028ee', 'request_id': 'req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:23.515702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e89105f6bc148b193cbf16594d028ee', 'request_id': 'req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:23.523085 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e89105f6bc148b193cbf16594d028ee', 'request_id': 'req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:23.536242 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c admin admin] The token cache is being invalidate because project 2e89105f6bc148b193cbf16594d028ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:21:23.536529 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:23.537172 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-1d8c97ac-1d84-4bd9-b395-fbfb93a1303c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:23.538764 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1437/2860] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:21:23 2022] DELETE /identity/v3/projects/2e89105f6bc148b193cbf16594d028ee => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:23.543790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2418e0-7a91-433c-84dc-0493a944c62a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:23.544285 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2418e0-7a91-433c-84dc-0493a944c62a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:23.544387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2418e0-7a91-433c-84dc-0493a944c62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:23.565510 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1f2418e0-7a91-433c-84dc-0493a944c62a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:23.566754 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1f2418e0-7a91-433c-84dc-0493a944c62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:23.625943 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1424/2861] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:23.635141 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1f72f-5881-49e0-a907-b9be36db1dd6 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:23.635507 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1f72f-5881-49e0-a907-b9be36db1dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:23.635784 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1f72f-5881-49e0-a907-b9be36db1dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:23.655511 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-94b1f72f-5881-49e0-a907-b9be36db1dd6 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:23.656709 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-94b1f72f-5881-49e0-a907-b9be36db1dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:23.665339 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1438/2862] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:23.670199 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2418e0-7a91-433c-84dc-0493a944c62a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:23.679934 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2418e0-7a91-433c-84dc-0493a944c62a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:23.684425 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfebd6-abb5-498b-a2d7-867799b7d403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:23.685016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfebd6-abb5-498b-a2d7-867799b7d403 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:23.685295 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfebd6-abb5-498b-a2d7-867799b7d403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:23.685564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfebd6-abb5-498b-a2d7-867799b7d403 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:23.686210 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfebd6-abb5-498b-a2d7-867799b7d403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:21:23.686510 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfebd6-abb5-498b-a2d7-867799b7d403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:23.688123 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfebd6-abb5-498b-a2d7-867799b7d403 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:23.699919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1425/2863] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 21:21:23.704151 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1f72f-5881-49e0-a907-b9be36db1dd6 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:23.713907 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1f72f-5881-49e0-a907-b9be36db1dd6 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:23.718399 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0853a3b-e6c3-48e4-870c-fa341532ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:23.719025 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0853a3b-e6c3-48e4-870c-fa341532ba26 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:23.719303 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0853a3b-e6c3-48e4-870c-fa341532ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:23.719574 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0853a3b-e6c3-48e4-870c-fa341532ba26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:23.720192 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0853a3b-e6c3-48e4-870c-fa341532ba26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:23.722845 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0853a3b-e6c3-48e4-870c-fa341532ba26 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:23.753571 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1439/2864] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:21:23 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:23.754773 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfebd6-abb5-498b-a2d7-867799b7d403 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:23.765061 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfebd6-abb5-498b-a2d7-867799b7d403 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:23.771017 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:23.823367 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8f24e-914d-4b12-84de-073a17475f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:23.823966 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8f24e-914d-4b12-84de-073a17475f5e admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:23.824260 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8f24e-914d-4b12-84de-073a17475f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:23.824517 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8f24e-914d-4b12-84de-073a17475f5e admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:23.825131 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8f24e-914d-4b12-84de-073a17475f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:23.827065 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8f24e-914d-4b12-84de-073a17475f5e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:23.850165 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1426/2865] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:21:23 2022] POST /identity/v3/users => generated 280 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:23.854419 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0853a3b-e6c3-48e4-870c-fa341532ba26 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:23.864882 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0853a3b-e6c3-48e4-870c-fa341532ba26 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:23.869433 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3291697-9b3b-425b-8741-51dc09677242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:23.870035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291697-9b3b-425b-8741-51dc09677242 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:23.870316 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291697-9b3b-425b-8741-51dc09677242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:23.870590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291697-9b3b-425b-8741-51dc09677242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:23.871266 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3291697-9b3b-425b-8741-51dc09677242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:23.872856 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3291697-9b3b-425b-8741-51dc09677242 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:23.882916 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1440/2866] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:23.886951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8f24e-914d-4b12-84de-073a17475f5e admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:23.897742 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8f24e-914d-4b12-84de-073a17475f5e admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:23.902347 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb81f6d-a2a4-4176-928c-e46ecca00b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:23.902978 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb81f6d-a2a4-4176-928c-e46ecca00b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:23.903293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb81f6d-a2a4-4176-928c-e46ecca00b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:23.903571 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb81f6d-a2a4-4176-928c-e46ecca00b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:23.904249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb81f6d-a2a4-4176-928c-e46ecca00b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:23.905843 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb81f6d-a2a4-4176-928c-e46ecca00b7c admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:23.918728 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1427/2867] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:23.922920 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3291697-9b3b-425b-8741-51dc09677242 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:23.933702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3291697-9b3b-425b-8741-51dc09677242 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:23.938555 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86641d-54cc-4584-ba14-3955a49a82f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:23.939829 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86641d-54cc-4584-ba14-3955a49a82f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:23.940179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86641d-54cc-4584-ba14-3955a49a82f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:23.940468 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86641d-54cc-4584-ba14-3955a49a82f1 admin admin] PATH_INFO: `/v3/projects/e45e4548eddb4297b7f2b066baf3a23d/users/7f7fb67c207a477dba15d87e8846cfd3/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:23.955851 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86641d-54cc-4584-ba14-3955a49a82f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45e4548eddb4297b7f2b066baf3a23d, user_id=7f7fb67c207a477dba15d87e8846cfd3, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:23.958523 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86641d-54cc-4584-ba14-3955a49a82f1 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:23.971744 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1441/2868] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:23 2022] PUT /identity/v3/projects/e45e4548eddb4297b7f2b066baf3a23d/users/7f7fb67c207a477dba15d87e8846cfd3/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:23.982625 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c66151-e073-4090-b453-bc98915bfb6c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:23.982964 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c66151-e073-4090-b453-bc98915bfb6c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:23.983272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c66151-e073-4090-b453-bc98915bfb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:24.012205 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-f2c66151-e073-4090-b453-bc98915bfb6c None None] MFA Rules not processed for user `7f7fb67c207a477dba15d87e8846cfd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:24.013442 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-f2c66151-e073-4090-b453-bc98915bfb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:24.077916 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1428/2869] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:24.111891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86641d-54cc-4584-ba14-3955a49a82f1 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:24.113560 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-7a86641d-54cc-4584-ba14-3955a49a82f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:24.171018 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86641d-54cc-4584-ba14-3955a49a82f1 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:24.174798 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9778c-7b0c-46d4-86b4-cf459fb2e174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:24.175416 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9778c-7b0c-46d4-86b4-cf459fb2e174 service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:24.175700 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9778c-7b0c-46d4-86b4-cf459fb2e174 service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:24.175979 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9778c-7b0c-46d4-86b4-cf459fb2e174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:24.184229 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9778c-7b0c-46d4-86b4-cf459fb2e174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:24.185651 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9778c-7b0c-46d4-86b4-cf459fb2e174 service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:24.195741 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1442/2870] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:24.211387 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c66151-e073-4090-b453-bc98915bfb6c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:24.274286 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c66151-e073-4090-b453-bc98915bfb6c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:24.278832 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:24.279460 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:24.279745 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:24.280023 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] PATH_INFO: `/v3/users/7f7fb67c207a477dba15d87e8846cfd3` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:24.281166 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7fb67c207a477dba15d87e8846cfd3)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:24.283568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:24.305145 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:24.331354 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7fb67c207a477dba15d87e8846cfd3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:24.343246 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7fb67c207a477dba15d87e8846cfd3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:24.351009 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7fb67c207a477dba15d87e8846cfd3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:24.351633 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7fb67c207a477dba15d87e8846cfd3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:24.352251 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7fb67c207a477dba15d87e8846cfd3'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:24.365407 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1429/2871] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:21:24 2022] DELETE /identity/v3/users/7f7fb67c207a477dba15d87e8846cfd3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:24.369939 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2f513-051e-463d-b198-d1f48ea22c87 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:24.370233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2f513-051e-463d-b198-d1f48ea22c87 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:24.370514 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2f513-051e-463d-b198-d1f48ea22c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:24.390160 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-4aa2f513-051e-463d-b198-d1f48ea22c87 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:24.391403 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4aa2f513-051e-463d-b198-d1f48ea22c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:24.450542 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1443/2872] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:24.460575 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:24.461990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:24.524819 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0fdf9-7669-4bd5-971f-fdcf90ff371d admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:24.528710 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50372cc-ed5e-42af-bcff-67fbf72bd04b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:24.529333 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50372cc-ed5e-42af-bcff-67fbf72bd04b service neutron] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:24.529609 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50372cc-ed5e-42af-bcff-67fbf72bd04b service neutron] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:24.529885 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50372cc-ed5e-42af-bcff-67fbf72bd04b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:24.539534 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50372cc-ed5e-42af-bcff-67fbf72bd04b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:24.540951 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50372cc-ed5e-42af-bcff-67fbf72bd04b service neutron] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:24.550919 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1430/2873] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:24.824808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2f513-051e-463d-b198-d1f48ea22c87 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:24.826307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-4aa2f513-051e-463d-b198-d1f48ea22c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:24.843035 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2f513-051e-463d-b198-d1f48ea22c87 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:24.849284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61538649-644a-4128-b4ed-8b5eab1162a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:24.849866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61538649-644a-4128-b4ed-8b5eab1162a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:24.850152 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61538649-644a-4128-b4ed-8b5eab1162a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:24.850431 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61538649-644a-4128-b4ed-8b5eab1162a9 admin admin] PATH_INFO: `/v3/projects/e45e4548eddb4297b7f2b066baf3a23d` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:24.852192 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61538649-644a-4128-b4ed-8b5eab1162a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45e4548eddb4297b7f2b066baf3a23d)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:24.855127 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61538649-644a-4128-b4ed-8b5eab1162a9 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:24.866663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:24.904622 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-61538649-644a-4128-b4ed-8b5eab1162a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45e4548eddb4297b7f2b066baf3a23d', 'request_id': 'req-61538649-644a-4128-b4ed-8b5eab1162a9'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:24.912981 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-61538649-644a-4128-b4ed-8b5eab1162a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45e4548eddb4297b7f2b066baf3a23d', 'request_id': 'req-61538649-644a-4128-b4ed-8b5eab1162a9'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:24.919548 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-61538649-644a-4128-b4ed-8b5eab1162a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45e4548eddb4297b7f2b066baf3a23d', 'request_id': 'req-61538649-644a-4128-b4ed-8b5eab1162a9'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:24.930931 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-61538649-644a-4128-b4ed-8b5eab1162a9 admin admin] The token cache is being invalidate because project e45e4548eddb4297b7f2b066baf3a23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:21:24.931224 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-61538649-644a-4128-b4ed-8b5eab1162a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:24.931866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-61538649-644a-4128-b4ed-8b5eab1162a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:24.933354 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1444/2874] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:21:24 2022] DELETE /identity/v3/projects/e45e4548eddb4297b7f2b066baf3a23d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:24.938287 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099ed3a-1ab3-4023-a295-ae1538b57c5f None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:24.938573 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099ed3a-1ab3-4023-a295-ae1538b57c5f None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:24.938882 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099ed3a-1ab3-4023-a295-ae1538b57c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:24.958413 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-c099ed3a-1ab3-4023-a295-ae1538b57c5f None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:24.959661 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-c099ed3a-1ab3-4023-a295-ae1538b57c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:25.020141 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1431/2875] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:25.027952 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb0e71-bf67-4d1c-acf5-7dbd4811f6a0 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.028238 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb0e71-bf67-4d1c-acf5-7dbd4811f6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.028512 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb0e71-bf67-4d1c-acf5-7dbd4811f6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.049115 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-54cb0e71-bf67-4d1c-acf5-7dbd4811f6a0 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:25.050667 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-54cb0e71-bf67-4d1c-acf5-7dbd4811f6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:25.058526 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1445/2876] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:25.062995 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099ed3a-1ab3-4023-a295-ae1538b57c5f None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:25.073416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099ed3a-1ab3-4023-a295-ae1538b57c5f None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:25.077816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0a01c-584c-4e04-848d-9982bed14447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:25.078408 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0a01c-584c-4e04-848d-9982bed14447 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.078687 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0a01c-584c-4e04-848d-9982bed14447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.078991 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0a01c-584c-4e04-848d-9982bed14447 admin admin] PATH_INFO: `/v3/domains` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.079635 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0a01c-584c-4e04-848d-9982bed14447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:21:25.079999 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0a01c-584c-4e04-848d-9982bed14447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:25.081538 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0a01c-584c-4e04-848d-9982bed14447 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:25.093016 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1432/2877] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:21:25.097406 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb0e71-bf67-4d1c-acf5-7dbd4811f6a0 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:25.106799 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb0e71-bf67-4d1c-acf5-7dbd4811f6a0 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:25.112135 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce26b6-ea4f-4aa0-bbe5-8aac54f83667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:25.112738 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce26b6-ea4f-4aa0-bbe5-8aac54f83667 admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.113022 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce26b6-ea4f-4aa0-bbe5-8aac54f83667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.113301 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce26b6-ea4f-4aa0-bbe5-8aac54f83667 admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.113935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce26b6-ea4f-4aa0-bbe5-8aac54f83667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:25.115898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce26b6-ea4f-4aa0-bbe5-8aac54f83667 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:25.144966 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1446/2878] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:21:25 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:25.149323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0a01c-584c-4e04-848d-9982bed14447 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:25.161157 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0a01c-584c-4e04-848d-9982bed14447 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:25.186974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:25.225938 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600aab7-f421-4228-9332-dbec09bf2f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:25.226548 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600aab7-f421-4228-9332-dbec09bf2f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.226869 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600aab7-f421-4228-9332-dbec09bf2f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.227154 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600aab7-f421-4228-9332-dbec09bf2f49 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.227790 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600aab7-f421-4228-9332-dbec09bf2f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:25.229706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600aab7-f421-4228-9332-dbec09bf2f49 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:25.251831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1433/2879] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:21:25 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:25.256291 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce26b6-ea4f-4aa0-bbe5-8aac54f83667 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:25.268169 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce26b6-ea4f-4aa0-bbe5-8aac54f83667 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:25.272913 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdd9fc-9754-47db-abcd-317520f3aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:25.273514 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdd9fc-9754-47db-abcd-317520f3aac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.273793 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdd9fc-9754-47db-abcd-317520f3aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.274064 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdd9fc-9754-47db-abcd-317520f3aac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.274702 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdd9fc-9754-47db-abcd-317520f3aac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:25.276310 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdd9fc-9754-47db-abcd-317520f3aac1 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:25.286858 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1447/2880] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:25.290960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600aab7-f421-4228-9332-dbec09bf2f49 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:25.301613 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600aab7-f421-4228-9332-dbec09bf2f49 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:25.306393 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf90f0e-e0c1-428e-bc51-598916b68403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:25.307024 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf90f0e-e0c1-428e-bc51-598916b68403 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.307306 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf90f0e-e0c1-428e-bc51-598916b68403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.307583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf90f0e-e0c1-428e-bc51-598916b68403 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.308225 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf90f0e-e0c1-428e-bc51-598916b68403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:25.309808 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf90f0e-e0c1-428e-bc51-598916b68403 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:25.322022 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1434/2881] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:25.326184 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdd9fc-9754-47db-abcd-317520f3aac1 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:25.336233 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdd9fc-9754-47db-abcd-317520f3aac1 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:25.340935 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48085a89-81cb-4639-b1e0-d9e5329fb4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:25.341588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48085a89-81cb-4639-b1e0-d9e5329fb4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.341876 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48085a89-81cb-4639-b1e0-d9e5329fb4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.342157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48085a89-81cb-4639-b1e0-d9e5329fb4ed admin admin] PATH_INFO: `/v3/projects/4395f2d6d8e04cfbab2675b506a5140d/users/b7b0bfcb975f4fd4bb8af1e607738f14/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.356843 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48085a89-81cb-4639-b1e0-d9e5329fb4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4395f2d6d8e04cfbab2675b506a5140d, user_id=b7b0bfcb975f4fd4bb8af1e607738f14, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:25.359525 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48085a89-81cb-4639-b1e0-d9e5329fb4ed admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:25.373401 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1448/2882] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:25 2022] PUT /identity/v3/projects/4395f2d6d8e04cfbab2675b506a5140d/users/b7b0bfcb975f4fd4bb8af1e607738f14/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:25.385412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9e68f-8131-444d-b46b-791b212ded34 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.385700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9e68f-8131-444d-b46b-791b212ded34 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.385977 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9e68f-8131-444d-b46b-791b212ded34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.413366 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-ddc9e68f-8131-444d-b46b-791b212ded34 None None] MFA Rules not processed for user `b7b0bfcb975f4fd4bb8af1e607738f14`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:25.414583 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-ddc9e68f-8131-444d-b46b-791b212ded34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:25.479060 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1435/2883] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:25.483637 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48085a89-81cb-4639-b1e0-d9e5329fb4ed admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:25.546466 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48085a89-81cb-4639-b1e0-d9e5329fb4ed admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:25.552052 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5a55c-e0c3-4bef-9c4b-7a558f7ec8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:25.552660 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5a55c-e0c3-4bef-9c4b-7a558f7ec8ec admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.552945 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5a55c-e0c3-4bef-9c4b-7a558f7ec8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.553247 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5a55c-e0c3-4bef-9c4b-7a558f7ec8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.553938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5a55c-e0c3-4bef-9c4b-7a558f7ec8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:25.556086 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5a55c-e0c3-4bef-9c4b-7a558f7ec8ec admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:25.583434 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1449/2884] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:21:25 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 21:21:25.587466 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9e68f-8131-444d-b46b-791b212ded34 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:25.598445 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9e68f-8131-444d-b46b-791b212ded34 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:25.655831 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85e370-6851-443f-ad15-4e273da395c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:25.656437 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85e370-6851-443f-ad15-4e273da395c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.656722 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85e370-6851-443f-ad15-4e273da395c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.657001 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85e370-6851-443f-ad15-4e273da395c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.658516 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85e370-6851-443f-ad15-4e273da395c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:25.660883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85e370-6851-443f-ad15-4e273da395c3 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:25.682189 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1436/2885] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:21:25 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:25.686194 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5a55c-e0c3-4bef-9c4b-7a558f7ec8ec admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:25.696802 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5a55c-e0c3-4bef-9c4b-7a558f7ec8ec admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:25.701418 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fa955-5086-4874-943e-c231d7a399ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:25.702024 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fa955-5086-4874-943e-c231d7a399ac admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.702309 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fa955-5086-4874-943e-c231d7a399ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.702587 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fa955-5086-4874-943e-c231d7a399ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.703271 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fa955-5086-4874-943e-c231d7a399ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:25.705109 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fa955-5086-4874-943e-c231d7a399ac admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:25.716701 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1450/2886] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:25.721450 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85e370-6851-443f-ad15-4e273da395c3 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:25.731623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85e370-6851-443f-ad15-4e273da395c3 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:25.736884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa38fa-34ed-4da3-b580-8016ce74836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:25.737627 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa38fa-34ed-4da3-b580-8016ce74836e admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.737913 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa38fa-34ed-4da3-b580-8016ce74836e admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.738193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa38fa-34ed-4da3-b580-8016ce74836e admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.738875 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa38fa-34ed-4da3-b580-8016ce74836e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:25.740483 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa38fa-34ed-4da3-b580-8016ce74836e admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:25.751470 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1437/2887] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:25.756142 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fa955-5086-4874-943e-c231d7a399ac admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:25.766163 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fa955-5086-4874-943e-c231d7a399ac admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:25.771640 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6822e6-d7e4-48c8-b6de-58cb470fa867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:25.772313 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6822e6-d7e4-48c8-b6de-58cb470fa867 admin admin] REQUEST_METHOD: `PUT` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.772627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6822e6-d7e4-48c8-b6de-58cb470fa867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.772908 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6822e6-d7e4-48c8-b6de-58cb470fa867 admin admin] PATH_INFO: `/v3/projects/645805e3d2df4473a11b1a110959107c/users/454f0de441b347bc91b154b33e6d6fea/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.776223 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:25.791465 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6822e6-d7e4-48c8-b6de-58cb470fa867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=645805e3d2df4473a11b1a110959107c, user_id=454f0de441b347bc91b154b33e6d6fea, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:25.794206 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6822e6-d7e4-48c8-b6de-58cb470fa867 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:25.808157 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1451/2888] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:25 2022] PUT /identity/v3/projects/645805e3d2df4473a11b1a110959107c/users/454f0de441b347bc91b154b33e6d6fea/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:21:25.818730 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e5630-5322-4591-b2d5-e3744737ca8c None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.819146 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e5630-5322-4591-b2d5-e3744737ca8c None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.819304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e5630-5322-4591-b2d5-e3744737ca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.844579 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:25.847886 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-5d5e5630-5322-4591-b2d5-e3744737ca8c None None] MFA Rules not processed for user `454f0de441b347bc91b154b33e6d6fea`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:25.849766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-5d5e5630-5322-4591-b2d5-e3744737ca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:25.915633 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1438/2889] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:25.920126 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6822e6-d7e4-48c8-b6de-58cb470fa867 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:25.982202 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6822e6-d7e4-48c8-b6de-58cb470fa867 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:25.987686 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aa2b7-48f5-45fb-85b1-750c7581085e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:25.988302 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa2b7-48f5-45fb-85b1-750c7581085e admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:25.988583 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa2b7-48f5-45fb-85b1-750c7581085e admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:25.988863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa2b7-48f5-45fb-85b1-750c7581085e admin admin] PATH_INFO: `/v3/projects` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:25.989502 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aa2b7-48f5-45fb-85b1-750c7581085e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:25.991482 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aa2b7-48f5-45fb-85b1-750c7581085e admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:26.020003 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1452/2890] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:21:25 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:26.023597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e5630-5322-4591-b2d5-e3744737ca8c None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:26.034859 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e5630-5322-4591-b2d5-e3744737ca8c None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:26.093842 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9438e-b3f6-4e17-b287-ac71a26e81f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:26.094455 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9438e-b3f6-4e17-b287-ac71a26e81f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:26.094820 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9438e-b3f6-4e17-b287-ac71a26e81f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:26.095043 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9438e-b3f6-4e17-b287-ac71a26e81f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:26.096028 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9438e-b3f6-4e17-b287-ac71a26e81f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:26.097954 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9438e-b3f6-4e17-b287-ac71a26e81f2 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:26.119416 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1439/2891] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:21:26 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:26.124866 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aa2b7-48f5-45fb-85b1-750c7581085e admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:26.136099 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aa2b7-48f5-45fb-85b1-750c7581085e admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:26.140792 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f1a51-6ef1-4fb7-8dda-aaa231f2deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:26.141398 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f1a51-6ef1-4fb7-8dda-aaa231f2deea admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:26.141683 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f1a51-6ef1-4fb7-8dda-aaa231f2deea admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:26.141954 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f1a51-6ef1-4fb7-8dda-aaa231f2deea admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:26.142778 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f1a51-6ef1-4fb7-8dda-aaa231f2deea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:26.144375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f1a51-6ef1-4fb7-8dda-aaa231f2deea admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:26.155404 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1453/2892] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:26.160310 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9438e-b3f6-4e17-b287-ac71a26e81f2 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:26.171364 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9438e-b3f6-4e17-b287-ac71a26e81f2 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:26.176748 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557a1f7-6bdf-40f3-af3f-6f16c710de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:26.177433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a1f7-6bdf-40f3-af3f-6f16c710de1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:26.177714 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a1f7-6bdf-40f3-af3f-6f16c710de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:26.177990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a1f7-6bdf-40f3-af3f-6f16c710de1f admin admin] PATH_INFO: `/v3/projects/31b6ad9e49b54738942a1fb557811781/users/89d9e3282329476b9fab7f0d3e4448f8/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:26.194768 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557a1f7-6bdf-40f3-af3f-6f16c710de1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b6ad9e49b54738942a1fb557811781, user_id=89d9e3282329476b9fab7f0d3e4448f8, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:26.197430 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557a1f7-6bdf-40f3-af3f-6f16c710de1f admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:26.211400 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1440/2893] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:26 2022] PUT /identity/v3/projects/31b6ad9e49b54738942a1fb557811781/users/89d9e3282329476b9fab7f0d3e4448f8/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:26.215572 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f1a51-6ef1-4fb7-8dda-aaa231f2deea admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:26.226251 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f1a51-6ef1-4fb7-8dda-aaa231f2deea admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:26.286577 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f214c50-754d-4072-8654-1f3ca1d49936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:26.287228 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f214c50-754d-4072-8654-1f3ca1d49936 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:26.287518 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f214c50-754d-4072-8654-1f3ca1d49936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:26.287794 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f214c50-754d-4072-8654-1f3ca1d49936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:26.288439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f214c50-754d-4072-8654-1f3ca1d49936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:26.290045 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f214c50-754d-4072-8654-1f3ca1d49936 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:26.300588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1454/2894] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:26.304832 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557a1f7-6bdf-40f3-af3f-6f16c710de1f admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:26.315319 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557a1f7-6bdf-40f3-af3f-6f16c710de1f admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:26.320027 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f43691-54e4-4e94-b0a4-bbcf914e2db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:26.320670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f43691-54e4-4e94-b0a4-bbcf914e2db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:26.320947 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f43691-54e4-4e94-b0a4-bbcf914e2db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:26.321219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f43691-54e4-4e94-b0a4-bbcf914e2db5 admin admin] PATH_INFO: `/v3/projects/31b6ad9e49b54738942a1fb557811781/users/89d9e3282329476b9fab7f0d3e4448f8/roles/50c88cf8d5e64eca8d743b9028a587bc` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:26.323133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f43691-54e4-4e94-b0a4-bbcf914e2db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b6ad9e49b54738942a1fb557811781, user_id=89d9e3282329476b9fab7f0d3e4448f8, role_id=50c88cf8d5e64eca8d743b9028a587bc)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:26.325726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f43691-54e4-4e94-b0a4-bbcf914e2db5 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:26.336358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1441/2895] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:26 2022] PUT /identity/v3/projects/31b6ad9e49b54738942a1fb557811781/users/89d9e3282329476b9fab7f0d3e4448f8/roles/50c88cf8d5e64eca8d743b9028a587bc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:26.347220 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd3851-c1f4-451f-b4e2-fe1d55f3cf6c None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:26.347441 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd3851-c1f4-451f-b4e2-fe1d55f3cf6c None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:26.347722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd3851-c1f4-451f-b4e2-fe1d55f3cf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:26.376312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-78dd3851-c1f4-451f-b4e2-fe1d55f3cf6c None None] MFA Rules not processed for user `89d9e3282329476b9fab7f0d3e4448f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:26.377937 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-78dd3851-c1f4-451f-b4e2-fe1d55f3cf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:26.421579 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:26.447598 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1455/2896] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:26.459536 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f43691-54e4-4e94-b0a4-bbcf914e2db5 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:26.461249 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-12f43691-54e4-4e94-b0a4-bbcf914e2db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:26.528369 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f43691-54e4-4e94-b0a4-bbcf914e2db5 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:26.533756 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cebb7-f4b7-46b1-b65d-f487e88f4aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:26.534551 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cebb7-f4b7-46b1-b65d-f487e88f4aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:26.534884 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cebb7-f4b7-46b1-b65d-f487e88f4aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:26.535316 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cebb7-f4b7-46b1-b65d-f487e88f4aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:26.548254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:26.601765 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cebb7-f4b7-46b1-b65d-f487e88f4aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:26.603148 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cebb7-f4b7-46b1-b65d-f487e88f4aa2 service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:26.612757 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1442/2897] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:28.128625 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd3851-c1f4-451f-b4e2-fe1d55f3cf6c None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:28.130174 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-78dd3851-c1f4-451f-b4e2-fe1d55f3cf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:28.142065 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd3851-c1f4-451f-b4e2-fe1d55f3cf6c None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:28.146244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21c530-0720-4f9c-a278-6c2f9b0e573d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:28.146884 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21c530-0720-4f9c-a278-6c2f9b0e573d service cinder] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:28.147168 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21c530-0720-4f9c-a278-6c2f9b0e573d service cinder] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:28.147439 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21c530-0720-4f9c-a278-6c2f9b0e573d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:28.203961 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21c530-0720-4f9c-a278-6c2f9b0e573d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:28.205314 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21c530-0720-4f9c-a278-6c2f9b0e573d service cinder] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:28.214844 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1456/2898] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:28.740659 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cebb7-f4b7-46b1-b65d-f487e88f4aa2 service cinder] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:28.749740 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cebb7-f4b7-46b1-b65d-f487e88f4aa2 service cinder] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:28.753404 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75ed4b-d2ae-4acb-8d6a-e502a33c565e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:28.754002 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75ed4b-d2ae-4acb-8d6a-e502a33c565e service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:28.754280 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75ed4b-d2ae-4acb-8d6a-e502a33c565e service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:28.754553 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75ed4b-d2ae-4acb-8d6a-e502a33c565e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:28.763576 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75ed4b-d2ae-4acb-8d6a-e502a33c565e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:28.764989 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75ed4b-d2ae-4acb-8d6a-e502a33c565e service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:28.774784 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1443/2899] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:32.642332 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21c530-0720-4f9c-a278-6c2f9b0e573d service cinder] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:32.717210 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21c530-0720-4f9c-a278-6c2f9b0e573d service cinder] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:32.723068 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:32.723748 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:32.724032 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:32.724315 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] PATH_INFO: `/v3/users/b7b0bfcb975f4fd4bb8af1e607738f14` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:32.725570 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b0bfcb975f4fd4bb8af1e607738f14)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:32.727588 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:32.789124 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b0bfcb975f4fd4bb8af1e607738f14'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:32.797279 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b0bfcb975f4fd4bb8af1e607738f14'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:32.797948 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b0bfcb975f4fd4bb8af1e607738f14'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:32.798602 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b0bfcb975f4fd4bb8af1e607738f14'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:32.811294 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b0bfcb975f4fd4bb8af1e607738f14'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:32.819307 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:32.828574 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1457/2900] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:21:32 2022] DELETE /identity/v3/users/b7b0bfcb975f4fd4bb8af1e607738f14 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:32.831293 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4902a-21a3-4791-b016-651ecd4ab80e None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:32.832291 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4902a-21a3-4791-b016-651ecd4ab80e None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:32.832808 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4902a-21a3-4791-b016-651ecd4ab80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:32.854299 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-58f4902a-21a3-4791-b016-651ecd4ab80e None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:32.855555 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-58f4902a-21a3-4791-b016-651ecd4ab80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:32.921444 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1444/2901] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 21:21:32.931627 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:32.933027 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:32.993378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b0f44-834e-4778-806d-0a27e52e4cc9 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:32.997040 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6de5b-1469-4acf-b1eb-cd77a4b36c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:32.997655 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6de5b-1469-4acf-b1eb-cd77a4b36c27 service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:32.997938 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6de5b-1469-4acf-b1eb-cd77a4b36c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:32.998211 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6de5b-1469-4acf-b1eb-cd77a4b36c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:33.008092 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6de5b-1469-4acf-b1eb-cd77a4b36c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:33.009516 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6de5b-1469-4acf-b1eb-cd77a4b36c27 service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:33.019663 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1458/2902] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:21:33.291345 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4902a-21a3-4791-b016-651ecd4ab80e None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:33.292771 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-58f4902a-21a3-4791-b016-651ecd4ab80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:33.307737 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4902a-21a3-4791-b016-651ecd4ab80e None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:33.312358 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:33.313091 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:33.313338 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:33.313591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] PATH_INFO: `/v3/projects/4395f2d6d8e04cfbab2675b506a5140d` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:33.315715 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4395f2d6d8e04cfbab2675b506a5140d)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:33.317766 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:33.369354 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4395f2d6d8e04cfbab2675b506a5140d', 'request_id': 'req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.374700 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4395f2d6d8e04cfbab2675b506a5140d', 'request_id': 'req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.382647 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4395f2d6d8e04cfbab2675b506a5140d', 'request_id': 'req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.394304 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] The token cache is being invalidate because project 4395f2d6d8e04cfbab2675b506a5140d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:21:33.394601 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.395262 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.396743 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1445/2903] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:21:33 2022] DELETE /identity/v3/projects/4395f2d6d8e04cfbab2675b506a5140d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:33.400971 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6de5b-1469-4acf-b1eb-cd77a4b36c27 service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:33.411448 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6de5b-1469-4acf-b1eb-cd77a4b36c27 service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:33.470482 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:33.471146 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:33.472056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:33.472446 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] PATH_INFO: `/v3/users/454f0de441b347bc91b154b33e6d6fea` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:33.473590 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=454f0de441b347bc91b154b33e6d6fea)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:33.475717 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:33.522063 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454f0de441b347bc91b154b33e6d6fea'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.529312 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454f0de441b347bc91b154b33e6d6fea'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.529932 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454f0de441b347bc91b154b33e6d6fea'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.530540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454f0de441b347bc91b154b33e6d6fea'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.543106 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454f0de441b347bc91b154b33e6d6fea'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.555121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1459/2904] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:21:33 2022] DELETE /identity/v3/users/454f0de441b347bc91b154b33e6d6fea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 21:21:33.840827 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:33.842412 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:33.856542 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44d7e4-3d38-4c32-b3ac-f6c1a441112a admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:33.875456 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:33.918380 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:33.918973 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:33.919259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:33.919540 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] PATH_INFO: `/v3/projects/645805e3d2df4473a11b1a110959107c` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:33.920666 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=645805e3d2df4473a11b1a110959107c)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:33.922566 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:33.970783 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645805e3d2df4473a11b1a110959107c', 'request_id': 'req-fe4866d1-6c4a-4289-a49e-6943e08fecbe'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.976599 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645805e3d2df4473a11b1a110959107c', 'request_id': 'req-fe4866d1-6c4a-4289-a49e-6943e08fecbe'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.984089 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645805e3d2df4473a11b1a110959107c', 'request_id': 'req-fe4866d1-6c4a-4289-a49e-6943e08fecbe'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.996052 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] The token cache is being invalidate because project 645805e3d2df4473a11b1a110959107c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:21:33.996375 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.996990 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:33.998463 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1446/2905] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:21:33 2022] DELETE /identity/v3/projects/645805e3d2df4473a11b1a110959107c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:34.002492 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:34.003987 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:34.017214 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbd6c4-6027-4213-9146-8f1fc4376366 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:34.033733 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:34.076244 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97a900-8bde-47e9-9c2a-65c5ef4f14eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:34.076891 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97a900-8bde-47e9-9c2a-65c5ef4f14eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:34.077177 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97a900-8bde-47e9-9c2a-65c5ef4f14eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:34.077460 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97a900-8bde-47e9-9c2a-65c5ef4f14eb admin admin] PATH_INFO: `/v3/users/89d9e3282329476b9fab7f0d3e4448f8` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:34.078630 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97a900-8bde-47e9-9c2a-65c5ef4f14eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d9e3282329476b9fab7f0d3e4448f8)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:34.080611 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97a900-8bde-47e9-9c2a-65c5ef4f14eb admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:34.134058 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0e97a900-8bde-47e9-9c2a-65c5ef4f14eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d9e3282329476b9fab7f0d3e4448f8'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:34.146097 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0e97a900-8bde-47e9-9c2a-65c5ef4f14eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d9e3282329476b9fab7f0d3e4448f8'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:34.146893 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0e97a900-8bde-47e9-9c2a-65c5ef4f14eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d9e3282329476b9fab7f0d3e4448f8'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:34.147803 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0e97a900-8bde-47e9-9c2a-65c5ef4f14eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d9e3282329476b9fab7f0d3e4448f8'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:34.161950 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-0e97a900-8bde-47e9-9c2a-65c5ef4f14eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d9e3282329476b9fab7f0d3e4448f8'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:34.174335 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1460/2906] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:21:34 2022] DELETE /identity/v3/users/89d9e3282329476b9fab7f0d3e4448f8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:34.451844 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:34.453382 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:34.467193 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4866d1-6c4a-4289-a49e-6943e08fecbe admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:34.524378 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:34.525019 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:34.525302 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:34.525580 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0 admin admin] PATH_INFO: `/v3/projects/31b6ad9e49b54738942a1fb557811781` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:34.526726 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b6ad9e49b54738942a1fb557811781)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:34.528651 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:34.578054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b6ad9e49b54738942a1fb557811781', 'request_id': 'req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:34.580004 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:34.585272 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b6ad9e49b54738942a1fb557811781', 'request_id': 'req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:34.593372 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b6ad9e49b54738942a1fb557811781', 'request_id': 'req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:34.605067 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0 admin admin] The token cache is being invalidate because project 31b6ad9e49b54738942a1fb557811781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:21:34.605360 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:34.606062 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-0fcc2783-3fbe-4edd-9942-cda2e4b8a0d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:21:34.607591 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1447/2907] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:21:34 2022] DELETE /identity/v3/projects/31b6ad9e49b54738942a1fb557811781 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:34.612376 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c1de-b51a-44a3-b081-e6c08a95db4a None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:34.612666 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c1de-b51a-44a3-b081-e6c08a95db4a None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:34.612961 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c1de-b51a-44a3-b081-e6c08a95db4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:34.633235 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-0032c1de-b51a-44a3-b081-e6c08a95db4a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:34.634452 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-0032c1de-b51a-44a3-b081-e6c08a95db4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:34.694774 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1461/2908] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:34.702708 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808c362-ca3c-4abc-aa2f-a4253d3f0c3a None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:34.703054 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808c362-ca3c-4abc-aa2f-a4253d3f0c3a None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:34.703338 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808c362-ca3c-4abc-aa2f-a4253d3f0c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:34.725138 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1808c362-ca3c-4abc-aa2f-a4253d3f0c3a None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:34.726354 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1808c362-ca3c-4abc-aa2f-a4253d3f0c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:34.734362 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1448/2909] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:34.739414 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c1de-b51a-44a3-b081-e6c08a95db4a None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:34.749405 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c1de-b51a-44a3-b081-e6c08a95db4a None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:34.754291 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3e47-9c89-40d0-8477-a08afeb4b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:34.754997 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3e47-9c89-40d0-8477-a08afeb4b8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:34.755284 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3e47-9c89-40d0-8477-a08afeb4b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:34.755562 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3e47-9c89-40d0-8477-a08afeb4b8e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:34.756219 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3e47-9c89-40d0-8477-a08afeb4b8e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 21:21:34.756524 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3e47-9c89-40d0-8477-a08afeb4b8e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:34.758119 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3e47-9c89-40d0-8477-a08afeb4b8e1 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:34.771852 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1462/2910] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Aug 19 21:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 21:21:34.776107 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808c362-ca3c-4abc-aa2f-a4253d3f0c3a None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:34.786667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808c362-ca3c-4abc-aa2f-a4253d3f0c3a None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:34.791464 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af6ebc-d819-45ce-83ae-0d463fea1d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:34.792064 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af6ebc-d819-45ce-83ae-0d463fea1d33 admin admin] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:34.792348 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af6ebc-d819-45ce-83ae-0d463fea1d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:34.792623 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af6ebc-d819-45ce-83ae-0d463fea1d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:34.793256 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af6ebc-d819-45ce-83ae-0d463fea1d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:34.795185 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af6ebc-d819-45ce-83ae-0d463fea1d33 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:34.822568 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1449/2911] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Aug 19 21:21:34 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:34.827592 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3e47-9c89-40d0-8477-a08afeb4b8e1 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:34.838166 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3e47-9c89-40d0-8477-a08afeb4b8e1 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:34.862658 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:34.897722 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e495a4-e006-42ce-a6ea-1ab4f546f64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:34.898327 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e495a4-e006-42ce-a6ea-1ab4f546f64b admin admin] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:34.898612 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e495a4-e006-42ce-a6ea-1ab4f546f64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:34.898923 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e495a4-e006-42ce-a6ea-1ab4f546f64b admin admin] PATH_INFO: `/v3/users` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:34.899558 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e495a4-e006-42ce-a6ea-1ab4f546f64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:34.901488 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e495a4-e006-42ce-a6ea-1ab4f546f64b admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:34.923077 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1463/2912] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Aug 19 21:21:34 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 21:21:34.927595 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af6ebc-d819-45ce-83ae-0d463fea1d33 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:34.937772 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af6ebc-d819-45ce-83ae-0d463fea1d33 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:34.942518 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2398a-034c-4211-937e-fee85b019b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:34.943152 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2398a-034c-4211-937e-fee85b019b89 admin admin] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:34.943433 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2398a-034c-4211-937e-fee85b019b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:34.943706 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2398a-034c-4211-937e-fee85b019b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:34.944343 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2398a-034c-4211-937e-fee85b019b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:34.945974 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2398a-034c-4211-937e-fee85b019b89 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:34.955764 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1450/2913] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:34.960438 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e495a4-e006-42ce-a6ea-1ab4f546f64b admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:34.970643 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e495a4-e006-42ce-a6ea-1ab4f546f64b admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:34.980180 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df09a2b-3116-4db0-a37f-3915611580d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:34.980880 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df09a2b-3116-4db0-a37f-3915611580d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:34.981259 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df09a2b-3116-4db0-a37f-3915611580d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:34.981540 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df09a2b-3116-4db0-a37f-3915611580d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:34.982270 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df09a2b-3116-4db0-a37f-3915611580d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:34.984008 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df09a2b-3116-4db0-a37f-3915611580d4 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:34.994898 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1464/2914] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Aug 19 21:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 21:21:34.999673 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2398a-034c-4211-937e-fee85b019b89 admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:35.010391 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2398a-034c-4211-937e-fee85b019b89 admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:35.015029 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfd4d7-3859-48e4-91cc-66af080c49ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:35.015677 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd4d7-3859-48e4-91cc-66af080c49ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:35.015960 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd4d7-3859-48e4-91cc-66af080c49ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:35.016237 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd4d7-3859-48e4-91cc-66af080c49ed admin admin] PATH_INFO: `/v3/projects/2c4d39eb17444c17a33442b7d993e036/users/80a30e6a8bc14a72aebfe895cc07736f/roles/40d451ce7e0143e682ac5d43622c57d2` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:35.030758 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfd4d7-3859-48e4-91cc-66af080c49ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4d39eb17444c17a33442b7d993e036, user_id=80a30e6a8bc14a72aebfe895cc07736f, role_id=40d451ce7e0143e682ac5d43622c57d2)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:35.033670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfd4d7-3859-48e4-91cc-66af080c49ed admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:35.046915 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1451/2915] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Aug 19 21:21:34 2022] PUT /identity/v3/projects/2c4d39eb17444c17a33442b7d993e036/users/80a30e6a8bc14a72aebfe895cc07736f/roles/40d451ce7e0143e682ac5d43622c57d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:21:35.057795 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6e16-8268-4aca-9214-1b573b277939 None None] REQUEST_METHOD: `POST` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:35.058269 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6e16-8268-4aca-9214-1b573b277939 None None] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:35.058366 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6e16-8268-4aca-9214-1b573b277939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:35.086375 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.auth.core [None req-c8ff6e16-8268-4aca-9214-1b573b277939 None None] MFA Rules not processed for user `80a30e6a8bc14a72aebfe895cc07736f`. Rule list: `[]` (Enabled: `True`). {{(pid=81640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:21:35.087633 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-c8ff6e16-8268-4aca-9214-1b573b277939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:35.153002 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1465/2916] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:21:35.165040 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfd4d7-3859-48e4-91cc-66af080c49ed admin admin] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:21:35.166761 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-a4cfd4d7-3859-48e4-91cc-66af080c49ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:21:35.223878 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfd4d7-3859-48e4-91cc-66af080c49ed admin admin] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:21:35.227667 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeac00c-eab9-4d2e-b690-e6cf6d8d27bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c27e2db991245359bcceb62ff768b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:21:35.228277 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeac00c-eab9-4d2e-b690-e6cf6d8d27bc service cinder] REQUEST_METHOD: `GET` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:21:35.228569 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeac00c-eab9-4d2e-b690-e6cf6d8d27bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:21:35.228846 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeac00c-eab9-4d2e-b690-e6cf6d8d27bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:21:35.237253 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeac00c-eab9-4d2e-b690-e6cf6d8d27bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:21:35.238670 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeac00c-eab9-4d2e-b690-e6cf6d8d27bc service cinder] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:21:35.248220 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1452/2917] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:21:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 21:21:45.150089 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=54,keystone:INSERT=3 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:45.244254 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=59,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:22:07.434772 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6e16-8268-4aca-9214-1b573b277939 None None] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:22:07.502493 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6e16-8268-4aca-9214-1b573b277939 None None] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:22:07.508534 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:22:07.509174 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:22:07.509456 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:22:07.509736 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] PATH_INFO: `/v3/users/80a30e6a8bc14a72aebfe895cc07736f` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:22:07.510918 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a30e6a8bc14a72aebfe895cc07736f)` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:22:07.512832 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:22:07.560817 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a30e6a8bc14a72aebfe895cc07736f'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:22:07.568311 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a30e6a8bc14a72aebfe895cc07736f'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:22:07.568936 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a30e6a8bc14a72aebfe895cc07736f'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:22:07.569550 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a30e6a8bc14a72aebfe895cc07736f'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:22:07.582246 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.notifications [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a30e6a8bc14a72aebfe895cc07736f'} {{(pid=81640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:22:07.595022 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1466/2918] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Aug 19 21:22:07 2022] DELETE /identity/v3/users/80a30e6a8bc14a72aebfe895cc07736f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:22:07.599581 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4062cc-c99b-4b09-9052-c4c615864392 None None] REQUEST_METHOD: `POST` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:22:07.600069 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4062cc-c99b-4b09-9052-c4c615864392 None None] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:22:07.600171 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4062cc-c99b-4b09-9052-c4c615864392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:22:07.619133 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.auth.core [None req-1d4062cc-c99b-4b09-9052-c4c615864392 None None] MFA Rules not processed for user `0e229cb6df1d467b90bf2948d7f02eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 21:22:07.620341 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1d4062cc-c99b-4b09-9052-c4c615864392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:22:07.681127 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1453/2919] 10.222.0.17 () {58 vars in 958 bytes} [Fri Aug 19 21:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 21:22:07.690944 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:22:07.692378 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:22:07.751385 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e9647-5466-4044-946a-734400685241 admin admin] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:22:07.755912 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4516476-3b5b-4320-9212-fa28fe01eddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b17424a40b475480403eb9f4f3f88f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:22:07.756538 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4516476-3b5b-4320-9212-fa28fe01eddd service neutron] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:22:07.756826 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4516476-3b5b-4320-9212-fa28fe01eddd service neutron] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:22:07.757108 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4516476-3b5b-4320-9212-fa28fe01eddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:22:07.767695 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4516476-3b5b-4320-9212-fa28fe01eddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:22:07.769179 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4516476-3b5b-4320-9212-fa28fe01eddd service neutron] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:22:07.781808 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1467/2920] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:22:08.064639 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4062cc-c99b-4b09-9052-c4c615864392 None None] Authenticating user token {{(pid=81641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:22:08.066219 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.fernet_utils [None req-1d4062cc-c99b-4b09-9052-c4c615864392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:22:08.079297 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4062cc-c99b-4b09-9052-c4c615864392 None None] Validating token access rules against request {{(pid=81641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:22:08.084323 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad905c53-c026-405e-94b4-7991f786b336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e229cb6df1d467b90bf2948d7f02eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff8263e17f324e50a27d4a90ba61dbe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:22:08.084971 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad905c53-c026-405e-94b4-7991f786b336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:22:08.085259 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad905c53-c026-405e-94b4-7991f786b336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:22:08.085564 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad905c53-c026-405e-94b4-7991f786b336 admin admin] PATH_INFO: `/v3/projects/2c4d39eb17444c17a33442b7d993e036` {{(pid=81641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:22:08.086876 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad905c53-c026-405e-94b4-7991f786b336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4d39eb17444c17a33442b7d993e036)` {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:22:08.088816 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad905c53-c026-405e-94b4-7991f786b336 admin admin] RBAC: Authorization granted {{(pid=81641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:22:08.155438 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ad905c53-c026-405e-94b4-7991f786b336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4d39eb17444c17a33442b7d993e036', 'request_id': 'req-ad905c53-c026-405e-94b4-7991f786b336'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:22:08.161235 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ad905c53-c026-405e-94b4-7991f786b336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4d39eb17444c17a33442b7d993e036', 'request_id': 'req-ad905c53-c026-405e-94b4-7991f786b336'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:22:08.169282 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ad905c53-c026-405e-94b4-7991f786b336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4d39eb17444c17a33442b7d993e036', 'request_id': 'req-ad905c53-c026-405e-94b4-7991f786b336'} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:22:08.181895 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ad905c53-c026-405e-94b4-7991f786b336 admin admin] The token cache is being invalidate because project 2c4d39eb17444c17a33442b7d993e036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 21:22:08.182191 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ad905c53-c026-405e-94b4-7991f786b336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:22:08.182883 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG keystone.notifications [None req-ad905c53-c026-405e-94b4-7991f786b336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 21:22:08.184477 dv-cinder-852209-6-smb devstack@keystone.service[81641]: [pid: 81641|app: 0|req: 1454/2921] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Aug 19 21:22:08 2022] DELETE /identity/v3/projects/2c4d39eb17444c17a33442b7d993e036 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 21:22:17.775011 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:22:18.177597 dv-cinder-852209-6-smb devstack@keystone.service[81641]: DEBUG dbcounter [-] [81641] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:26:41.420967 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4516476-3b5b-4320-9212-fa28fe01eddd service neutron] Authenticating user token {{(pid=81640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 21:26:41.422408 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-f4516476-3b5b-4320-9212-fa28fe01eddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:26:41.564056 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4516476-3b5b-4320-9212-fa28fe01eddd service neutron] Validating token access rules against request {{(pid=81640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 21:26:41.622863 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a429ba-f5bf-484c-b1e1-898b246646ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0a8d40d21048afa4ce94706e3625c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1defe14eddd4b28ac969adb3d504c7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 21:26:41.623549 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a429ba-f5bf-484c-b1e1-898b246646ad service placement] REQUEST_METHOD: `GET` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 21:26:41.623840 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a429ba-f5bf-484c-b1e1-898b246646ad service placement] SCRIPT_NAME: `/identity` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 21:26:41.624117 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a429ba-f5bf-484c-b1e1-898b246646ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 21:26:41.625872 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.fernet_utils [None req-e1a429ba-f5bf-484c-b1e1-898b246646ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 21:26:41.637121 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a429ba-f5bf-484c-b1e1-898b246646ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 21:26:41.639443 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a429ba-f5bf-484c-b1e1-898b246646ad service placement] RBAC: Authorization granted {{(pid=81640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 21:26:41.649363 dv-cinder-852209-6-smb devstack@keystone.service[81640]: [pid: 81640|app: 0|req: 1468/2922] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Aug 19 21:26:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 21:26:51.645386 dv-cinder-852209-6-smb devstack@keystone.service[81640]: DEBUG dbcounter [-] [81640] Writing DB stats keystone:SELECT=89 {{(pid=81640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}